[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:08:11 dist-test-slave-7vjv krb5kdc[4695](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:08:11 dist-test-slave-7vjv krb5kdc[4695](info): set up 2 sockets
Aug 11 17:08:11 dist-test-slave-7vjv krb5kdc[4695](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 17:08:13.497469 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.566s user 0.005s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:08:13 dist-test-slave-7vjv krb5kdc[4695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468093, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:08:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:08:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:08:13.656879 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:35149
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:43207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:35149
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:13.809587 4720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:13.809993 4720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:13.810105 4720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:13.814580 4720 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:08:13.814697 4720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:13.814736 4720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:13.814777 4720 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:08:13.814811 4720 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:08:13.821496 4720 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:43207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:35149
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:35149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4720
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:13.822875 4720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:13.824172 4720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 17:08:13.836439 4720 server_base.cc:1034] running on GCE node
W20260811 17:08:13.836807 4734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:13.838129 4730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:13.838145 4731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:13.839100 4720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:13.840571 4720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:13.841806 4720 hybrid_clock.cc:648] HybridClock initialized: now 1786468093841761 us; error 118 us; skew 500 ppm
Aug 11 17:08:13 dist-test-slave-7vjv krb5kdc[4695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468093, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:13.849243 4720 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:08:13.850499 4720 webserver.cc:460] Webserver started at http://127.4.146.254:42431/ using document root <none> and password file <none>
I20260811 17:08:13.851168 4720 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:13.851279 4720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:13.851547 4720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:13.854158 4720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "b0991699d9d640038ccb90b935648e73"
format_stamp: "Formatted at 2026-08-11 17:08:13 on dist-test-slave-7vjv"
server_key: "97cd69f4c087ef4143fe59215f2f0a43"
server_key_iv: "79c89189e4390b15783503a97c382129"
server_key_version: "encryptionkey@0"
I20260811 17:08:13.854882 4720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "b0991699d9d640038ccb90b935648e73"
format_stamp: "Formatted at 2026-08-11 17:08:13 on dist-test-slave-7vjv"
server_key: "97cd69f4c087ef4143fe59215f2f0a43"
server_key_iv: "79c89189e4390b15783503a97c382129"
server_key_version: "encryptionkey@0"
I20260811 17:08:13.859162 4720 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260811 17:08:13.862026 4744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:13.863428 4720 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 17:08:13.863608 4720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "b0991699d9d640038ccb90b935648e73"
format_stamp: "Formatted at 2026-08-11 17:08:13 on dist-test-slave-7vjv"
server_key: "97cd69f4c087ef4143fe59215f2f0a43"
server_key_iv: "79c89189e4390b15783503a97c382129"
server_key_version: "encryptionkey@0"
I20260811 17:08:13.863790 4720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:13.882830 4720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:13.886408 4720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:13.886649 4720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:13.895040 4720 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:35149
I20260811 17:08:13.895076 4850 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:35149 every 8 connection(s)
I20260811 17:08:13.896162 4720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:08:13.897429 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 4720
I20260811 17:08:13.897605 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:08:13.899446 4683 external_mini_cluster.cc:1428] Setting key bde743deeaadc56b69d4730b75052069
I20260811 17:08:13.900231 4851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:13.908280 4851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0991699d9d640038ccb90b935648e73: Bootstrap starting.
I20260811 17:08:13.911360 4851 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0991699d9d640038ccb90b935648e73: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:13.912565 4851 log.cc:824] T 00000000000000000000000000000000 P b0991699d9d640038ccb90b935648e73: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:13.914919 4851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0991699d9d640038ccb90b935648e73: No bootstrap required, opened a new log
I20260811 17:08:13.920584 4851 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0991699d9d640038ccb90b935648e73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0991699d9d640038ccb90b935648e73" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35149 } }
I20260811 17:08:13.920958 4851 raft_consensus.cc:374] T 00000000000000000000000000000000 P b0991699d9d640038ccb90b935648e73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:13.921020 4851 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0991699d9d640038ccb90b935648e73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0991699d9d640038ccb90b935648e73, State: Initialized, Role: FOLLOWER
I20260811 17:08:13.921617 4851 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0991699d9d640038ccb90b935648e73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0991699d9d640038ccb90b935648e73" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35149 } }
I20260811 17:08:13.921921 4851 raft_consensus.cc:388] T 00000000000000000000000000000000 P b0991699d9d640038ccb90b935648e73 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:08:13.922016 4851 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0991699d9d640038ccb90b935648e73 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:08:13.922142 4851 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0991699d9d640038ccb90b935648e73 [term 0 FOLLOWER]: Advancing to term 1
Aug 11 17:08:13 dist-test-slave-7vjv krb5kdc[4695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468093, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:13.923379 4851 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0991699d9d640038ccb90b935648e73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0991699d9d640038ccb90b935648e73" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35149 } }
I20260811 17:08:13.923888 4851 leader_election.cc:302] T 00000000000000000000000000000000 P b0991699d9d640038ccb90b935648e73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0991699d9d640038ccb90b935648e73; no voters:
I20260811 17:08:13.924365 4851 leader_election.cc:288] T 00000000000000000000000000000000 P b0991699d9d640038ccb90b935648e73 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:08:13.924540 4861 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b0991699d9d640038ccb90b935648e73 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:13.924840 4861 raft_consensus.cc:686] T 00000000000000000000000000000000 P b0991699d9d640038ccb90b935648e73 [term 1 LEADER]: Becoming Leader. State: Replica: b0991699d9d640038ccb90b935648e73, State: Running, Role: LEADER
I20260811 17:08:13.925278 4861 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0991699d9d640038ccb90b935648e73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0991699d9d640038ccb90b935648e73" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35149 } }
I20260811 17:08:13.926021 4851 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0991699d9d640038ccb90b935648e73 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:08:13.927564 4862 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0991699d9d640038ccb90b935648e73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b0991699d9d640038ccb90b935648e73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0991699d9d640038ccb90b935648e73" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35149 } } }
I20260811 17:08:13.927716 4862 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0991699d9d640038ccb90b935648e73 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:13.928077 4865 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0991699d9d640038ccb90b935648e73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0991699d9d640038ccb90b935648e73. Latest consensus state: current_term: 1 leader_uuid: "b0991699d9d640038ccb90b935648e73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0991699d9d640038ccb90b935648e73" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35149 } } }
I20260811 17:08:13.928246 4865 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0991699d9d640038ccb90b935648e73 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:13.931277 4856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:13.903748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54330 (local address 127.4.146.254:35149)
0811 17:08:13.904305 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:13.904325 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:13.905438 (+ 1113us) server_negotiation.cc:407] Connection header received
0811 17:08:13.909773 (+ 4335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:13.909790 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:13.910166 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:13.910451 (+ 285us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:13.913861 (+ 3410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:13.915117 (+ 1256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:13.917165 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:13.917731 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:13.917889 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:13.923715 (+ 5826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:13.923722 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:13.923742 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:13.923782 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:13.926290 (+ 2508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:13.927191 (+ 901us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:13.927202 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:13.927211 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:13.927397 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:13.927915 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:13.927919 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:13.927921 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:13.928670 (+ 749us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:13.928915 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:13.929890 (+ 975us) server_negotiation.cc:299] Negotiation successful
0811 17:08:13.930220 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":167,"threads_started":1}
W20260811 17:08:13.932297 4885 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b0991699d9d640038ccb90b935648e73: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 17:08:13.932391 4885 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 17:08:13.932461 4873 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:08:13.933367 4873 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:08:13.940579 4873 catalog_manager.cc:1347] Generated new cluster ID: a1794d02da064a69b7b32288dada1ed1
I20260811 17:08:13.940678 4873 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:08:13.952809 4873 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:08:13.954322 4873 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:08:13.959793 4873 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b0991699d9d640038ccb90b935648e73: Generated new TSK 0
I20260811 17:08:13.960809 4873 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
I20260811 17:08:14.006742 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:35149
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:43207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:14.179013 4906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:14.179351 4906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:14.179404 4906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:14.183843 4906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:14.183952 4906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:14.184067 4906 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:08:14.190364 4906 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:43207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:35149
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4906
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:14.191700 4906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:14.192945 4906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:14.206475 4914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:14.206568 4921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:14.206454 4913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:14.206969 4906 server_base.cc:1034] running on GCE node
I20260811 17:08:14.207484 4906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:14.208280 4906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:14.209504 4906 hybrid_clock.cc:648] HybridClock initialized: now 1786468094209478 us; error 36 us; skew 500 ppm
Aug 11 17:08:14 dist-test-slave-7vjv krb5kdc[4695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468094, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:14.213024 4906 init.cc:377] Logged in from keytab as kudu/127.4.146.193@KRBTEST.COM (short username kudu)
I20260811 17:08:14.214228 4906 webserver.cc:460] Webserver started at http://127.4.146.193:40921/ using document root <none> and password file <none>
I20260811 17:08:14.214893 4906 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:14.214972 4906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:14.215241 4906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:14.218307 4906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "53cd495c67da4036afd1f771c703a347"
format_stamp: "Formatted at 2026-08-11 17:08:14 on dist-test-slave-7vjv"
server_key: "c1ab25f1677ffeb9de4bf1985f72219a"
server_key_iv: "35f6af699a7bc266f94cefe6131c61bb"
server_key_version: "encryptionkey@0"
I20260811 17:08:14.219154 4906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "53cd495c67da4036afd1f771c703a347"
format_stamp: "Formatted at 2026-08-11 17:08:14 on dist-test-slave-7vjv"
server_key: "c1ab25f1677ffeb9de4bf1985f72219a"
server_key_iv: "35f6af699a7bc266f94cefe6131c61bb"
server_key_version: "encryptionkey@0"
I20260811 17:08:14.224347 4906 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 17:08:14.228255 4933 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:14.230039 4906 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 17:08:14.230276 4906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "53cd495c67da4036afd1f771c703a347"
format_stamp: "Formatted at 2026-08-11 17:08:14 on dist-test-slave-7vjv"
server_key: "c1ab25f1677ffeb9de4bf1985f72219a"
server_key_iv: "35f6af699a7bc266f94cefe6131c61bb"
server_key_version: "encryptionkey@0"
I20260811 17:08:14.230450 4906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:14.256795 4906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:14.263944 4906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:14.264595 4906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:14.266209 4906 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:14.268637 4906 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:14.268808 4906 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:14.269024 4906 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:14.269130 4906 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:14.314430 4906 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:41779
I20260811 17:08:14.314673 5158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:41779 every 8 connection(s)
I20260811 17:08:14.316876 4906 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:08:14.319401 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 4906
I20260811 17:08:14.319661 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
I20260811 17:08:14.320358 4683 external_mini_cluster.cc:1428] Setting key eb810fdb4d55d493f461dbb275580bb0
Aug 11 17:08:14 dist-test-slave-7vjv krb5kdc[4695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468094, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.146.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.194@KRBTEST.COM" created.
I20260811 17:08:14.366891 4856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:14.322299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:59739 (local address 127.4.146.254:35149)
0811 17:08:14.322544 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:14.322556 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:14.325965 (+ 3409us) server_negotiation.cc:407] Connection header received
0811 17:08:14.333494 (+ 7529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:14.333511 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:14.333717 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:14.334093 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:14.340184 (+ 6091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:14.342073 (+ 1889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:14.345554 (+ 3481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:14.346092 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:14.346485 (+ 393us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:14.356513 (+ 10028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:14.356536 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:14.356540 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:14.356660 (+ 120us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:14.361405 (+ 4745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:14.363094 (+ 1689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:14.363099 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:14.363107 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:14.363314 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:14.364018 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:14.364030 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:14.364032 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:14.364676 (+ 644us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:14.364835 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:14.366154 (+ 1319us) server_negotiation.cc:299] Negotiation successful
0811 17:08:14.366450 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 17:08:14.369490 5162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:14.323512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:35149 (local address 127.4.146.193:59739)
0811 17:08:14.325334 (+ 1822us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:14.325555 (+ 221us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:14.332491 (+ 6936us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:14.334398 (+ 1907us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:14.334409 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:14.335763 (+ 1354us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:14.339224 (+ 3461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:14.339372 (+ 148us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:14.342439 (+ 3067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:14.342454 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:14.345113 (+ 2659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:14.345143 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:14.346638 (+ 1495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:14.346653 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:14.347179 (+ 526us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:14.349088 (+ 1909us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:14.349166 (+ 78us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:14.355759 (+ 6593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:14.361871 (+ 6112us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:14.361884 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:14.361923 (+ 39us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:14.362767 (+ 844us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:14.363522 (+ 755us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:14.363525 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:14.363527 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:14.363855 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:14.364847 (+ 992us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:14.364861 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:14.365493 (+ 632us) client_negotiation.cc:769] Sending connection context
0811 17:08:14.366057 (+ 564us) client_negotiation.cc:240] Negotiation successful
0811 17:08:14.367161 (+ 1104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":998,"thread_start_us":309,"threads_started":1}
I20260811 17:08:14.373903 5159 heartbeater.cc:347] Connected to a master server at 127.4.146.254:35149
I20260811 17:08:14.374432 5159 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:14.375749 5159 heartbeater.cc:511] Master 127.4.146.254:35149 requested a full tablet report, sending...
I20260811 17:08:14.379858 4785 ts_manager.cc:194] Registered new tserver with Master: 53cd495c67da4036afd1f771c703a347 (127.4.146.193:41779)
I20260811 17:08:14.383111 4785 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.193@KRBTEST.COM'} at 127.4.146.193:59739
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
I20260811 17:08:14.406109 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:35149
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:43207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:14.731359 5168 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:14.732229 5168 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:14.732467 5168 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:14.743690 5168 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:14.744022 5168 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:14.744398 5168 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:08:14.761255 5168 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:43207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:35149
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5168
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:14.764708 5168 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:14.768473 5168 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:14.795984 5178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:14.796244 5183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:14.796026 5181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:14.796617 5168 server_base.cc:1034] running on GCE node
I20260811 17:08:14.798079 5168 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:14.799767 5168 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:14.803305 5168 hybrid_clock.cc:648] HybridClock initialized: now 1786468094803253 us; error 94 us; skew 500 ppm
Aug 11 17:08:14 dist-test-slave-7vjv krb5kdc[4695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468094, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:14.811354 5168 init.cc:377] Logged in from keytab as kudu/127.4.146.194@KRBTEST.COM (short username kudu)
I20260811 17:08:14.813959 5168 webserver.cc:460] Webserver started at http://127.4.146.194:43979/ using document root <none> and password file <none>
I20260811 17:08:14.815696 5168 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:14.816044 5168 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:14.816710 5168 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:14.823495 5168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "49b3bddc24894c66acd3f2118789f340"
format_stamp: "Formatted at 2026-08-11 17:08:14 on dist-test-slave-7vjv"
server_key: "0e8f33b8925251dd1666b25381b8e902"
server_key_iv: "0a969ddd3132071a94992394276a259d"
server_key_version: "encryptionkey@0"
I20260811 17:08:14.826124 5168 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "49b3bddc24894c66acd3f2118789f340"
format_stamp: "Formatted at 2026-08-11 17:08:14 on dist-test-slave-7vjv"
server_key: "0e8f33b8925251dd1666b25381b8e902"
server_key_iv: "0a969ddd3132071a94992394276a259d"
server_key_version: "encryptionkey@0"
I20260811 17:08:14.842482 5168 fs_manager.cc:691] Time spent creating directory manager: real 0.015s user 0.012s sys 0.000s
I20260811 17:08:14.850762 5192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:14.854628 5168 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.004s sys 0.002s
I20260811 17:08:14.855090 5168 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "49b3bddc24894c66acd3f2118789f340"
format_stamp: "Formatted at 2026-08-11 17:08:14 on dist-test-slave-7vjv"
server_key: "0e8f33b8925251dd1666b25381b8e902"
server_key_iv: "0a969ddd3132071a94992394276a259d"
server_key_version: "encryptionkey@0"
I20260811 17:08:14.855402 5168 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:14.904735 5168 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:14.916431 5168 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:14.916975 5168 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:14.919356 5168 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:14.923385 5168 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:14.923529 5168 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:14.923646 5168 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:14.923691 5168 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:14.970245 5168 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:36965
I20260811 17:08:14.970359 5399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:36965 every 8 connection(s)
I20260811 17:08:14.972271 5168 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:08:14.975174 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 5168
I20260811 17:08:14.975567 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:08:14.976466 4683 external_mini_cluster.cc:1428] Setting key 24a51992b8787bf73c4c9879ab92c328
Aug 11 17:08:14 dist-test-slave-7vjv krb5kdc[4695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468094, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.195@KRBTEST.COM" created.
I20260811 17:08:15.016613 5403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:14.978241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:38325 (local address 127.4.146.254:35149)
0811 17:08:14.979230 (+ 989us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:14.979238 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:14.982964 (+ 3726us) server_negotiation.cc:407] Connection header received
0811 17:08:14.989253 (+ 6289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:14.989260 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:14.989402 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:14.989678 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:14.993249 (+ 3571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:14.994287 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:14.997429 (+ 3142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:14.997935 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:14.998238 (+ 303us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:15.005126 (+ 6888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:15.005135 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:15.005141 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:15.005212 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:15.009212 (+ 4000us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:15.010544 (+ 1332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:15.010565 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:15.010582 (+ 17us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:15.010900 (+ 318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:15.011817 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:15.011822 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:15.011823 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:15.012455 (+ 632us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:15.012634 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:15.015860 (+ 3226us) server_negotiation.cc:299] Negotiation successful
0811 17:08:15.016360 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":723,"thread_start_us":406,"threads_started":1}
I20260811 17:08:15.020709 5404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:14.980286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:35149 (local address 127.4.146.194:38325)
0811 17:08:14.982316 (+ 2030us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:14.982618 (+ 302us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:14.988739 (+ 6121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:14.990165 (+ 1426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:14.990183 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:14.991178 (+ 995us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:14.992877 (+ 1699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:14.992918 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:14.994670 (+ 1752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:14.994677 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:14.997009 (+ 2332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:14.997070 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:14.998368 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:14.998412 (+ 44us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:14.998991 (+ 579us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:15.000463 (+ 1472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:15.000499 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:15.004580 (+ 4081us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:15.009449 (+ 4869us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:15.009465 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:15.009499 (+ 34us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:15.010220 (+ 721us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:15.011156 (+ 936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:15.011160 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:15.011162 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:15.011556 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:15.012730 (+ 1174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:15.012763 (+ 33us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:15.014497 (+ 1734us) client_negotiation.cc:769] Sending connection context
0811 17:08:15.015710 (+ 1213us) client_negotiation.cc:240] Negotiation successful
0811 17:08:15.017165 (+ 1455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1086,"thread_start_us":537,"threads_started":1}
I20260811 17:08:15.025182 5400 heartbeater.cc:347] Connected to a master server at 127.4.146.254:35149
I20260811 17:08:15.025928 5400 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:15.027453 5400 heartbeater.cc:511] Master 127.4.146.254:35149 requested a full tablet report, sending...
I20260811 17:08:15.030946 4785 ts_manager.cc:194] Registered new tserver with Master: 49b3bddc24894c66acd3f2118789f340 (127.4.146.194:36965)
I20260811 17:08:15.032271 4785 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.194@KRBTEST.COM'} at 127.4.146.194:38325
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
I20260811 17:08:15.059222 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:35149
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:43207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 17:08:15.389562 5159 heartbeater.cc:503] Master 127.4.146.254:35149 was elected leader, sending a full tablet report...
W20260811 17:08:15.458274 5410 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:15.459049 5410 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:15.459384 5410 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:15.469856 5410 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:15.470010 5410 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:15.470235 5410 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:08:15.483534 5410 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:43207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:35149
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5410
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:15.486500 5410 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:15.489102 5410 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:15.514829 5417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:15.514974 5416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:15.514719 5422 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:15.515424 5410 server_base.cc:1034] running on GCE node
I20260811 17:08:15.516841 5410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:15.518384 5410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:15.521814 5410 hybrid_clock.cc:648] HybridClock initialized: now 1786468095521718 us; error 91 us; skew 500 ppm
Aug 11 17:08:15 dist-test-slave-7vjv krb5kdc[4695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468095, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:15.529909 5410 init.cc:377] Logged in from keytab as kudu/127.4.146.195@KRBTEST.COM (short username kudu)
I20260811 17:08:15.532485 5410 webserver.cc:460] Webserver started at http://127.4.146.195:43413/ using document root <none> and password file <none>
I20260811 17:08:15.533366 5410 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:15.533452 5410 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:15.533715 5410 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:15.538625 5410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "98326f5cd9684e6fa980ffbf4a693518"
format_stamp: "Formatted at 2026-08-11 17:08:15 on dist-test-slave-7vjv"
server_key: "5c23e0e2aca9760f33b0d85b2f7626f8"
server_key_iv: "4debf9368bb33971ccd3336b563ce83b"
server_key_version: "encryptionkey@0"
I20260811 17:08:15.540172 5410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "98326f5cd9684e6fa980ffbf4a693518"
format_stamp: "Formatted at 2026-08-11 17:08:15 on dist-test-slave-7vjv"
server_key: "5c23e0e2aca9760f33b0d85b2f7626f8"
server_key_iv: "4debf9368bb33971ccd3336b563ce83b"
server_key_version: "encryptionkey@0"
I20260811 17:08:15.550467 5410 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.002s sys 0.005s
I20260811 17:08:15.557447 5435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:15.561058 5410 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.005s sys 0.001s
I20260811 17:08:15.561394 5410 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "98326f5cd9684e6fa980ffbf4a693518"
format_stamp: "Formatted at 2026-08-11 17:08:15 on dist-test-slave-7vjv"
server_key: "5c23e0e2aca9760f33b0d85b2f7626f8"
server_key_iv: "4debf9368bb33971ccd3336b563ce83b"
server_key_version: "encryptionkey@0"
I20260811 17:08:15.561672 5410 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:15.592227 5410 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:15.601496 5410 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:15.602089 5410 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:15.603821 5410 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:15.606216 5410 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:15.606427 5410 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:15.606704 5410 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:15.606763 5410 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:15.651319 5410 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:42005
I20260811 17:08:15.651408 5637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:42005 every 8 connection(s)
I20260811 17:08:15.653674 5410 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:08:15.661978 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 5410
I20260811 17:08:15.662331 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:08:15.663203 4683 external_mini_cluster.cc:1428] Setting key 7609cac886835c25199af271055c0cd2
Aug 11 17:08:15 dist-test-slave-7vjv krb5kdc[4695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468095, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:15.694072 5640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:15.659008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:34343 (local address 127.4.146.254:35149)
0811 17:08:15.659645 (+ 637us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:15.659651 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:15.662002 (+ 2351us) server_negotiation.cc:407] Connection header received
0811 17:08:15.666398 (+ 4396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:15.666401 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:15.666496 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:15.666839 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:15.671081 (+ 4242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:15.672338 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:15.675930 (+ 3592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:15.676683 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:15.676845 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:15.683772 (+ 6927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:15.683794 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:15.683803 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:15.683865 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:15.687620 (+ 3755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:15.689589 (+ 1969us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:15.689595 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:15.689596 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:15.689853 (+ 257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:15.691171 (+ 1318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:15.691181 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:15.691183 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:15.691724 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:15.691875 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:15.693359 (+ 1484us) server_negotiation.cc:299] Negotiation successful
0811 17:08:15.693713 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":429,"thread_start_us":260,"threads_started":1}
I20260811 17:08:15.696688 5642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:15.660326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:35149 (local address 127.4.146.195:34343)
0811 17:08:15.661551 (+ 1225us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:15.661674 (+ 123us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:15.665924 (+ 4250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:15.667342 (+ 1418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:15.667390 (+ 48us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:15.668868 (+ 1478us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:15.670582 (+ 1714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:15.670621 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:15.672758 (+ 2137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:15.672769 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:15.675579 (+ 2810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:15.675602 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:15.676938 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:15.676954 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:15.677409 (+ 455us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:15.678822 (+ 1413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:15.678873 (+ 51us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:15.683206 (+ 4333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:15.688002 (+ 4796us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:15.688067 (+ 65us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:15.688209 (+ 142us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:15.689288 (+ 1079us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:15.690109 (+ 821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:15.690126 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:15.690171 (+ 45us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:15.690883 (+ 712us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:15.692002 (+ 1119us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:15.692023 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:15.692738 (+ 715us) client_negotiation.cc:769] Sending connection context
0811 17:08:15.693215 (+ 477us) client_negotiation.cc:240] Negotiation successful
0811 17:08:15.693828 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":752,"thread_start_us":333,"threads_started":1}
I20260811 17:08:15.699790 5638 heartbeater.cc:347] Connected to a master server at 127.4.146.254:35149
I20260811 17:08:15.700549 5638 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:15.701719 5638 heartbeater.cc:511] Master 127.4.146.254:35149 requested a full tablet report, sending...
I20260811 17:08:15.704370 4779 ts_manager.cc:194] Registered new tserver with Master: 98326f5cd9684e6fa980ffbf4a693518 (127.4.146.195:42005)
I20260811 17:08:15.706058 4779 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.195@KRBTEST.COM'} at 127.4.146.195:34343
I20260811 17:08:15.713073 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 17:08:15 dist-test-slave-7vjv krb5kdc[4695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468095, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 17:08:15 dist-test-slave-7vjv krb5kdc[4695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468095, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.146.193@KRBTEST.COM
I20260811 17:08:15.819983 5650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:15.771732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59956 (local address 127.4.146.193:41779)
0811 17:08:15.772891 (+ 1159us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:15.772918 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:15.773733 (+ 815us) server_negotiation.cc:407] Connection header received
0811 17:08:15.773933 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:15.773941 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:15.774416 (+ 475us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:15.775384 (+ 968us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:15.778465 (+ 3081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:15.781687 (+ 3222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:15.787255 (+ 5568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:15.788982 (+ 1727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:15.789521 (+ 539us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:15.801926 (+ 12405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:15.801963 (+ 37us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:15.802017 (+ 54us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:15.802172 (+ 155us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:15.810834 (+ 8662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:15.814160 (+ 3326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:15.814204 (+ 44us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:15.814212 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:15.814667 (+ 455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:15.816048 (+ 1381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:15.816072 (+ 24us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:15.816087 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:15.817188 (+ 1101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:15.817720 (+ 532us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:15.818676 (+ 956us) server_negotiation.cc:299] Negotiation successful
0811 17:08:15.819170 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":730,"thread_start_us":182,"threads_started":1}
W20260811 17:08:15.823572 4997 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59956
Aug 11 17:08:15 dist-test-slave-7vjv krb5kdc[4695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468095, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 17:08:15 dist-test-slave-7vjv krb5kdc[4695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468095, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.193@KRBTEST.COM
I20260811 17:08:15.953655 5650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:15.898501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59958 (local address 127.4.146.193:41779)
0811 17:08:15.899096 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:15.899111 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:15.900936 (+ 1825us) server_negotiation.cc:407] Connection header received
0811 17:08:15.901486 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:15.901524 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:15.901861 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:15.902548 (+ 687us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:15.906102 (+ 3554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:15.908559 (+ 2457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:15.913666 (+ 5107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:15.915603 (+ 1937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:15.916028 (+ 425us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:15.946334 (+ 30306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:15.946363 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:15.946389 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:15.946576 (+ 187us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:15.951028 (+ 4452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:15.951898 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:15.951905 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:15.951907 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:15.952077 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:15.952534 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:15.952537 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:15.952539 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:15.952777 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:15.952926 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:15.953272 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 17:08:15.953450 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243}
I20260811 17:08:15.954835 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 4906
I20260811 17:08:15.971735 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 5168
I20260811 17:08:15.981776 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 5410
I20260811 17:08:16.008724 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 4720
2026-08-11T17:08:16Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4121 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:08:16 dist-test-slave-7vjv krb5kdc[5664](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:08:16 dist-test-slave-7vjv krb5kdc[5664](info): set up 2 sockets
Aug 11 17:08:16 dist-test-slave-7vjv krb5kdc[5664](info): commencing operation
krb5kdc: starting...
W20260811 17:08:17.358207 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.316s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:08:17 dist-test-slave-7vjv krb5kdc[5664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:08:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:08:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:08:17.497759 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:45237
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:43329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:45237
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:17.615818 5687 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:17.616214 5687 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:17.616324 5687 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:17.620564 5687 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:08:17.620673 5687 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:17.620711 5687 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:17.620754 5687 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:08:17.620786 5687 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:08:17.626233 5687 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:43329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:45237
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:45237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5687
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:17.627378 5687 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:17.628502 5687 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:17.637496 5695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:17.639118 5697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:17.639209 5694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:17.639321 5687 server_base.cc:1034] running on GCE node
I20260811 17:08:17.640021 5687 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:17.641307 5687 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:17.642477 5687 hybrid_clock.cc:648] HybridClock initialized: now 1786468097642462 us; error 35 us; skew 500 ppm
Aug 11 17:08:17 dist-test-slave-7vjv krb5kdc[5664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468097, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:17.645485 5687 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:08:17.646481 5687 webserver.cc:460] Webserver started at http://127.4.146.254:35445/ using document root <none> and password file <none>
I20260811 17:08:17.647071 5687 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:17.647168 5687 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:17.647408 5687 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:17.649585 5687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "1ac8278e800041a98758be5905d4a043"
format_stamp: "Formatted at 2026-08-11 17:08:17 on dist-test-slave-7vjv"
server_key: "af14b9f7436f91f35a69ab26d6ab8939"
server_key_iv: "47ffde1abf58d3856bf9015b2f6e6340"
server_key_version: "encryptionkey@0"
I20260811 17:08:17.650183 5687 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "1ac8278e800041a98758be5905d4a043"
format_stamp: "Formatted at 2026-08-11 17:08:17 on dist-test-slave-7vjv"
server_key: "af14b9f7436f91f35a69ab26d6ab8939"
server_key_iv: "47ffde1abf58d3856bf9015b2f6e6340"
server_key_version: "encryptionkey@0"
I20260811 17:08:17.654062 5687 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 17:08:17.656615 5709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:17.657892 5687 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 17:08:17.658039 5687 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "1ac8278e800041a98758be5905d4a043"
format_stamp: "Formatted at 2026-08-11 17:08:17 on dist-test-slave-7vjv"
server_key: "af14b9f7436f91f35a69ab26d6ab8939"
server_key_iv: "47ffde1abf58d3856bf9015b2f6e6340"
server_key_version: "encryptionkey@0"
I20260811 17:08:17.658157 5687 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:17.674450 5687 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:17.677594 5687 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:17.677827 5687 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:17.685782 5687 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:45237
I20260811 17:08:17.685818 5796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:45237 every 8 connection(s)
I20260811 17:08:17.686842 5687 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:08:17.690052 5799 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:17.695883 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 5687
I20260811 17:08:17.696015 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:08:17.696333 4683 external_mini_cluster.cc:1428] Setting key 853e93dd6945bbd97043810cfc81a313
I20260811 17:08:17.696412 5799 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ac8278e800041a98758be5905d4a043: Bootstrap starting.
I20260811 17:08:17.699796 5799 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ac8278e800041a98758be5905d4a043: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:17.701051 5799 log.cc:824] T 00000000000000000000000000000000 P 1ac8278e800041a98758be5905d4a043: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:17.703315 5799 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ac8278e800041a98758be5905d4a043: No bootstrap required, opened a new log
Aug 11 17:08:17 dist-test-slave-7vjv krb5kdc[5664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:17.707914 5799 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ac8278e800041a98758be5905d4a043 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ac8278e800041a98758be5905d4a043" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 45237 } }
I20260811 17:08:17.708225 5799 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1ac8278e800041a98758be5905d4a043 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:17.708303 5799 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ac8278e800041a98758be5905d4a043 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ac8278e800041a98758be5905d4a043, State: Initialized, Role: FOLLOWER
I20260811 17:08:17.708760 5799 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ac8278e800041a98758be5905d4a043 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ac8278e800041a98758be5905d4a043" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 45237 } }
I20260811 17:08:17.708896 5799 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1ac8278e800041a98758be5905d4a043 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:08:17.708977 5799 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ac8278e800041a98758be5905d4a043 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:08:17.709087 5799 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ac8278e800041a98758be5905d4a043 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:17.710371 5799 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ac8278e800041a98758be5905d4a043 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ac8278e800041a98758be5905d4a043" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 45237 } }
I20260811 17:08:17.710763 5799 leader_election.cc:302] T 00000000000000000000000000000000 P 1ac8278e800041a98758be5905d4a043 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ac8278e800041a98758be5905d4a043; no voters:
I20260811 17:08:17.711141 5799 leader_election.cc:288] T 00000000000000000000000000000000 P 1ac8278e800041a98758be5905d4a043 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:08:17.711238 5810 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ac8278e800041a98758be5905d4a043 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:17.711665 5810 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ac8278e800041a98758be5905d4a043 [term 1 LEADER]: Becoming Leader. State: Replica: 1ac8278e800041a98758be5905d4a043, State: Running, Role: LEADER
I20260811 17:08:17.712134 5810 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ac8278e800041a98758be5905d4a043 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ac8278e800041a98758be5905d4a043" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 45237 } }
I20260811 17:08:17.712656 5799 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ac8278e800041a98758be5905d4a043 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:08:17.712934 5805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:17.697845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36396 (local address 127.4.146.254:45237)
0811 17:08:17.698462 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:17.698487 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:17.698523 (+ 36us) server_negotiation.cc:407] Connection header received
0811 17:08:17.699170 (+ 647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:17.699188 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:17.699532 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:17.699843 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:17.700945 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:17.702044 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:17.703194 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:17.703726 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:17.703850 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:17.706860 (+ 3010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:17.706865 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:17.706880 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:17.706910 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:17.709281 (+ 2371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:17.709780 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:17.709785 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:17.709790 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:17.709911 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:17.710245 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:17.710248 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:17.710249 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:17.710812 (+ 563us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:17.711057 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:17.711538 (+ 481us) server_negotiation.cc:299] Negotiation successful
0811 17:08:17.711892 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":335,"threads_started":1}
I20260811 17:08:17.713446 5810 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ac8278e800041a98758be5905d4a043 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ac8278e800041a98758be5905d4a043. Latest consensus state: current_term: 1 leader_uuid: "1ac8278e800041a98758be5905d4a043" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ac8278e800041a98758be5905d4a043" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 45237 } } }
I20260811 17:08:17.713619 5810 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ac8278e800041a98758be5905d4a043 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:17.714170 5811 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ac8278e800041a98758be5905d4a043 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1ac8278e800041a98758be5905d4a043" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ac8278e800041a98758be5905d4a043" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 45237 } } }
I20260811 17:08:17.714283 5811 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ac8278e800041a98758be5905d4a043 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:17.715970 5823 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:08:17.719239 5823 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:08:17.725558 5823 catalog_manager.cc:1347] Generated new cluster ID: aa86c4ebd8ca4d60a9476c116cffb893
I20260811 17:08:17.725652 5823 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:08:17.744302 5823 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:08:17.745415 5823 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:08:17.762121 5823 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1ac8278e800041a98758be5905d4a043: Generated new TSK 0
I20260811 17:08:17.762980 5823 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
I20260811 17:08:17.799691 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:45237
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:43329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:17.919193 5844 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:17.919494 5844 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:17.919540 5844 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:17.923699 5844 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:17.923780 5844 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:17.923866 5844 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:08:17.929482 5844 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:43329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:45237
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5844
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:17.930660 5844 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:17.931762 5844 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:17.942117 5854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:17.942112 5850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:17.942112 5857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:17.942759 5844 server_base.cc:1034] running on GCE node
I20260811 17:08:17.943243 5844 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:17.943957 5844 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:17.945139 5844 hybrid_clock.cc:648] HybridClock initialized: now 1786468097945099 us; error 55 us; skew 500 ppm
Aug 11 17:08:17 dist-test-slave-7vjv krb5kdc[5664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468097, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:17.948465 5844 init.cc:377] Logged in from keytab as kudu/127.4.146.193@KRBTEST.COM (short username kudu)
I20260811 17:08:17.949415 5844 webserver.cc:460] Webserver started at http://127.4.146.193:41111/ using document root <none> and password file <none>
I20260811 17:08:17.950006 5844 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:17.950075 5844 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:17.950290 5844 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:17.952457 5844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "66cace5d1ee845739dd2188e273aa124"
format_stamp: "Formatted at 2026-08-11 17:08:17 on dist-test-slave-7vjv"
server_key: "167869d21c511f3aee472a8a4aaaf4a2"
server_key_iv: "be7b1388b415061c7deda9ece7d0e526"
server_key_version: "encryptionkey@0"
I20260811 17:08:17.953050 5844 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "66cace5d1ee845739dd2188e273aa124"
format_stamp: "Formatted at 2026-08-11 17:08:17 on dist-test-slave-7vjv"
server_key: "167869d21c511f3aee472a8a4aaaf4a2"
server_key_iv: "be7b1388b415061c7deda9ece7d0e526"
server_key_version: "encryptionkey@0"
I20260811 17:08:17.957011 5844 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 17:08:17.960150 5869 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:17.962101 5844 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 17:08:17.962270 5844 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "66cace5d1ee845739dd2188e273aa124"
format_stamp: "Formatted at 2026-08-11 17:08:17 on dist-test-slave-7vjv"
server_key: "167869d21c511f3aee472a8a4aaaf4a2"
server_key_iv: "be7b1388b415061c7deda9ece7d0e526"
server_key_version: "encryptionkey@0"
I20260811 17:08:17.962427 5844 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:17.984544 5844 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:17.989096 5844 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:17.989341 5844 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:17.989981 5844 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:17.990916 5844 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:17.990988 5844 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:17.991058 5844 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:17.991128 5844 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:18.008409 5844 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:36219
I20260811 17:08:18.008483 6066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:36219 every 8 connection(s)
I20260811 17:08:18.009856 5844 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:08:18.019721 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 5844
I20260811 17:08:18.019901 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
I20260811 17:08:18.020332 4683 external_mini_cluster.cc:1428] Setting key 3c5243f8367b3510c46d00a06080de88
Aug 11 17:08:18 dist-test-slave-7vjv krb5kdc[5664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468097, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:18.029150 5805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:18.012590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:43905 (local address 127.4.146.254:45237)
0811 17:08:18.012794 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:18.012801 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:18.013922 (+ 1121us) server_negotiation.cc:407] Connection header received
0811 17:08:18.015642 (+ 1720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:18.015649 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:18.015731 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:18.015862 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:18.017667 (+ 1805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.018491 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.020427 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.020794 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.020877 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:18.024488 (+ 3611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:18.024492 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:18.024495 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:18.024528 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:18.026464 (+ 1936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:18.027189 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:18.027192 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:18.027194 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:18.027295 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:18.027705 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:18.027708 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:18.027710 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:18.027965 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:18.028045 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:18.028812 (+ 767us) server_negotiation.cc:299] Negotiation successful
0811 17:08:18.028961 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 17:08:18.031121 6070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:18.013111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:45237 (local address 127.4.146.193:43905)
0811 17:08:18.013675 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:18.013739 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:18.015377 (+ 1638us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:18.016157 (+ 780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:18.016168 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:18.016717 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:18.017441 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:18.017464 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.018688 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.018691 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:18.020257 (+ 1566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:18.020271 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.021134 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.021138 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:18.021379 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:18.022142 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:18.022166 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:18.024248 (+ 2082us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:18.026626 (+ 2378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:18.026634 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:18.026656 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:18.027041 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:18.027401 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:18.027404 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:18.027406 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:18.027597 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:18.028158 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:18.028166 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:18.028518 (+ 352us) client_negotiation.cc:769] Sending connection context
0811 17:08:18.029369 (+ 851us) client_negotiation.cc:240] Negotiation successful
0811 17:08:18.029774 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":157,"threads_started":1}
I20260811 17:08:18.032935 6067 heartbeater.cc:347] Connected to a master server at 127.4.146.254:45237
I20260811 17:08:18.033278 6067 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:18.034024 6067 heartbeater.cc:511] Master 127.4.146.254:45237 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.4.146.194@KRBTEST.COM; defaulting to no policy
I20260811 17:08:18.036237 5734 ts_manager.cc:194] Registered new tserver with Master: 66cace5d1ee845739dd2188e273aa124 (127.4.146.193:36219)
I20260811 17:08:18.037828 5734 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.193@KRBTEST.COM'} at 127.4.146.193:43905
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
I20260811 17:08:18.061172 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:45237
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:43329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:18.187139 6077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:18.187512 6077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:18.187595 6077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:18.191903 6077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:18.192036 6077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:18.192179 6077 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:08:18.198277 6077 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:43329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:45237
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6077
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:18.199772 6077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:18.201166 6077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:18.212774 6086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:18.212687 6085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:18.212778 6089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:18.213281 6077 server_base.cc:1034] running on GCE node
I20260811 17:08:18.213980 6077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:18.214792 6077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:18.218194 6077 hybrid_clock.cc:648] HybridClock initialized: now 1786468098218074 us; error 89 us; skew 500 ppm
Aug 11 17:08:18 dist-test-slave-7vjv krb5kdc[5664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468098, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:18.222199 6077 init.cc:377] Logged in from keytab as kudu/127.4.146.194@KRBTEST.COM (short username kudu)
I20260811 17:08:18.223344 6077 webserver.cc:460] Webserver started at http://127.4.146.194:38881/ using document root <none> and password file <none>
I20260811 17:08:18.223961 6077 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:18.224032 6077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:18.224315 6077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:18.227195 6077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "d9aba804c11845359b0f58ac3019254c"
format_stamp: "Formatted at 2026-08-11 17:08:18 on dist-test-slave-7vjv"
server_key: "959048923cbc7910c534a6fc9a9ea207"
server_key_iv: "eba49bec11a631198e2648f5b29d7a0a"
server_key_version: "encryptionkey@0"
I20260811 17:08:18.227931 6077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "d9aba804c11845359b0f58ac3019254c"
format_stamp: "Formatted at 2026-08-11 17:08:18 on dist-test-slave-7vjv"
server_key: "959048923cbc7910c534a6fc9a9ea207"
server_key_iv: "eba49bec11a631198e2648f5b29d7a0a"
server_key_version: "encryptionkey@0"
I20260811 17:08:18.232556 6077 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 17:08:18.235699 6102 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:18.237344 6077 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:08:18.237514 6077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "d9aba804c11845359b0f58ac3019254c"
format_stamp: "Formatted at 2026-08-11 17:08:18 on dist-test-slave-7vjv"
server_key: "959048923cbc7910c534a6fc9a9ea207"
server_key_iv: "eba49bec11a631198e2648f5b29d7a0a"
server_key_version: "encryptionkey@0"
I20260811 17:08:18.237659 6077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:18.262154 6077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:18.267238 6077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:18.267735 6077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:18.268801 6077 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:18.269908 6077 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:18.270006 6077 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:18.270089 6077 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:18.270134 6077 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:18.288470 6077 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:41843
I20260811 17:08:18.288496 6323 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:41843 every 8 connection(s)
I20260811 17:08:18.289598 6077 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:08:18.290596 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 6077
I20260811 17:08:18.290732 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:08:18.291150 4683 external_mini_cluster.cc:1428] Setting key bfba62b81696533aef1e8cd6b0b4882d
Aug 11 17:08:18 dist-test-slave-7vjv krb5kdc[5664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468098, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.146.195@KRBTEST.COM; defaulting to no policy
I20260811 17:08:18.307780 5805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:18.292782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:44151 (local address 127.4.146.254:45237)
0811 17:08:18.292930 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:18.292935 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:18.294356 (+ 1421us) server_negotiation.cc:407] Connection header received
0811 17:08:18.296424 (+ 2068us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:18.296427 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:18.296484 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:18.296574 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:18.298394 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.298941 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.300252 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.300494 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.300619 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:18.303521 (+ 2902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:18.303526 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:18.303530 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:18.303593 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:18.305528 (+ 1935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:18.306108 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:18.306113 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:18.306115 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:18.306209 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:18.306579 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:18.306583 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:18.306584 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:18.306795 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:18.306907 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:18.307457 (+ 550us) server_negotiation.cc:299] Negotiation successful
0811 17:08:18.307606 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.195@KRBTEST.COM" created.
I20260811 17:08:18.308861 6327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:18.293401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:45237 (local address 127.4.146.194:44151)
0811 17:08:18.294172 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:18.294224 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:18.296137 (+ 1913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:18.296816 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:18.296827 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:18.297523 (+ 696us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:18.298228 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:18.298246 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.299093 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.299095 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:18.300067 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:18.300077 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.300671 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.300675 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:18.300892 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:18.301620 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:18.301639 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:18.303302 (+ 1663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:18.305660 (+ 2358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:18.305665 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:18.305681 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:18.305959 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:18.306307 (+ 348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:18.306310 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:18.306312 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:18.306463 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:18.306908 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:18.306916 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:18.307196 (+ 280us) client_negotiation.cc:769] Sending connection context
0811 17:08:18.307396 (+ 200us) client_negotiation.cc:240] Negotiation successful
0811 17:08:18.307802 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":230,"threads_started":1}
I20260811 17:08:18.310292 6324 heartbeater.cc:347] Connected to a master server at 127.4.146.254:45237
I20260811 17:08:18.310719 6324 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:18.311424 6324 heartbeater.cc:511] Master 127.4.146.254:45237 requested a full tablet report, sending...
I20260811 17:08:18.312806 5734 ts_manager.cc:194] Registered new tserver with Master: d9aba804c11845359b0f58ac3019254c (127.4.146.194:41843)
I20260811 17:08:18.313587 5734 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.194@KRBTEST.COM'} at 127.4.146.194:44151
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
I20260811 17:08:18.327836 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:45237
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:43329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:18.491842 6335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:18.492256 6335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:18.492312 6335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:18.496807 6335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:18.496893 6335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:18.497046 6335 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:08:18.503042 6335 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:43329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:45237
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6335
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:18.504293 6335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:18.505414 6335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:18.517477 6347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:18.517604 6343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:18.517550 6342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:18.518072 6335 server_base.cc:1034] running on GCE node
I20260811 17:08:18.518621 6335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:18.519419 6335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:18.520637 6335 hybrid_clock.cc:648] HybridClock initialized: now 1786468098520612 us; error 45 us; skew 500 ppm
Aug 11 17:08:18 dist-test-slave-7vjv krb5kdc[5664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468098, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:18.524011 6335 init.cc:377] Logged in from keytab as kudu/127.4.146.195@KRBTEST.COM (short username kudu)
I20260811 17:08:18.525102 6335 webserver.cc:460] Webserver started at http://127.4.146.195:34783/ using document root <none> and password file <none>
I20260811 17:08:18.525799 6335 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:18.525913 6335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:18.526189 6335 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:18.528828 6335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "35f84903bff6487099cff60953f38d20"
format_stamp: "Formatted at 2026-08-11 17:08:18 on dist-test-slave-7vjv"
server_key: "673a874a1fb40b8a35d7b0f6f4ab0eed"
server_key_iv: "377a3f03bdf1dbb3464c5a5943dd3351"
server_key_version: "encryptionkey@0"
I20260811 17:08:18.529577 6335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "35f84903bff6487099cff60953f38d20"
format_stamp: "Formatted at 2026-08-11 17:08:18 on dist-test-slave-7vjv"
server_key: "673a874a1fb40b8a35d7b0f6f4ab0eed"
server_key_iv: "377a3f03bdf1dbb3464c5a5943dd3351"
server_key_version: "encryptionkey@0"
I20260811 17:08:18.534510 6335 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260811 17:08:18.537837 6361 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:18.539299 6335 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 17:08:18.539479 6335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "35f84903bff6487099cff60953f38d20"
format_stamp: "Formatted at 2026-08-11 17:08:18 on dist-test-slave-7vjv"
server_key: "673a874a1fb40b8a35d7b0f6f4ab0eed"
server_key_iv: "377a3f03bdf1dbb3464c5a5943dd3351"
server_key_version: "encryptionkey@0"
I20260811 17:08:18.539656 6335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:18.567639 6335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:18.571379 6335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:18.571621 6335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:18.572352 6335 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:18.573276 6335 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:18.573351 6335 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:18.573426 6335 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:18.573467 6335 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:18.592362 6335 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:46253
I20260811 17:08:18.593434 6335 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:08:18.594058 6568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:46253 every 8 connection(s)
I20260811 17:08:18.598290 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 6335
I20260811 17:08:18.598446 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:08:18.598747 4683 external_mini_cluster.cc:1428] Setting key 4d10ad60359e21a01ffd9adcde8124c7
Aug 11 17:08:18 dist-test-slave-7vjv krb5kdc[5664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468098, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:18.612675 5805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:18.595665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:33125 (local address 127.4.146.254:45237)
0811 17:08:18.595834 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:18.595839 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:18.597066 (+ 1227us) server_negotiation.cc:407] Connection header received
0811 17:08:18.599285 (+ 2219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:18.599289 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:18.599359 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:18.599457 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:18.601503 (+ 2046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.602275 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.603941 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.604268 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.604385 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:18.607379 (+ 2994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:18.607385 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:18.607392 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:18.607431 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:18.610271 (+ 2840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:18.610867 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:18.610871 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:18.610873 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:18.610970 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:18.611341 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:18.611346 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:18.611348 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:18.611558 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:18.611673 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:18.612353 (+ 680us) server_negotiation.cc:299] Negotiation successful
0811 17:08:18.612489 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 17:08:18.613802 6574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:18.596045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:45237 (local address 127.4.146.195:33125)
0811 17:08:18.596862 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:18.596930 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:18.598955 (+ 2025us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:18.599690 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:18.599701 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:18.600440 (+ 739us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:18.601311 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:18.601336 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.602419 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.602423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:18.603802 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:18.603814 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.604434 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.604438 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:18.604680 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:18.605369 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:18.605387 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:18.607174 (+ 1787us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:18.610415 (+ 3241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:18.610423 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:18.610444 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:18.610752 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:18.611066 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:18.611070 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:18.611072 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:18.611244 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:18.611673 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:18.611681 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:18.612047 (+ 366us) client_negotiation.cc:769] Sending connection context
0811 17:08:18.612311 (+ 264us) client_negotiation.cc:240] Negotiation successful
0811 17:08:18.612693 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":144,"threads_started":1}
I20260811 17:08:18.615036 6570 heartbeater.cc:347] Connected to a master server at 127.4.146.254:45237
I20260811 17:08:18.615363 6570 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:18.615962 6570 heartbeater.cc:511] Master 127.4.146.254:45237 requested a full tablet report, sending...
I20260811 17:08:18.617172 5734 ts_manager.cc:194] Registered new tserver with Master: 35f84903bff6487099cff60953f38d20 (127.4.146.195:46253)
I20260811 17:08:18.617743 5734 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.195@KRBTEST.COM'} at 127.4.146.195:33125
I20260811 17:08:18.626389 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 17:08:18.639123 5805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:18.630367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36406 (local address 127.4.146.254:45237)
0811 17:08:18.630538 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:18.630544 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:18.630722 (+ 178us) server_negotiation.cc:407] Connection header received
0811 17:08:18.630897 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:18.630900 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:18.630944 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:18.631034 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:18.631774 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.632398 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.633237 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.633462 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.633570 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:18.634991 (+ 1421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:18.635001 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:18.635003 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:18.635069 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:18.636942 (+ 1873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:18.637511 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:18.637515 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:18.637517 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:18.637618 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:18.637958 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:18.637962 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:18.637964 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:18.638329 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:18.638501 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:18.638780 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 17:08:18.638934 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 17:08:18.645447 5734 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36406:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 17:08:18.648829 5734 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:08:18.664767 6594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:18.658932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49004 (local address 127.4.146.195:46253)
0811 17:08:18.659638 (+ 706us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:18.659652 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:18.659675 (+ 23us) server_negotiation.cc:407] Connection header received
0811 17:08:18.659763 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:18.659768 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:18.659940 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:18.660269 (+ 329us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:18.660454 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.661553 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.663148 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.663835 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.663967 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:18.664167 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:18.664473 (+ 306us) server_negotiation.cc:299] Negotiation successful
0811 17:08:18.664601 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":592,"thread_start_us":136,"threads_started":1}
I20260811 17:08:18.664754 6590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:18.658453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:46253 (local address 127.0.0.1:49004)
0811 17:08:18.659163 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:18.659189 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:18.659367 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:18.660226 (+ 859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:18.660229 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:18.660244 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:18.660342 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:18.660347 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.661681 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.661685 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:18.663026 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:18.663036 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.663969 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.663973 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:18.664249 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:18.664316 (+ 67us) client_negotiation.cc:769] Sending connection context
0811 17:08:18.664434 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 17:08:18.664561 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":649,"mutex_wait_us":71,"thread_start_us":158,"threads_started":1}
I20260811 17:08:18.665616 6589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:18.658189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50572 (local address 127.4.146.194:41843)
0811 17:08:18.659084 (+ 895us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:18.659098 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:18.659124 (+ 26us) server_negotiation.cc:407] Connection header received
0811 17:08:18.659255 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:18.659261 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:18.659486 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:18.659676 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:18.660045 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.661481 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.663175 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.664244 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.664998 (+ 754us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:18.665159 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:18.665216 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 17:08:18.665337 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":773,"thread_start_us":185,"threads_started":1}
I20260811 17:08:18.664760 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:18.658036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:41843 (local address 127.0.0.1:50572)
0811 17:08:18.658447 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:18.658506 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:18.658669 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:18.659709 (+ 1040us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:18.659716 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:18.659744 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:18.659889 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:18.659897 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.661616 (+ 1719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.661620 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:18.663032 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:18.663042 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.664374 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.664381 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:18.664487 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:18.664512 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 17:08:18.664562 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 17:08:18.664628 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":68,"thread_start_us":103,"threads_started":1}
I20260811 17:08:18.666079 6591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:18.658860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:36219 (local address 127.0.0.1:59738)
0811 17:08:18.659970 (+ 1110us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:18.659985 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:18.660075 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:18.660678 (+ 603us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:18.660681 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:18.660700 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:18.660806 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:18.660814 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.661879 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.661885 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:18.664062 (+ 2177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:18.664074 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.665605 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.665609 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:18.665745 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:18.665769 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 17:08:18.665847 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 17:08:18.665922 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1034,"mutex_wait_us":24,"thread_start_us":97,"threads_started":1}
I20260811 17:08:18.666548 6597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:18.659116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59738 (local address 127.4.146.193:36219)
0811 17:08:18.659507 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:18.659513 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:18.660064 (+ 551us) server_negotiation.cc:407] Connection header received
0811 17:08:18.660214 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:18.660220 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:18.660411 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:18.660713 (+ 302us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:18.660926 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.661777 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.664327 (+ 2550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.665301 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.665407 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:18.665540 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:18.666216 (+ 676us) server_negotiation.cc:299] Negotiation successful
0811 17:08:18.666378 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":107,"threads_started":1}
I20260811 17:08:18.668696 6451 tablet_service.cc:1467] Processing CreateTablet for tablet d9918e95dd5a446caa4855a3c6d19b4a (DEFAULT_TABLE table=test-table [id=d922017977834f778a09db0e38839eb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:18.669974 6451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9918e95dd5a446caa4855a3c6d19b4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:18.669457 6200 tablet_service.cc:1467] Processing CreateTablet for tablet d9918e95dd5a446caa4855a3c6d19b4a (DEFAULT_TABLE table=test-table [id=d922017977834f778a09db0e38839eb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:18.669530 5955 tablet_service.cc:1467] Processing CreateTablet for tablet d9918e95dd5a446caa4855a3c6d19b4a (DEFAULT_TABLE table=test-table [id=d922017977834f778a09db0e38839eb7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:18.670590 6200 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9918e95dd5a446caa4855a3c6d19b4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:18.670590 5955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9918e95dd5a446caa4855a3c6d19b4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:18.677664 6599 tablet_bootstrap.cc:492] T d9918e95dd5a446caa4855a3c6d19b4a P 35f84903bff6487099cff60953f38d20: Bootstrap starting.
I20260811 17:08:18.678707 6600 tablet_bootstrap.cc:492] T d9918e95dd5a446caa4855a3c6d19b4a P 66cace5d1ee845739dd2188e273aa124: Bootstrap starting.
I20260811 17:08:18.680281 6602 tablet_bootstrap.cc:492] T d9918e95dd5a446caa4855a3c6d19b4a P d9aba804c11845359b0f58ac3019254c: Bootstrap starting.
I20260811 17:08:18.681993 6600 tablet_bootstrap.cc:654] T d9918e95dd5a446caa4855a3c6d19b4a P 66cace5d1ee845739dd2188e273aa124: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:18.682605 6599 tablet_bootstrap.cc:654] T d9918e95dd5a446caa4855a3c6d19b4a P 35f84903bff6487099cff60953f38d20: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:18.683482 6602 tablet_bootstrap.cc:654] T d9918e95dd5a446caa4855a3c6d19b4a P d9aba804c11845359b0f58ac3019254c: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:18.683724 6600 log.cc:824] T d9918e95dd5a446caa4855a3c6d19b4a P 66cace5d1ee845739dd2188e273aa124: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:18.684001 6599 log.cc:824] T d9918e95dd5a446caa4855a3c6d19b4a P 35f84903bff6487099cff60953f38d20: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:18.684914 6602 log.cc:824] T d9918e95dd5a446caa4855a3c6d19b4a P d9aba804c11845359b0f58ac3019254c: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:18.686394 6600 tablet_bootstrap.cc:492] T d9918e95dd5a446caa4855a3c6d19b4a P 66cace5d1ee845739dd2188e273aa124: No bootstrap required, opened a new log
I20260811 17:08:18.686422 6599 tablet_bootstrap.cc:492] T d9918e95dd5a446caa4855a3c6d19b4a P 35f84903bff6487099cff60953f38d20: No bootstrap required, opened a new log
I20260811 17:08:18.686627 6600 ts_tablet_manager.cc:1397] T d9918e95dd5a446caa4855a3c6d19b4a P 66cace5d1ee845739dd2188e273aa124: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.006s
I20260811 17:08:18.686630 6599 ts_tablet_manager.cc:1397] T d9918e95dd5a446caa4855a3c6d19b4a P 35f84903bff6487099cff60953f38d20: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260811 17:08:18.692123 6599 raft_consensus.cc:348] T d9918e95dd5a446caa4855a3c6d19b4a P 35f84903bff6487099cff60953f38d20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9aba804c11845359b0f58ac3019254c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41843 } } peers { permanent_uuid: "66cace5d1ee845739dd2188e273aa124" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 36219 } } peers { permanent_uuid: "35f84903bff6487099cff60953f38d20" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 46253 } }
I20260811 17:08:18.692430 6600 raft_consensus.cc:348] T d9918e95dd5a446caa4855a3c6d19b4a P 66cace5d1ee845739dd2188e273aa124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9aba804c11845359b0f58ac3019254c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41843 } } peers { permanent_uuid: "66cace5d1ee845739dd2188e273aa124" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 36219 } } peers { permanent_uuid: "35f84903bff6487099cff60953f38d20" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 46253 } }
I20260811 17:08:18.692616 6599 raft_consensus.cc:374] T d9918e95dd5a446caa4855a3c6d19b4a P 35f84903bff6487099cff60953f38d20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:18.692740 6600 raft_consensus.cc:374] T d9918e95dd5a446caa4855a3c6d19b4a P 66cace5d1ee845739dd2188e273aa124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:18.692740 6599 raft_consensus.cc:729] T d9918e95dd5a446caa4855a3c6d19b4a P 35f84903bff6487099cff60953f38d20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35f84903bff6487099cff60953f38d20, State: Initialized, Role: FOLLOWER
I20260811 17:08:18.692827 6600 raft_consensus.cc:729] T d9918e95dd5a446caa4855a3c6d19b4a P 66cace5d1ee845739dd2188e273aa124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66cace5d1ee845739dd2188e273aa124, State: Initialized, Role: FOLLOWER
I20260811 17:08:18.693315 6599 consensus_queue.cc:260] T d9918e95dd5a446caa4855a3c6d19b4a P 35f84903bff6487099cff60953f38d20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9aba804c11845359b0f58ac3019254c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41843 } } peers { permanent_uuid: "66cace5d1ee845739dd2188e273aa124" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 36219 } } peers { permanent_uuid: "35f84903bff6487099cff60953f38d20" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 46253 } }
I20260811 17:08:18.693428 6600 consensus_queue.cc:260] T d9918e95dd5a446caa4855a3c6d19b4a P 66cace5d1ee845739dd2188e273aa124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9aba804c11845359b0f58ac3019254c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41843 } } peers { permanent_uuid: "66cace5d1ee845739dd2188e273aa124" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 36219 } } peers { permanent_uuid: "35f84903bff6487099cff60953f38d20" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 46253 } }
I20260811 17:08:18.694489 6599 ts_tablet_manager.cc:1428] T d9918e95dd5a446caa4855a3c6d19b4a P 35f84903bff6487099cff60953f38d20: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
I20260811 17:08:18.694554 6600 ts_tablet_manager.cc:1428] T d9918e95dd5a446caa4855a3c6d19b4a P 66cace5d1ee845739dd2188e273aa124: Time spent starting tablet: real 0.008s user 0.004s sys 0.005s
I20260811 17:08:18.694737 6602 tablet_bootstrap.cc:492] T d9918e95dd5a446caa4855a3c6d19b4a P d9aba804c11845359b0f58ac3019254c: No bootstrap required, opened a new log
I20260811 17:08:18.694868 6570 heartbeater.cc:503] Master 127.4.146.254:45237 was elected leader, sending a full tablet report...
I20260811 17:08:18.694937 6067 heartbeater.cc:503] Master 127.4.146.254:45237 was elected leader, sending a full tablet report...
I20260811 17:08:18.695140 6602 ts_tablet_manager.cc:1397] T d9918e95dd5a446caa4855a3c6d19b4a P d9aba804c11845359b0f58ac3019254c: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.000s
I20260811 17:08:18.701545 6602 raft_consensus.cc:348] T d9918e95dd5a446caa4855a3c6d19b4a P d9aba804c11845359b0f58ac3019254c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9aba804c11845359b0f58ac3019254c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41843 } } peers { permanent_uuid: "66cace5d1ee845739dd2188e273aa124" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 36219 } } peers { permanent_uuid: "35f84903bff6487099cff60953f38d20" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 46253 } }
I20260811 17:08:18.701957 6602 raft_consensus.cc:374] T d9918e95dd5a446caa4855a3c6d19b4a P d9aba804c11845359b0f58ac3019254c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:18.702042 6602 raft_consensus.cc:729] T d9918e95dd5a446caa4855a3c6d19b4a P d9aba804c11845359b0f58ac3019254c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9aba804c11845359b0f58ac3019254c, State: Initialized, Role: FOLLOWER
I20260811 17:08:18.702549 6602 consensus_queue.cc:260] T d9918e95dd5a446caa4855a3c6d19b4a P d9aba804c11845359b0f58ac3019254c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9aba804c11845359b0f58ac3019254c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41843 } } peers { permanent_uuid: "66cace5d1ee845739dd2188e273aa124" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 36219 } } peers { permanent_uuid: "35f84903bff6487099cff60953f38d20" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 46253 } }
I20260811 17:08:18.703496 6324 heartbeater.cc:503] Master 127.4.146.254:45237 was elected leader, sending a full tablet report...
I20260811 17:08:18.703724 6602 ts_tablet_manager.cc:1428] T d9918e95dd5a446caa4855a3c6d19b4a P d9aba804c11845359b0f58ac3019254c: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260811 17:08:18.751370 6610 raft_consensus.cc:482] T d9918e95dd5a446caa4855a3c6d19b4a P 66cace5d1ee845739dd2188e273aa124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:08:18.751823 6610 raft_consensus.cc:504] T d9918e95dd5a446caa4855a3c6d19b4a P 66cace5d1ee845739dd2188e273aa124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9aba804c11845359b0f58ac3019254c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41843 } } peers { permanent_uuid: "66cace5d1ee845739dd2188e273aa124" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 36219 } } peers { permanent_uuid: "35f84903bff6487099cff60953f38d20" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 46253 } }
I20260811 17:08:18.754401 6610 leader_election.cc:288] T d9918e95dd5a446caa4855a3c6d19b4a P 66cace5d1ee845739dd2188e273aa124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d9aba804c11845359b0f58ac3019254c (127.4.146.194:41843), 35f84903bff6487099cff60953f38d20 (127.4.146.195:46253)
I20260811 17:08:18.761042 6594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:18.755152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:34871 (local address 127.4.146.195:46253)
0811 17:08:18.755324 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:18.755332 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:18.756012 (+ 680us) server_negotiation.cc:407] Connection header received
0811 17:08:18.756256 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:18.756259 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:18.756313 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:18.756390 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:18.756949 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.757671 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.759692 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.760357 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.760504 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:18.760571 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:18.760814 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 17:08:18.760894 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 17:08:18.761101 6614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:18.754864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:46253 (local address 127.4.146.193:34871)
0811 17:08:18.755915 (+ 1051us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:18.755932 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:18.756084 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:18.756552 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:18.756556 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:18.756572 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:18.756816 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:18.756824 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.757834 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.757840 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:18.759523 (+ 1683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:18.759535 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.760496 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.760501 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:18.760666 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:18.760690 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 17:08:18.760794 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 17:08:18.760878 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":922,"thread_start_us":137,"threads_started":1}
W20260811 17:08:18.761584 6068 tablet.cc:2369] T d9918e95dd5a446caa4855a3c6d19b4a P 66cace5d1ee845739dd2188e273aa124: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 17:08:18.762251 6490 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9918e95dd5a446caa4855a3c6d19b4a" candidate_uuid: "66cace5d1ee845739dd2188e273aa124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35f84903bff6487099cff60953f38d20" is_pre_election: true
I20260811 17:08:18.762836 6490 raft_consensus.cc:2454] T d9918e95dd5a446caa4855a3c6d19b4a P 35f84903bff6487099cff60953f38d20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66cace5d1ee845739dd2188e273aa124 in term 0.
I20260811 17:08:18.762959 6613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:18.754813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:41843 (local address 127.4.146.193:50629)
0811 17:08:18.755417 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:18.755437 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:18.755781 (+ 344us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:18.756287 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:18.756290 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:18.756307 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:18.756581 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:18.756588 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.758454 (+ 1866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.758458 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:18.759905 (+ 1447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:18.759919 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.762219 (+ 2300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.762226 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:18.762471 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:18.762515 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 17:08:18.762649 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 17:08:18.762739 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":220,"threads_started":1}
I20260811 17:08:18.762889 6589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:18.755548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:50629 (local address 127.4.146.194:41843)
0811 17:08:18.755703 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:18.755711 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:18.755734 (+ 23us) server_negotiation.cc:407] Connection header received
0811 17:08:18.755976 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:18.755982 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:18.756045 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:18.756122 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:18.756775 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.757595 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.760154 (+ 2559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.761193 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.761359 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:18.761435 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:18.762675 (+ 1240us) server_negotiation.cc:299] Negotiation successful
0811 17:08:18.762769 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 17:08:18.763621 5873 leader_election.cc:302] T d9918e95dd5a446caa4855a3c6d19b4a P 66cace5d1ee845739dd2188e273aa124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35f84903bff6487099cff60953f38d20, 66cace5d1ee845739dd2188e273aa124; no voters:
I20260811 17:08:18.764045 6610 raft_consensus.cc:2781] T d9918e95dd5a446caa4855a3c6d19b4a P 66cace5d1ee845739dd2188e273aa124 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:08:18.764205 6610 raft_consensus.cc:482] T d9918e95dd5a446caa4855a3c6d19b4a P 66cace5d1ee845739dd2188e273aa124 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:08:18.764297 6610 raft_consensus.cc:3037] T d9918e95dd5a446caa4855a3c6d19b4a P 66cace5d1ee845739dd2188e273aa124 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:18.764206 6234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9918e95dd5a446caa4855a3c6d19b4a" candidate_uuid: "66cace5d1ee845739dd2188e273aa124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9aba804c11845359b0f58ac3019254c" is_pre_election: true
I20260811 17:08:18.764554 6234 raft_consensus.cc:2454] T d9918e95dd5a446caa4855a3c6d19b4a P d9aba804c11845359b0f58ac3019254c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66cace5d1ee845739dd2188e273aa124 in term 0.
I20260811 17:08:18.766764 6610 raft_consensus.cc:504] T d9918e95dd5a446caa4855a3c6d19b4a P 66cace5d1ee845739dd2188e273aa124 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9aba804c11845359b0f58ac3019254c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41843 } } peers { permanent_uuid: "66cace5d1ee845739dd2188e273aa124" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 36219 } } peers { permanent_uuid: "35f84903bff6487099cff60953f38d20" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 46253 } }
I20260811 17:08:18.767323 6610 leader_election.cc:288] T d9918e95dd5a446caa4855a3c6d19b4a P 66cace5d1ee845739dd2188e273aa124 [CANDIDATE]: Term 1 election: Requested vote from peers d9aba804c11845359b0f58ac3019254c (127.4.146.194:41843), 35f84903bff6487099cff60953f38d20 (127.4.146.195:46253)
I20260811 17:08:18.767772 6234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9918e95dd5a446caa4855a3c6d19b4a" candidate_uuid: "66cace5d1ee845739dd2188e273aa124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d9aba804c11845359b0f58ac3019254c"
I20260811 17:08:18.767762 6490 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d9918e95dd5a446caa4855a3c6d19b4a" candidate_uuid: "66cace5d1ee845739dd2188e273aa124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35f84903bff6487099cff60953f38d20"
I20260811 17:08:18.767925 6234 raft_consensus.cc:3037] T d9918e95dd5a446caa4855a3c6d19b4a P d9aba804c11845359b0f58ac3019254c [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:18.767920 6490 raft_consensus.cc:3037] T d9918e95dd5a446caa4855a3c6d19b4a P 35f84903bff6487099cff60953f38d20 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:18.769759 6234 raft_consensus.cc:2454] T d9918e95dd5a446caa4855a3c6d19b4a P d9aba804c11845359b0f58ac3019254c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66cace5d1ee845739dd2188e273aa124 in term 1.
I20260811 17:08:18.770174 6490 raft_consensus.cc:2454] T d9918e95dd5a446caa4855a3c6d19b4a P 35f84903bff6487099cff60953f38d20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66cace5d1ee845739dd2188e273aa124 in term 1.
I20260811 17:08:18.770273 5870 leader_election.cc:302] T d9918e95dd5a446caa4855a3c6d19b4a P 66cace5d1ee845739dd2188e273aa124 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66cace5d1ee845739dd2188e273aa124, d9aba804c11845359b0f58ac3019254c; no voters:
I20260811 17:08:18.770558 6610 raft_consensus.cc:2781] T d9918e95dd5a446caa4855a3c6d19b4a P 66cace5d1ee845739dd2188e273aa124 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:18.770882 6610 raft_consensus.cc:686] T d9918e95dd5a446caa4855a3c6d19b4a P 66cace5d1ee845739dd2188e273aa124 [term 1 LEADER]: Becoming Leader. State: Replica: 66cace5d1ee845739dd2188e273aa124, State: Running, Role: LEADER
I20260811 17:08:18.771530 6610 consensus_queue.cc:237] T d9918e95dd5a446caa4855a3c6d19b4a P 66cace5d1ee845739dd2188e273aa124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9aba804c11845359b0f58ac3019254c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41843 } } peers { permanent_uuid: "66cace5d1ee845739dd2188e273aa124" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 36219 } } peers { permanent_uuid: "35f84903bff6487099cff60953f38d20" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 46253 } }
I20260811 17:08:18.775820 5733 catalog_manager.cc:5495] T d9918e95dd5a446caa4855a3c6d19b4a P 66cace5d1ee845739dd2188e273aa124 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66cace5d1ee845739dd2188e273aa124 (127.4.146.193). New cstate: current_term: 1 leader_uuid: "66cace5d1ee845739dd2188e273aa124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d9aba804c11845359b0f58ac3019254c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41843 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66cace5d1ee845739dd2188e273aa124" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 36219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35f84903bff6487099cff60953f38d20" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 46253 } health_report { overall_health: UNKNOWN } } }
W20260811 17:08:18.790949 6325 tablet.cc:2369] T d9918e95dd5a446caa4855a3c6d19b4a P d9aba804c11845359b0f58ac3019254c: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 17:08:18 dist-test-slave-7vjv krb5kdc[5664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468097, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.193@KRBTEST.COM
I20260811 17:08:18.796538 6597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:18.783749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59748 (local address 127.4.146.193:36219)
0811 17:08:18.783878 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:18.783882 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:18.784360 (+ 478us) server_negotiation.cc:407] Connection header received
0811 17:08:18.784451 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:18.784457 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:18.784532 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:18.784648 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:18.785502 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.786432 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.787731 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.788221 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.788362 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:18.792004 (+ 3642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:18.792019 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:18.792034 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:18.792065 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:18.794147 (+ 2082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:18.794770 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:18.794777 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:18.794778 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:18.794884 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:18.795231 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:18.795234 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:18.795236 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:18.795552 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:18.795806 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:18.796032 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 17:08:18.796228 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 17:08:18 dist-test-slave-7vjv krb5kdc[5664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468098, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 17:08:18 dist-test-slave-7vjv krb5kdc[5664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468098, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.146.193@KRBTEST.COM
I20260811 17:08:18.843847 6597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:18.831487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59756 (local address 127.4.146.193:36219)
0811 17:08:18.831684 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:18.831691 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:18.831740 (+ 49us) server_negotiation.cc:407] Connection header received
0811 17:08:18.831899 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:18.831905 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:18.831977 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:18.832128 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:18.833087 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.834059 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.835085 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.835626 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.835768 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:18.838931 (+ 3163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:18.838938 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:18.838944 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:18.838991 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:18.841144 (+ 2153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:18.841783 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:18.841790 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:18.841794 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:18.841908 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:18.842440 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:18.842443 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:18.842445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:18.842720 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:18.842973 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:18.843478 (+ 505us) server_negotiation.cc:299] Negotiation successful
0811 17:08:18.843663 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260811 17:08:18.844966 6572 tablet.cc:2369] T d9918e95dd5a446caa4855a3c6d19b4a P 35f84903bff6487099cff60953f38d20: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 17:08:18 dist-test-slave-7vjv krb5kdc[5664](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 17:08:18 dist-test-slave-7vjv krb5kdc[5664](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.193@KRBTEST.COM
I20260811 17:08:18.887624 6597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:18.872225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59762 (local address 127.4.146.193:36219)
0811 17:08:18.872393 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:18.872400 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:18.872612 (+ 212us) server_negotiation.cc:407] Connection header received
0811 17:08:18.872773 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:18.872776 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:18.872824 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:18.872900 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:18.873973 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.874506 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.876002 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:18.876314 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:18.876405 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:18.883425 (+ 7020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:18.883432 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:18.883437 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:18.883484 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:18.885566 (+ 2082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:18.886059 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:18.886065 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:18.886070 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:18.886178 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:18.886476 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:18.886480 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:18.886484 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:18.886766 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:18.886944 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:18.887184 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 17:08:18.887348 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260811 17:08:18.889276 5916 tablet_service.cc:2908] Rejecting scan request for tablet d9918e95dd5a446caa4855a3c6d19b4a: Uninitialized: clean time has not yet been initialized
I20260811 17:08:18.891839 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 5844
I20260811 17:08:18.919698 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 6077
I20260811 17:08:18.936863 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 6335
I20260811 17:08:18.954835 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 5687
2026-08-11T17:08:18Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2953 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:08:19 dist-test-slave-7vjv krb5kdc[6638](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:08:19 dist-test-slave-7vjv krb5kdc[6638](info): set up 2 sockets
Aug 11 17:08:19 dist-test-slave-7vjv krb5kdc[6638](info): commencing operation
krb5kdc: starting...
W20260811 17:08:20.298061 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.303s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:08:20 dist-test-slave-7vjv krb5kdc[6638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:08:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:08:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:08:20.443727 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:33275
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:37747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:33275
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:20.566748 6658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:20.567116 6658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:20.567209 6658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:20.571486 6658 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:08:20.571605 6658 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 17:08:20.571638 6658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:20.571683 6658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:20.571727 6658 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:08:20.571764 6658 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:08:20.577564 6658 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:37747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:33275
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:33275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6658
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:20.578806 6658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:20.579931 6658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:20.590758 6670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:20.590780 6673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:20.590831 6658 server_base.cc:1034] running on GCE node
W20260811 17:08:20.590771 6671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:20.591710 6658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:20.593005 6658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:20.594178 6658 hybrid_clock.cc:648] HybridClock initialized: now 1786468100594134 us; error 65 us; skew 500 ppm
Aug 11 17:08:20 dist-test-slave-7vjv krb5kdc[6638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468100, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:20.597386 6658 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:08:20.598337 6658 webserver.cc:460] Webserver started at http://127.4.146.254:34907/ using document root <none> and password file <none>
I20260811 17:08:20.598889 6658 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:20.598950 6658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:20.599129 6658 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:20.601408 6658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "a3a9c007eca349dd9425e8553e81fd7d"
format_stamp: "Formatted at 2026-08-11 17:08:20 on dist-test-slave-7vjv"
server_key: "3c4f762aae802ebfa2b957ccff6742f7"
server_key_iv: "914a2dd9ac42f395e0ad62a359740246"
server_key_version: "encryptionkey@0"
I20260811 17:08:20.602002 6658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "a3a9c007eca349dd9425e8553e81fd7d"
format_stamp: "Formatted at 2026-08-11 17:08:20 on dist-test-slave-7vjv"
server_key: "3c4f762aae802ebfa2b957ccff6742f7"
server_key_iv: "914a2dd9ac42f395e0ad62a359740246"
server_key_version: "encryptionkey@0"
I20260811 17:08:20.606069 6658 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260811 17:08:20.608645 6686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:20.610005 6658 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:08:20.610178 6658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "a3a9c007eca349dd9425e8553e81fd7d"
format_stamp: "Formatted at 2026-08-11 17:08:20 on dist-test-slave-7vjv"
server_key: "3c4f762aae802ebfa2b957ccff6742f7"
server_key_iv: "914a2dd9ac42f395e0ad62a359740246"
server_key_version: "encryptionkey@0"
I20260811 17:08:20.610311 6658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:20.627923 6658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:20.631672 6658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:20.631912 6658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:20.641747 6658 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:33275
I20260811 17:08:20.641759 6797 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:33275 every 8 connection(s)
I20260811 17:08:20.642841 6658 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:08:20.646039 6805 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:20.652529 6805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d: Bootstrap starting.
I20260811 17:08:20.652688 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 6658
I20260811 17:08:20.652805 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:08:20.653082 4683 external_mini_cluster.cc:1428] Setting key 16655c0084aa049588937de6d54d68dd
I20260811 17:08:20.655527 6805 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:20.656407 6805 log.cc:824] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:20.658697 6805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d: No bootstrap required, opened a new log
Aug 11 17:08:20 dist-test-slave-7vjv krb5kdc[6638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468100, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:20.663486 6805 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3a9c007eca349dd9425e8553e81fd7d" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33275 } }
I20260811 17:08:20.663861 6805 raft_consensus.cc:374] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:20.663931 6805 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3a9c007eca349dd9425e8553e81fd7d, State: Initialized, Role: FOLLOWER
I20260811 17:08:20.664544 6805 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3a9c007eca349dd9425e8553e81fd7d" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33275 } }
I20260811 17:08:20.664748 6805 raft_consensus.cc:388] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:08:20.664829 6805 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:08:20.664934 6805 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:20.666258 6805 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3a9c007eca349dd9425e8553e81fd7d" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33275 } }
I20260811 17:08:20.666684 6805 leader_election.cc:302] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3a9c007eca349dd9425e8553e81fd7d; no voters:
I20260811 17:08:20.667085 6805 leader_election.cc:288] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:08:20.667240 6814 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:20.667524 6814 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d [term 1 LEADER]: Becoming Leader. State: Replica: a3a9c007eca349dd9425e8553e81fd7d, State: Running, Role: LEADER
I20260811 17:08:20.667929 6814 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3a9c007eca349dd9425e8553e81fd7d" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33275 } }
I20260811 17:08:20.668550 6805 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:08:20.669909 6811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:20.654678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41168 (local address 127.4.146.254:33275)
0811 17:08:20.655161 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:20.655179 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:20.655217 (+ 38us) server_negotiation.cc:407] Connection header received
0811 17:08:20.655968 (+ 751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:20.655988 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:20.656418 (+ 430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:20.656768 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:20.657636 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:20.658683 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:20.659916 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:20.660488 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:20.660627 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:20.663650 (+ 3023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:20.663657 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:20.663674 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:20.663710 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:20.666006 (+ 2296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:20.666564 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:20.666570 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:20.666576 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:20.666733 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:20.667234 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:20.667238 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:20.667240 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:20.667890 (+ 650us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:20.668144 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:20.668470 (+ 326us) server_negotiation.cc:299] Negotiation successful
0811 17:08:20.668796 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":173,"threads_started":1}
I20260811 17:08:20.670019 6816 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3a9c007eca349dd9425e8553e81fd7d. Latest consensus state: current_term: 1 leader_uuid: "a3a9c007eca349dd9425e8553e81fd7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3a9c007eca349dd9425e8553e81fd7d" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33275 } } }
I20260811 17:08:20.670295 6816 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:20.670099 6815 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a3a9c007eca349dd9425e8553e81fd7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3a9c007eca349dd9425e8553e81fd7d" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33275 } } }
I20260811 17:08:20.670594 6815 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d [sys.catalog]: This master's current role is: LEADER
W20260811 17:08:20.673874 6842 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 17:08:20.673976 6842 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 17:08:20.674043 6839 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:08:20.674955 6839 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:08:20.681169 6839 catalog_manager.cc:1347] Generated new cluster ID: debdb122fda24fd88b374ec22bc8a3b5
I20260811 17:08:20.681257 6839 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:08:20.704514 6839 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:08:20.705904 6839 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:08:20.714874 6839 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d: Generated new TSK 0
I20260811 17:08:20.715665 6839 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
I20260811 17:08:20.755606 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:33275
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:37747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:20.878731 6852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:20.879060 6852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:20.879107 6852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:20.883438 6852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:20.883523 6852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:20.883566 6852 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 17:08:20.883647 6852 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:08:20.889394 6852 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:37747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.146.254:33275
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6852
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:20.890686 6852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:20.891849 6852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:20.902870 6866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:20.902945 6860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:20.903082 6852 server_base.cc:1034] running on GCE node
W20260811 17:08:20.903244 6861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:20.903748 6852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:20.904517 6852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:20.905736 6852 hybrid_clock.cc:648] HybridClock initialized: now 1786468100905694 us; error 54 us; skew 500 ppm
Aug 11 17:08:20 dist-test-slave-7vjv krb5kdc[6638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468100, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:20.908947 6852 init.cc:377] Logged in from keytab as kudu/127.4.146.193@KRBTEST.COM (short username kudu)
I20260811 17:08:20.909993 6852 webserver.cc:460] Webserver started at http://127.4.146.193:34727/ using document root <none> and password file <none>
I20260811 17:08:20.910605 6852 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:20.910715 6852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:20.910972 6852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:20.913268 6852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "338736e3a7604b959e0b7195d6fb3b7c"
format_stamp: "Formatted at 2026-08-11 17:08:20 on dist-test-slave-7vjv"
server_key: "c04d84343a1ff4e107e26e9070295ba3"
server_key_iv: "386015c62fb321b94c3da79b3f72e53b"
server_key_version: "encryptionkey@0"
I20260811 17:08:20.913924 6852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "338736e3a7604b959e0b7195d6fb3b7c"
format_stamp: "Formatted at 2026-08-11 17:08:20 on dist-test-slave-7vjv"
server_key: "c04d84343a1ff4e107e26e9070295ba3"
server_key_iv: "386015c62fb321b94c3da79b3f72e53b"
server_key_version: "encryptionkey@0"
I20260811 17:08:20.918359 6852 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 17:08:20.921208 6876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:20.922608 6852 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:08:20.922791 6852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "338736e3a7604b959e0b7195d6fb3b7c"
format_stamp: "Formatted at 2026-08-11 17:08:20 on dist-test-slave-7vjv"
server_key: "c04d84343a1ff4e107e26e9070295ba3"
server_key_iv: "386015c62fb321b94c3da79b3f72e53b"
server_key_version: "encryptionkey@0"
I20260811 17:08:20.922925 6852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:20.933343 6852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:20.936777 6852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:20.937009 6852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:20.938597 6852 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:20.938688 6852 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:20.938767 6852 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:20.938822 6852 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 17:08:20 dist-test-slave-7vjv krb5kdc[6638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468100, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:20.950932 6852 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:34635
I20260811 17:08:20.950984 7072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:34635 every 8 connection(s)
I20260811 17:08:20.952270 6852 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:08:20.956317 6892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:20.939963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33275 (local address 127.4.146.193:55777)
0811 17:08:20.940529 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:20.940596 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:20.941835 (+ 1239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:20.942573 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:20.942586 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:20.943137 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:20.943920 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:20.943947 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:20.944999 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:20.945003 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:20.945971 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:20.945982 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:20.946809 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:20.946812 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:20.946965 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:20.947651 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:20.947673 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:20.949870 (+ 2197us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:20.952048 (+ 2178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:20.952053 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:20.952066 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:20.952531 (+ 465us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:20.952947 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:20.952950 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:20.952952 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:20.953134 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:20.953710 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:20.953717 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:20.954275 (+ 558us) client_negotiation.cc:769] Sending connection context
0811 17:08:20.954524 (+ 249us) client_negotiation.cc:240] Negotiation successful
0811 17:08:20.954957 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":164,"threads_started":1}
I20260811 17:08:20.956319 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 6852
I20260811 17:08:20.956473 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
I20260811 17:08:20.956846 4683 external_mini_cluster.cc:1428] Setting key ea67ae1e1035decb2dc844ba5a037189
I20260811 17:08:20.957211 6811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:20.939570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:55777 (local address 127.4.146.254:33275)
0811 17:08:20.939777 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:20.939785 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:20.940731 (+ 946us) server_negotiation.cc:407] Connection header received
0811 17:08:20.942156 (+ 1425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:20.942161 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:20.942232 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:20.942327 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:20.944164 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:20.944846 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:20.946121 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:20.946504 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:20.946631 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:20.950065 (+ 3434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:20.950069 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:20.950072 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:20.950110 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:20.951918 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:20.952669 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:20.952673 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:20.952674 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:20.952817 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:20.953259 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:20.953263 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:20.953265 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:20.953543 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:20.953661 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:20.956867 (+ 3206us) server_negotiation.cc:299] Negotiation successful
0811 17:08:20.957024 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 17:08:20.962087 7073 heartbeater.cc:347] Connected to a master server at 127.4.146.254:33275
I20260811 17:08:20.962304 7073 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:20.962929 7073 heartbeater.cc:511] Master 127.4.146.254:33275 requested a full tablet report, sending...
I20260811 17:08:20.964836 6717 ts_manager.cc:194] Registered new tserver with Master: 338736e3a7604b959e0b7195d6fb3b7c (127.4.146.193:34635)
I20260811 17:08:20.966501 6717 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.193@KRBTEST.COM'} at 127.4.146.193:55777
WARNING: no policy specified for kudu/127.4.146.194@KRBTEST.COM; defaulting to no policy
I20260811 17:08:20.972268 6811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:20.961980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:39697 (local address 127.4.146.254:33275)
0811 17:08:20.962186 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:20.962193 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:20.962366 (+ 173us) server_negotiation.cc:407] Connection header received
0811 17:08:20.962550 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:20.962555 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:20.962615 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:20.962718 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:20.963302 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:20.964182 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:20.965810 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:20.966158 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:20.966294 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:20.968302 (+ 2008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:20.968309 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:20.968315 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:20.968351 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:20.970300 (+ 1949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:20.970802 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:20.970807 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:20.970812 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:20.970914 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:20.971207 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:20.971211 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:20.971212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:20.971464 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:20.971592 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:20.971970 (+ 378us) server_negotiation.cc:299] Negotiation successful
0811 17:08:20.972084 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 17:08:20.972272 7086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:20.961831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33275 (local address 127.4.146.193:39697)
0811 17:08:20.962261 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:20.962276 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:20.962405 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:20.962770 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:20.962773 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:20.963026 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:20.963162 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:20.963170 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:20.964349 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:20.964355 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:20.965656 (+ 1301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:20.965674 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:20.966351 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:20.966357 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:20.966475 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:20.967385 (+ 910us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:20.967410 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:20.967987 (+ 577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:20.970434 (+ 2447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:20.970437 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:20.970438 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:20.970681 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:20.971013 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:20.971016 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:20.971017 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:20.971110 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:20.971648 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:20.971654 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:20.971774 (+ 120us) client_negotiation.cc:769] Sending connection context
0811 17:08:20.971893 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 17:08:20.972025 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":100,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
I20260811 17:08:20.991874 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:33275
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:37747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:21.117363 7089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:21.117691 7089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:21.117741 7089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:21.122656 7089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:21.122746 7089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:21.122790 7089 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 17:08:21.122864 7089 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:08:21.129624 7089 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:37747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.146.254:33275
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7089
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:21.131057 7089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:21.132326 7089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:21.144150 7105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:21.144277 7089 server_base.cc:1034] running on GCE node
W20260811 17:08:21.144289 7108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:21.144150 7112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:21.145206 7089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:21.146049 7089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:21.147281 7089 hybrid_clock.cc:648] HybridClock initialized: now 1786468101147264 us; error 28 us; skew 500 ppm
Aug 11 17:08:21 dist-test-slave-7vjv krb5kdc[6638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468101, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:21.150671 7089 init.cc:377] Logged in from keytab as kudu/127.4.146.194@KRBTEST.COM (short username kudu)
I20260811 17:08:21.151736 7089 webserver.cc:460] Webserver started at http://127.4.146.194:39261/ using document root <none> and password file <none>
I20260811 17:08:21.152598 7089 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:21.152704 7089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:21.152945 7089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:21.155265 7089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "9bb3ff8a66384d13aeaa31875b446494"
format_stamp: "Formatted at 2026-08-11 17:08:21 on dist-test-slave-7vjv"
server_key: "c7c6a13f9faa86791507b74ce8960223"
server_key_iv: "1a9fa58936c0e41234dc8f2cfcf517ba"
server_key_version: "encryptionkey@0"
I20260811 17:08:21.155885 7089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "9bb3ff8a66384d13aeaa31875b446494"
format_stamp: "Formatted at 2026-08-11 17:08:21 on dist-test-slave-7vjv"
server_key: "c7c6a13f9faa86791507b74ce8960223"
server_key_iv: "1a9fa58936c0e41234dc8f2cfcf517ba"
server_key_version: "encryptionkey@0"
I20260811 17:08:21.160533 7089 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 17:08:21.163460 7128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:21.165148 7089 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:08:21.165331 7089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "9bb3ff8a66384d13aeaa31875b446494"
format_stamp: "Formatted at 2026-08-11 17:08:21 on dist-test-slave-7vjv"
server_key: "c7c6a13f9faa86791507b74ce8960223"
server_key_iv: "1a9fa58936c0e41234dc8f2cfcf517ba"
server_key_version: "encryptionkey@0"
I20260811 17:08:21.165477 7089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:21.181246 7089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:21.185689 7089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:21.185982 7089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:21.188318 7089 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:21.188403 7089 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:21.188483 7089 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:21.188534 7089 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 17:08:21 dist-test-slave-7vjv krb5kdc[6638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468101, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:21.209887 7089 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:38813
I20260811 17:08:21.210170 7343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:38813 every 8 connection(s)
I20260811 17:08:21.210346 6811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.189418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:42267 (local address 127.4.146.254:33275)
0811 17:08:21.189586 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:21.189592 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:21.190888 (+ 1296us) server_negotiation.cc:407] Connection header received
0811 17:08:21.192804 (+ 1916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:21.192807 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:21.192863 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:21.192947 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:21.195288 (+ 2341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.196196 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.198867 (+ 2671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.199212 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.199333 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.205087 (+ 5754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:21.205092 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:21.205095 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:21.205133 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:21.207602 (+ 2469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:21.208411 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:21.208416 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:21.208418 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:21.208523 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:21.208905 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:21.208911 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:21.208916 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:21.209242 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:21.209386 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:21.210027 (+ 641us) server_negotiation.cc:299] Negotiation successful
0811 17:08:21.210182 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 17:08:21.211045 7089 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:08:21.211421 7141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.189920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33275 (local address 127.4.146.194:42267)
0811 17:08:21.190625 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:21.190711 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:21.192452 (+ 1741us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:21.193271 (+ 819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:21.193283 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:21.194079 (+ 796us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:21.195008 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:21.195049 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.196395 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.196400 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:21.198642 (+ 2242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:21.198657 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.199422 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.199427 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:21.199730 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.200762 (+ 1032us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:21.200792 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:21.204819 (+ 4027us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:21.207820 (+ 3001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:21.207829 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:21.207853 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:21.208282 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:21.208624 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:21.208626 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:21.208628 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:21.208783 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:21.209405 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:21.209412 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:21.209714 (+ 302us) client_negotiation.cc:769] Sending connection context
0811 17:08:21.209954 (+ 240us) client_negotiation.cc:240] Negotiation successful
0811 17:08:21.210468 (+ 514us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":147,"threads_started":1}
I20260811 17:08:21.213179 7344 heartbeater.cc:347] Connected to a master server at 127.4.146.254:33275
I20260811 17:08:21.213382 7344 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:21.214069 7344 heartbeater.cc:511] Master 127.4.146.254:33275 requested a full tablet report, sending...
I20260811 17:08:21.215507 6717 ts_manager.cc:194] Registered new tserver with Master: 9bb3ff8a66384d13aeaa31875b446494 (127.4.146.194:38813)
I20260811 17:08:21.216365 6717 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.194@KRBTEST.COM'} at 127.4.146.194:42267
I20260811 17:08:21.221014 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 7089
I20260811 17:08:21.221203 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:08:21.221525 4683 external_mini_cluster.cc:1428] Setting key edec8b15b580ac533f2d9d66c2bc2809
I20260811 17:08:21.224330 6811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.215792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:50827 (local address 127.4.146.254:33275)
0811 17:08:21.215911 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:21.215916 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:21.216300 (+ 384us) server_negotiation.cc:407] Connection header received
0811 17:08:21.216453 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:21.216456 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:21.216510 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:21.216623 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:21.217411 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.218184 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.219041 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.219252 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.219339 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.220699 (+ 1360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:21.220702 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:21.220704 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:21.220730 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:21.222485 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:21.222989 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:21.222994 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:21.222996 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:21.223088 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:21.223383 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:21.223386 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:21.223388 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:21.223629 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:21.223744 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:21.224018 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 17:08:21.224172 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 17:08:21.224344 7355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.215794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33275 (local address 127.4.146.194:50827)
0811 17:08:21.216188 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:21.216203 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:21.216314 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:21.216724 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:21.216727 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:21.217046 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:21.217245 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:21.217258 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.218333 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.218337 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:21.218919 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:21.218928 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.219378 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.219381 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:21.219453 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.220017 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:21.220052 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:21.220522 (+ 470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:21.222626 (+ 2104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:21.222629 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:21.222631 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:21.222908 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:21.223185 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:21.223188 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:21.223190 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:21.223284 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:21.223732 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:21.223735 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:21.223845 (+ 110us) client_negotiation.cc:769] Sending connection context
0811 17:08:21.223949 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 17:08:21.224159 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":122,"threads_started":1}
WARNING: no policy specified for kudu/127.4.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
I20260811 17:08:21.256981 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:33275
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:37747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:21.422677 7359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:21.423008 7359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:21.423110 7359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:21.427729 7359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:21.427810 7359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:21.427879 7359 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 17:08:21.427968 7359 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:08:21.434046 7359 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:37747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.146.254:33275
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:21.435350 7359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:21.436559 7359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:21.448477 7365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:21.448588 7367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:21.448647 7359 server_base.cc:1034] running on GCE node
W20260811 17:08:21.448589 7370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:21.449505 7359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:21.450314 7359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:21.451552 7359 hybrid_clock.cc:648] HybridClock initialized: now 1786468101451532 us; error 40 us; skew 500 ppm
Aug 11 17:08:21 dist-test-slave-7vjv krb5kdc[6638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468101, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:21.455652 7359 init.cc:377] Logged in from keytab as kudu/127.4.146.195@KRBTEST.COM (short username kudu)
I20260811 17:08:21.456776 7359 webserver.cc:460] Webserver started at http://127.4.146.195:39841/ using document root <none> and password file <none>
I20260811 17:08:21.457414 7359 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:21.457517 7359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:21.457780 7359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:21.460340 7359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "e7645a9ddc964ddc8748bcbe7180f4ab"
format_stamp: "Formatted at 2026-08-11 17:08:21 on dist-test-slave-7vjv"
server_key: "07b666ad538c51d9fc698e7ab574d7f9"
server_key_iv: "1cfacd253d61a1c7605034ba6e4143de"
server_key_version: "encryptionkey@0"
I20260811 17:08:21.461020 7359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "e7645a9ddc964ddc8748bcbe7180f4ab"
format_stamp: "Formatted at 2026-08-11 17:08:21 on dist-test-slave-7vjv"
server_key: "07b666ad538c51d9fc698e7ab574d7f9"
server_key_iv: "1cfacd253d61a1c7605034ba6e4143de"
server_key_version: "encryptionkey@0"
I20260811 17:08:21.465543 7359 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 17:08:21.468637 7379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:21.470409 7359 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 17:08:21.470630 7359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "e7645a9ddc964ddc8748bcbe7180f4ab"
format_stamp: "Formatted at 2026-08-11 17:08:21 on dist-test-slave-7vjv"
server_key: "07b666ad538c51d9fc698e7ab574d7f9"
server_key_iv: "1cfacd253d61a1c7605034ba6e4143de"
server_key_version: "encryptionkey@0"
I20260811 17:08:21.470862 7359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:21.492486 7359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:21.496377 7359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:21.496704 7359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:21.498538 7359 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:21.498620 7359 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:21.498701 7359 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:21.498747 7359 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 17:08:21 dist-test-slave-7vjv krb5kdc[6638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468101, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:21.517889 7359 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:39089
I20260811 17:08:21.518169 7594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:39089 every 8 connection(s)
I20260811 17:08:21.518594 6811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.499477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:52121 (local address 127.4.146.254:33275)
0811 17:08:21.499702 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:21.499708 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:21.500926 (+ 1218us) server_negotiation.cc:407] Connection header received
0811 17:08:21.501903 (+ 977us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:21.501907 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:21.502029 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:21.502190 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:21.503620 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.504666 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.506621 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.507081 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.507206 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.513047 (+ 5841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:21.513050 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:21.513058 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:21.513090 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:21.515327 (+ 2237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:21.516264 (+ 937us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:21.516271 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:21.516273 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:21.516395 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:21.516829 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:21.516836 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:21.516840 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:21.517278 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:21.517423 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:21.518222 (+ 799us) server_negotiation.cc:299] Negotiation successful
0811 17:08:21.518424 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 17:08:21.519217 7359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:08:21.519562 7390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.500033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33275 (local address 127.4.146.195:52121)
0811 17:08:21.500726 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:21.500780 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:21.501650 (+ 870us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:21.502358 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:21.502365 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:21.502764 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:21.503428 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:21.503442 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.504847 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.504851 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:21.506454 (+ 1603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:21.506471 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.507333 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.507343 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:21.507553 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.508846 (+ 1293us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:21.508871 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:21.512756 (+ 3885us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:21.515507 (+ 2751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:21.515517 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:21.515541 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:21.516054 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:21.516509 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:21.516511 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:21.516513 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:21.516701 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:21.517426 (+ 725us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:21.517433 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:21.517855 (+ 422us) client_negotiation.cc:769] Sending connection context
0811 17:08:21.518125 (+ 270us) client_negotiation.cc:240] Negotiation successful
0811 17:08:21.518540 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":246,"threads_started":1}
I20260811 17:08:21.521232 7595 heartbeater.cc:347] Connected to a master server at 127.4.146.254:33275
I20260811 17:08:21.521413 7595 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:21.521960 7595 heartbeater.cc:511] Master 127.4.146.254:33275 requested a full tablet report, sending...
I20260811 17:08:21.523180 6717 ts_manager.cc:194] Registered new tserver with Master: e7645a9ddc964ddc8748bcbe7180f4ab (127.4.146.195:39089)
I20260811 17:08:21.523869 6717 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.195@KRBTEST.COM'} at 127.4.146.195:52121
I20260811 17:08:21.527655 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 7359
I20260811 17:08:21.527819 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:08:21.528155 4683 external_mini_cluster.cc:1428] Setting key 2d9c4c8779a67bf3d643a4509f5efdd3
I20260811 17:08:21.530436 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 17:08:21.532681 6811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.524204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:36477 (local address 127.4.146.254:33275)
0811 17:08:21.524341 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:21.524346 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:21.524644 (+ 298us) server_negotiation.cc:407] Connection header received
0811 17:08:21.524761 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:21.524764 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:21.524814 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:21.524901 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:21.525570 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.526082 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.527155 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.527415 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.527550 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.529155 (+ 1605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:21.529158 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:21.529161 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:21.529190 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:21.530820 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:21.531279 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:21.531283 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:21.531285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:21.531377 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:21.531683 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:21.531687 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:21.531689 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:21.531890 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:21.532003 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:21.532342 (+ 339us) server_negotiation.cc:299] Negotiation successful
0811 17:08:21.532465 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 17:08:21.532840 7608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.524155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33275 (local address 127.4.146.195:36477)
0811 17:08:21.524549 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:21.524562 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:21.524680 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:21.524919 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:21.524922 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:21.525280 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:21.525448 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:21.525455 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.526281 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.526285 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:21.527023 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:21.527033 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.527581 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.527584 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:21.527710 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.528563 (+ 853us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:21.528575 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:21.529021 (+ 446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:21.530941 (+ 1920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:21.530944 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:21.530946 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:21.531169 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:21.531483 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:21.531486 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:21.531488 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:21.531585 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:21.531994 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:21.531997 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:21.532152 (+ 155us) client_negotiation.cc:769] Sending connection context
0811 17:08:21.532280 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 17:08:21.532458 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":143,"threads_started":1}
Aug 11 17:08:21 dist-test-slave-7vjv krb5kdc[6638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468101, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 17:08:21 dist-test-slave-7vjv krb5kdc[6638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468101, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:21.563643 6811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.554337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41178 (local address 127.4.146.254:33275)
0811 17:08:21.554474 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:21.554477 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:21.554491 (+ 14us) server_negotiation.cc:407] Connection header received
0811 17:08:21.554537 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:21.554539 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:21.554580 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:21.554658 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:21.555431 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.555947 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.557190 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.557422 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.557518 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.560338 (+ 2820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:21.560341 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:21.560343 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:21.560371 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:21.561786 (+ 1415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:21.562311 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:21.562314 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:21.562315 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:21.562408 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:21.562744 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:21.562746 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:21.562747 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:21.562946 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:21.563054 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:21.563388 (+ 334us) server_negotiation.cc:299] Negotiation successful
0811 17:08:21.563513 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 17:08:21.567615 6717 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41178:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 17:08:21.571326 6717 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:08:21.588512 7627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.581302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:38813 (local address 127.0.0.1:50766)
0811 17:08:21.582298 (+ 996us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:21.582377 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:21.582548 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:21.583192 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:21.583200 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:21.583243 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:21.583421 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:21.583428 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.584662 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.584665 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:21.586526 (+ 1861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:21.586542 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.587808 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.587812 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:21.587933 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.587979 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 17:08:21.588164 (+ 185us) client_negotiation.cc:240] Negotiation successful
0811 17:08:21.588317 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":736,"mutex_wait_us":189,"thread_start_us":129,"threads_started":1}
I20260811 17:08:21.589273 7629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.581419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50766 (local address 127.4.146.194:38813)
0811 17:08:21.582048 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:21.582119 (+ 71us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:21.582702 (+ 583us) server_negotiation.cc:407] Connection header received
0811 17:08:21.582791 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:21.582796 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:21.583025 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:21.583220 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:21.583557 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.584518 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.586669 (+ 2151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.587665 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.587759 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.587961 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:21.588918 (+ 957us) server_negotiation.cc:299] Negotiation successful
0811 17:08:21.589061 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":519,"thread_start_us":248,"threads_started":1}
I20260811 17:08:21.589418 7634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.582775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44620 (local address 127.4.146.193:34635)
0811 17:08:21.583067 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:21.583073 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:21.583421 (+ 348us) server_negotiation.cc:407] Connection header received
0811 17:08:21.584257 (+ 836us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:21.584264 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:21.584442 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:21.584599 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:21.584938 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.585927 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.587359 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.588059 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.588214 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.588360 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:21.589074 (+ 714us) server_negotiation.cc:299] Negotiation successful
0811 17:08:21.589286 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":91,"threads_started":1}
I20260811 17:08:21.588956 7633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.582263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:34635 (local address 127.0.0.1:44620)
0811 17:08:21.583283 (+ 1020us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:21.583299 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:21.583430 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:21.584591 (+ 1161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:21.584594 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:21.584615 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:21.584777 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:21.584789 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.586042 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.586049 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:21.587196 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:21.587208 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.588539 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.588544 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:21.588635 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.588660 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 17:08:21.588738 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 17:08:21.588812 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":955,"mutex_wait_us":26,"thread_start_us":158,"threads_started":1}
I20260811 17:08:21.589459 7626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.581336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:39089 (local address 127.0.0.1:34082)
0811 17:08:21.582501 (+ 1165us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:21.582515 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:21.582603 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:21.583392 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:21.583396 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:21.583411 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:21.583497 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:21.583504 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.584774 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.584776 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:21.586526 (+ 1750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:21.586539 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.589096 (+ 2557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.589099 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:21.589189 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.589213 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 17:08:21.589264 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 17:08:21.589327 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1106,"mutex_wait_us":147,"spinlock_wait_cycles":9472,"thread_start_us":127,"threads_started":1}
I20260811 17:08:21.590319 7632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.581585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34082 (local address 127.4.146.195:39089)
0811 17:08:21.582325 (+ 740us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:21.582379 (+ 54us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:21.582901 (+ 522us) server_negotiation.cc:407] Connection header received
0811 17:08:21.582989 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:21.582995 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:21.583190 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:21.583644 (+ 454us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:21.583756 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.584673 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.588029 (+ 3356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.588949 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.589571 (+ 622us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.589954 (+ 383us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:21.590071 (+ 117us) server_negotiation.cc:299] Negotiation successful
0811 17:08:21.590173 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":130,"threads_started":1}
I20260811 17:08:21.593464 6966 tablet_service.cc:1467] Processing CreateTablet for tablet f05fcaeb28d7499e90dca023383af038 (DEFAULT_TABLE table=test-table [id=eb951a1b8e674b42bbbefe5e9b7e4e4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:21.593488 7226 tablet_service.cc:1467] Processing CreateTablet for tablet f05fcaeb28d7499e90dca023383af038 (DEFAULT_TABLE table=test-table [id=eb951a1b8e674b42bbbefe5e9b7e4e4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:21.593488 7463 tablet_service.cc:1467] Processing CreateTablet for tablet f05fcaeb28d7499e90dca023383af038 (DEFAULT_TABLE table=test-table [id=eb951a1b8e674b42bbbefe5e9b7e4e4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:21.594676 6966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f05fcaeb28d7499e90dca023383af038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:21.594678 7226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f05fcaeb28d7499e90dca023383af038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:21.594693 7463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f05fcaeb28d7499e90dca023383af038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:21.602424 7635 tablet_bootstrap.cc:492] T f05fcaeb28d7499e90dca023383af038 P 338736e3a7604b959e0b7195d6fb3b7c: Bootstrap starting.
I20260811 17:08:21.604892 7641 tablet_bootstrap.cc:492] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494: Bootstrap starting.
I20260811 17:08:21.605396 7635 tablet_bootstrap.cc:654] T f05fcaeb28d7499e90dca023383af038 P 338736e3a7604b959e0b7195d6fb3b7c: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:21.605711 7639 tablet_bootstrap.cc:492] T f05fcaeb28d7499e90dca023383af038 P e7645a9ddc964ddc8748bcbe7180f4ab: Bootstrap starting.
I20260811 17:08:21.607144 7635 log.cc:824] T f05fcaeb28d7499e90dca023383af038 P 338736e3a7604b959e0b7195d6fb3b7c: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:21.608203 7641 tablet_bootstrap.cc:654] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:21.608264 7639 tablet_bootstrap.cc:654] T f05fcaeb28d7499e90dca023383af038 P e7645a9ddc964ddc8748bcbe7180f4ab: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:21.609460 7639 log.cc:824] T f05fcaeb28d7499e90dca023383af038 P e7645a9ddc964ddc8748bcbe7180f4ab: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:21.609519 7641 log.cc:824] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:21.609813 7635 tablet_bootstrap.cc:492] T f05fcaeb28d7499e90dca023383af038 P 338736e3a7604b959e0b7195d6fb3b7c: No bootstrap required, opened a new log
I20260811 17:08:21.610085 7635 ts_tablet_manager.cc:1397] T f05fcaeb28d7499e90dca023383af038 P 338736e3a7604b959e0b7195d6fb3b7c: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.002s
I20260811 17:08:21.612031 7639 tablet_bootstrap.cc:492] T f05fcaeb28d7499e90dca023383af038 P e7645a9ddc964ddc8748bcbe7180f4ab: No bootstrap required, opened a new log
I20260811 17:08:21.612314 7639 ts_tablet_manager.cc:1397] T f05fcaeb28d7499e90dca023383af038 P e7645a9ddc964ddc8748bcbe7180f4ab: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.004s
I20260811 17:08:21.613866 7641 tablet_bootstrap.cc:492] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494: No bootstrap required, opened a new log
I20260811 17:08:21.614243 7641 ts_tablet_manager.cc:1397] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260811 17:08:21.616384 7635 raft_consensus.cc:348] T f05fcaeb28d7499e90dca023383af038 P 338736e3a7604b959e0b7195d6fb3b7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } } peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } }
I20260811 17:08:21.616662 7635 raft_consensus.cc:374] T f05fcaeb28d7499e90dca023383af038 P 338736e3a7604b959e0b7195d6fb3b7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:21.616719 7635 raft_consensus.cc:729] T f05fcaeb28d7499e90dca023383af038 P 338736e3a7604b959e0b7195d6fb3b7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338736e3a7604b959e0b7195d6fb3b7c, State: Initialized, Role: FOLLOWER
I20260811 17:08:21.617199 7635 consensus_queue.cc:260] T f05fcaeb28d7499e90dca023383af038 P 338736e3a7604b959e0b7195d6fb3b7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } } peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } }
I20260811 17:08:21.617933 7073 heartbeater.cc:503] Master 127.4.146.254:33275 was elected leader, sending a full tablet report...
I20260811 17:08:21.618311 7635 ts_tablet_manager.cc:1428] T f05fcaeb28d7499e90dca023383af038 P 338736e3a7604b959e0b7195d6fb3b7c: Time spent starting tablet: real 0.008s user 0.006s sys 0.002s
I20260811 17:08:21.619120 7639 raft_consensus.cc:348] T f05fcaeb28d7499e90dca023383af038 P e7645a9ddc964ddc8748bcbe7180f4ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } } peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } }
I20260811 17:08:21.619432 7639 raft_consensus.cc:374] T f05fcaeb28d7499e90dca023383af038 P e7645a9ddc964ddc8748bcbe7180f4ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:21.619501 7639 raft_consensus.cc:729] T f05fcaeb28d7499e90dca023383af038 P e7645a9ddc964ddc8748bcbe7180f4ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7645a9ddc964ddc8748bcbe7180f4ab, State: Initialized, Role: FOLLOWER
I20260811 17:08:21.620167 7639 consensus_queue.cc:260] T f05fcaeb28d7499e90dca023383af038 P e7645a9ddc964ddc8748bcbe7180f4ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } } peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } }
I20260811 17:08:21.620790 7641 raft_consensus.cc:348] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } } peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } }
I20260811 17:08:21.621073 7641 raft_consensus.cc:374] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:21.621124 7641 raft_consensus.cc:729] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bb3ff8a66384d13aeaa31875b446494, State: Initialized, Role: FOLLOWER
I20260811 17:08:21.621452 7639 ts_tablet_manager.cc:1428] T f05fcaeb28d7499e90dca023383af038 P e7645a9ddc964ddc8748bcbe7180f4ab: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260811 17:08:21.621593 7595 heartbeater.cc:503] Master 127.4.146.254:33275 was elected leader, sending a full tablet report...
I20260811 17:08:21.621795 7641 consensus_queue.cc:260] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } } peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } }
I20260811 17:08:21.622782 7344 heartbeater.cc:503] Master 127.4.146.254:33275 was elected leader, sending a full tablet report...
I20260811 17:08:21.623116 7641 ts_tablet_manager.cc:1428] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260811 17:08:21.651391 7651 raft_consensus.cc:482] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:08:21.651722 7651 raft_consensus.cc:504] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } } peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } }
I20260811 17:08:21.653213 7651 leader_election.cc:288] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7645a9ddc964ddc8748bcbe7180f4ab (127.4.146.195:39089), 338736e3a7604b959e0b7195d6fb3b7c (127.4.146.193:34635)
I20260811 17:08:21.658630 7141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.653655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:39089 (local address 127.4.146.194:46851)
0811 17:08:21.653796 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:21.653814 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:21.653941 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:21.654410 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:21.654414 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:21.654433 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:21.654631 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:21.654644 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.655809 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.655814 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:21.657236 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:21.657248 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.658011 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.658015 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:21.658272 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.658293 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 17:08:21.658391 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 17:08:21.658483 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 17:08:21.658630 7632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.653744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:46851 (local address 127.4.146.195:39089)
0811 17:08:21.653872 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:21.653877 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:21.653895 (+ 18us) server_negotiation.cc:407] Connection header received
0811 17:08:21.654100 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:21.654105 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:21.654165 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:21.654273 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:21.654772 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.655619 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.657419 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.657877 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.658000 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.658050 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:21.658416 (+ 366us) server_negotiation.cc:299] Negotiation successful
0811 17:08:21.658491 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 17:08:21.659492 7507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f05fcaeb28d7499e90dca023383af038" candidate_uuid: "9bb3ff8a66384d13aeaa31875b446494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" is_pre_election: true
I20260811 17:08:21.659780 7654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.654061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:34635 (local address 127.4.146.194:50159)
0811 17:08:21.654611 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:21.654626 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:21.654728 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:21.655023 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:21.655026 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:21.655046 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:21.655321 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:21.655329 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.656238 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.656242 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:21.658016 (+ 1774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:21.658025 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.659238 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.659242 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:21.659336 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.659362 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 17:08:21.659503 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 17:08:21.659581 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":215,"threads_started":1}
I20260811 17:08:21.659843 7634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.654279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:50159 (local address 127.4.146.193:34635)
0811 17:08:21.654399 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:21.654404 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:21.654717 (+ 313us) server_negotiation.cc:407] Connection header received
0811 17:08:21.654844 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:21.654847 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:21.654896 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:21.654982 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:21.655458 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.656035 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.658253 (+ 2218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.659067 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.659203 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.659254 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:21.659569 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 17:08:21.659673 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 17:08:21.659924 7507 raft_consensus.cc:2454] T f05fcaeb28d7499e90dca023383af038 P e7645a9ddc964ddc8748bcbe7180f4ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bb3ff8a66384d13aeaa31875b446494 in term 0.
I20260811 17:08:21.660640 7130 leader_election.cc:302] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bb3ff8a66384d13aeaa31875b446494, e7645a9ddc964ddc8748bcbe7180f4ab; no voters:
I20260811 17:08:21.660921 7002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f05fcaeb28d7499e90dca023383af038" candidate_uuid: "9bb3ff8a66384d13aeaa31875b446494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338736e3a7604b959e0b7195d6fb3b7c" is_pre_election: true
I20260811 17:08:21.660944 7651 raft_consensus.cc:2781] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:08:21.661053 7651 raft_consensus.cc:482] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:08:21.661127 7651 raft_consensus.cc:3037] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:21.661293 7002 raft_consensus.cc:2454] T f05fcaeb28d7499e90dca023383af038 P 338736e3a7604b959e0b7195d6fb3b7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bb3ff8a66384d13aeaa31875b446494 in term 0.
I20260811 17:08:21.662909 7651 raft_consensus.cc:504] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } } peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } }
I20260811 17:08:21.663331 7651 leader_election.cc:288] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494 [CANDIDATE]: Term 1 election: Requested vote from peers e7645a9ddc964ddc8748bcbe7180f4ab (127.4.146.195:39089), 338736e3a7604b959e0b7195d6fb3b7c (127.4.146.193:34635)
I20260811 17:08:21.663829 7507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f05fcaeb28d7499e90dca023383af038" candidate_uuid: "9bb3ff8a66384d13aeaa31875b446494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab"
I20260811 17:08:21.663956 7507 raft_consensus.cc:3037] T f05fcaeb28d7499e90dca023383af038 P e7645a9ddc964ddc8748bcbe7180f4ab [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:21.664075 7002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f05fcaeb28d7499e90dca023383af038" candidate_uuid: "9bb3ff8a66384d13aeaa31875b446494" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338736e3a7604b959e0b7195d6fb3b7c"
I20260811 17:08:21.664300 7002 raft_consensus.cc:3037] T f05fcaeb28d7499e90dca023383af038 P 338736e3a7604b959e0b7195d6fb3b7c [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:21.666024 7507 raft_consensus.cc:2454] T f05fcaeb28d7499e90dca023383af038 P e7645a9ddc964ddc8748bcbe7180f4ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bb3ff8a66384d13aeaa31875b446494 in term 1.
I20260811 17:08:21.666172 7002 raft_consensus.cc:2454] T f05fcaeb28d7499e90dca023383af038 P 338736e3a7604b959e0b7195d6fb3b7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bb3ff8a66384d13aeaa31875b446494 in term 1.
I20260811 17:08:21.666465 7130 leader_election.cc:302] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bb3ff8a66384d13aeaa31875b446494, e7645a9ddc964ddc8748bcbe7180f4ab; no voters:
I20260811 17:08:21.666685 7651 raft_consensus.cc:2781] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:21.666903 7651 raft_consensus.cc:686] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494 [term 1 LEADER]: Becoming Leader. State: Replica: 9bb3ff8a66384d13aeaa31875b446494, State: Running, Role: LEADER
I20260811 17:08:21.667285 7651 consensus_queue.cc:237] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } } peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } }
I20260811 17:08:21.671241 6717 catalog_manager.cc:5495] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bb3ff8a66384d13aeaa31875b446494 (127.4.146.194). New cstate: current_term: 1 leader_uuid: "9bb3ff8a66384d13aeaa31875b446494" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } health_report { overall_health: UNKNOWN } } }
I20260811 17:08:21.694897 7629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.690814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50778 (local address 127.4.146.194:38813)
0811 17:08:21.690959 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:21.690962 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:21.690979 (+ 17us) server_negotiation.cc:407] Connection header received
0811 17:08:21.691151 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:21.691154 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:21.691220 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:21.691320 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:08:21.691640 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.692248 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.693252 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.693475 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.693558 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.693920 (+ 362us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:08:21.694396 (+ 476us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:08:21.694491 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:21.694671 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 17:08:21.694734 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 17:08:21.701671 7002 raft_consensus.cc:1261] T f05fcaeb28d7499e90dca023383af038 P 338736e3a7604b959e0b7195d6fb3b7c [term 1 FOLLOWER]: Refusing update from remote peer 9bb3ff8a66384d13aeaa31875b446494: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:08:21.701671 7507 raft_consensus.cc:1261] T f05fcaeb28d7499e90dca023383af038 P e7645a9ddc964ddc8748bcbe7180f4ab [term 1 FOLLOWER]: Refusing update from remote peer 9bb3ff8a66384d13aeaa31875b446494: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:08:21.702802 7656 consensus_queue.cc:1035] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:08:21.703183 7651 consensus_queue.cc:1035] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494 [LEADER]: Connected to new peer: Peer: permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 17:08:21.704234 7074 tablet.cc:2369] T f05fcaeb28d7499e90dca023383af038 P 338736e3a7604b959e0b7195d6fb3b7c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 17:08:21.713975 7665 mvcc.cc:205] Tried to move back new op lower bound from 7317373344560742400 to 7317373344432320512. Current Snapshot: MvccSnapshot[applied={T|T < 7317373344560742400}]
I20260811 17:08:21.714380 7663 mvcc.cc:205] Tried to move back new op lower bound from 7317373344560742400 to 7317373344432320512. Current Snapshot: MvccSnapshot[applied={T|T < 7317373344560742400}]
I20260811 17:08:21.727556 6717 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41178:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:08:21.727818 6717 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41178:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:08:21.731061 6717 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d: Sending DeleteTablet for 3 replicas of tablet f05fcaeb28d7499e90dca023383af038
I20260811 17:08:21.732195 7226 tablet_service.cc:1514] Processing DeleteTablet for tablet f05fcaeb28d7499e90dca023383af038 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:21 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:50766
I20260811 17:08:21.732275 7463 tablet_service.cc:1514] Processing DeleteTablet for tablet f05fcaeb28d7499e90dca023383af038 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:21 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:34082
I20260811 17:08:21.733187 7681 tablet_replica.cc:330] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494: stopping tablet replica
I20260811 17:08:21.733135 7683 tablet_replica.cc:330] T f05fcaeb28d7499e90dca023383af038 P e7645a9ddc964ddc8748bcbe7180f4ab: stopping tablet replica
I20260811 17:08:21.733189 6966 tablet_service.cc:1514] Processing DeleteTablet for tablet f05fcaeb28d7499e90dca023383af038 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:21 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:44620
I20260811 17:08:21.733273 6717 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41178:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 17:08:21.733630 7683 raft_consensus.cc:2229] T f05fcaeb28d7499e90dca023383af038 P e7645a9ddc964ddc8748bcbe7180f4ab [term 1 FOLLOWER]: Raft consensus shutting down.
W20260811 17:08:21.733748 6717 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:08:21.733964 7681 raft_consensus.cc:2229] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494 [term 1 LEADER]: Raft consensus shutting down.
I20260811 17:08:21.734135 7683 raft_consensus.cc:2258] T f05fcaeb28d7499e90dca023383af038 P e7645a9ddc964ddc8748bcbe7180f4ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:21.734543 7681 raft_consensus.cc:2258] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:21.735994 7681 ts_tablet_manager.cc:1905] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:21.737411 7683 ts_tablet_manager.cc:1905] T f05fcaeb28d7499e90dca023383af038 P e7645a9ddc964ddc8748bcbe7180f4ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:21.740041 7681 ts_tablet_manager.cc:1918] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:08:21.740211 7681 log.cc:1196] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-1/wal/wals/f05fcaeb28d7499e90dca023383af038
I20260811 17:08:21.740584 7681 ts_tablet_manager.cc:1939] T f05fcaeb28d7499e90dca023383af038 P 9bb3ff8a66384d13aeaa31875b446494: Deleting consensus metadata
I20260811 17:08:21.740659 6966 tablet_service.cc:1467] Processing CreateTablet for tablet 3afc00591d1045639706af059ad47ec6 (DEFAULT_TABLE table=test-table [id=734ffc6a3d244d6aa58042842947840d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:21.740978 6966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3afc00591d1045639706af059ad47ec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:21.741225 7463 tablet_service.cc:1467] Processing CreateTablet for tablet 3afc00591d1045639706af059ad47ec6 (DEFAULT_TABLE table=test-table [id=734ffc6a3d244d6aa58042842947840d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:21.741480 7463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3afc00591d1045639706af059ad47ec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:21.742010 7684 tablet_replica.cc:330] T f05fcaeb28d7499e90dca023383af038 P 338736e3a7604b959e0b7195d6fb3b7c: stopping tablet replica
I20260811 17:08:21.742425 7684 raft_consensus.cc:2229] T f05fcaeb28d7499e90dca023383af038 P 338736e3a7604b959e0b7195d6fb3b7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:08:21.742821 7684 raft_consensus.cc:2258] T f05fcaeb28d7499e90dca023383af038 P 338736e3a7604b959e0b7195d6fb3b7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:21.743530 6693 catalog_manager.cc:4841] TS 9bb3ff8a66384d13aeaa31875b446494 (127.4.146.194:38813): tablet f05fcaeb28d7499e90dca023383af038 (table test-table [id=eb951a1b8e674b42bbbefe5e9b7e4e4d]) successfully deleted
I20260811 17:08:21.743877 7635 tablet_bootstrap.cc:492] T 3afc00591d1045639706af059ad47ec6 P 338736e3a7604b959e0b7195d6fb3b7c: Bootstrap starting.
I20260811 17:08:21.744369 7639 tablet_bootstrap.cc:492] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab: Bootstrap starting.
I20260811 17:08:21.745705 7635 tablet_bootstrap.cc:654] T 3afc00591d1045639706af059ad47ec6 P 338736e3a7604b959e0b7195d6fb3b7c: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:21.746026 7639 tablet_bootstrap.cc:654] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:21.746591 7684 ts_tablet_manager.cc:1905] T f05fcaeb28d7499e90dca023383af038 P 338736e3a7604b959e0b7195d6fb3b7c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:21.746806 7226 tablet_service.cc:1467] Processing CreateTablet for tablet 3afc00591d1045639706af059ad47ec6 (DEFAULT_TABLE table=test-table [id=734ffc6a3d244d6aa58042842947840d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:21.747076 7226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3afc00591d1045639706af059ad47ec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:21.747478 7635 tablet_bootstrap.cc:492] T 3afc00591d1045639706af059ad47ec6 P 338736e3a7604b959e0b7195d6fb3b7c: No bootstrap required, opened a new log
I20260811 17:08:21.747581 7635 ts_tablet_manager.cc:1397] T 3afc00591d1045639706af059ad47ec6 P 338736e3a7604b959e0b7195d6fb3b7c: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260811 17:08:21.747741 7639 tablet_bootstrap.cc:492] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab: No bootstrap required, opened a new log
I20260811 17:08:21.747815 7639 ts_tablet_manager.cc:1397] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260811 17:08:21.748657 7639 raft_consensus.cc:348] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } }
I20260811 17:08:21.748793 7639 raft_consensus.cc:374] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:21.748711 7635 raft_consensus.cc:348] T 3afc00591d1045639706af059ad47ec6 P 338736e3a7604b959e0b7195d6fb3b7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } }
I20260811 17:08:21.748828 7639 raft_consensus.cc:729] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7645a9ddc964ddc8748bcbe7180f4ab, State: Initialized, Role: FOLLOWER
I20260811 17:08:21.748842 7635 raft_consensus.cc:374] T 3afc00591d1045639706af059ad47ec6 P 338736e3a7604b959e0b7195d6fb3b7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:21.748873 7635 raft_consensus.cc:729] T 3afc00591d1045639706af059ad47ec6 P 338736e3a7604b959e0b7195d6fb3b7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338736e3a7604b959e0b7195d6fb3b7c, State: Initialized, Role: FOLLOWER
I20260811 17:08:21.748961 7639 consensus_queue.cc:260] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } }
I20260811 17:08:21.749001 7635 consensus_queue.cc:260] T 3afc00591d1045639706af059ad47ec6 P 338736e3a7604b959e0b7195d6fb3b7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } }
I20260811 17:08:21.749269 7639 ts_tablet_manager.cc:1428] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260811 17:08:21.749290 7635 ts_tablet_manager.cc:1428] T 3afc00591d1045639706af059ad47ec6 P 338736e3a7604b959e0b7195d6fb3b7c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 17:08:21.750417 7641 tablet_bootstrap.cc:492] T 3afc00591d1045639706af059ad47ec6 P 9bb3ff8a66384d13aeaa31875b446494: Bootstrap starting.
I20260811 17:08:21.751865 7641 tablet_bootstrap.cc:654] T 3afc00591d1045639706af059ad47ec6 P 9bb3ff8a66384d13aeaa31875b446494: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:21.752084 7684 ts_tablet_manager.cc:1918] T f05fcaeb28d7499e90dca023383af038 P 338736e3a7604b959e0b7195d6fb3b7c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:08:21.752276 7684 log.cc:1196] T f05fcaeb28d7499e90dca023383af038 P 338736e3a7604b959e0b7195d6fb3b7c: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-0/wal/wals/f05fcaeb28d7499e90dca023383af038
I20260811 17:08:21.752669 7684 ts_tablet_manager.cc:1939] T f05fcaeb28d7499e90dca023383af038 P 338736e3a7604b959e0b7195d6fb3b7c: Deleting consensus metadata
I20260811 17:08:21.752696 7683 ts_tablet_manager.cc:1918] T f05fcaeb28d7499e90dca023383af038 P e7645a9ddc964ddc8748bcbe7180f4ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:08:21.752921 7683 log.cc:1196] T f05fcaeb28d7499e90dca023383af038 P e7645a9ddc964ddc8748bcbe7180f4ab: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/f05fcaeb28d7499e90dca023383af038
I20260811 17:08:21.753381 7683 ts_tablet_manager.cc:1939] T f05fcaeb28d7499e90dca023383af038 P e7645a9ddc964ddc8748bcbe7180f4ab: Deleting consensus metadata
I20260811 17:08:21.754043 6690 catalog_manager.cc:4841] TS 338736e3a7604b959e0b7195d6fb3b7c (127.4.146.193:34635): tablet f05fcaeb28d7499e90dca023383af038 (table test-table [id=eb951a1b8e674b42bbbefe5e9b7e4e4d]) successfully deleted
I20260811 17:08:21.754774 6690 catalog_manager.cc:4841] TS e7645a9ddc964ddc8748bcbe7180f4ab (127.4.146.195:39089): tablet f05fcaeb28d7499e90dca023383af038 (table test-table [id=eb951a1b8e674b42bbbefe5e9b7e4e4d]) successfully deleted
I20260811 17:08:21.755299 7641 tablet_bootstrap.cc:492] T 3afc00591d1045639706af059ad47ec6 P 9bb3ff8a66384d13aeaa31875b446494: No bootstrap required, opened a new log
I20260811 17:08:21.755422 7641 ts_tablet_manager.cc:1397] T 3afc00591d1045639706af059ad47ec6 P 9bb3ff8a66384d13aeaa31875b446494: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 17:08:21.755976 7641 raft_consensus.cc:348] T 3afc00591d1045639706af059ad47ec6 P 9bb3ff8a66384d13aeaa31875b446494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } }
I20260811 17:08:21.756157 7641 raft_consensus.cc:374] T 3afc00591d1045639706af059ad47ec6 P 9bb3ff8a66384d13aeaa31875b446494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:21.756211 7641 raft_consensus.cc:729] T 3afc00591d1045639706af059ad47ec6 P 9bb3ff8a66384d13aeaa31875b446494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bb3ff8a66384d13aeaa31875b446494, State: Initialized, Role: FOLLOWER
I20260811 17:08:21.756358 7641 consensus_queue.cc:260] T 3afc00591d1045639706af059ad47ec6 P 9bb3ff8a66384d13aeaa31875b446494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } }
I20260811 17:08:21.756739 7641 ts_tablet_manager.cc:1428] T 3afc00591d1045639706af059ad47ec6 P 9bb3ff8a66384d13aeaa31875b446494: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
W20260811 17:08:21.771085 7596 tablet.cc:2369] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 17:08:21.868257 7650 raft_consensus.cc:482] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:08:21.868474 7650 raft_consensus.cc:504] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } }
I20260811 17:08:21.870000 7650 leader_election.cc:288] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 338736e3a7604b959e0b7195d6fb3b7c (127.4.146.193:34635), 9bb3ff8a66384d13aeaa31875b446494 (127.4.146.194:38813)
I20260811 17:08:21.875380 7390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.870235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:34635 (local address 127.4.146.195:43189)
0811 17:08:21.870464 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:21.870480 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:21.870616 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:21.871078 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:21.871081 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:21.871104 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:21.871373 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:21.871380 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.872405 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.872410 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:21.873839 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:21.873851 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.874816 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.874820 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:21.875005 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.875028 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 17:08:21.875151 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 17:08:21.875233 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131}
I20260811 17:08:21.875380 7634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.870344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:43189 (local address 127.4.146.193:34635)
0811 17:08:21.870475 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:21.870480 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:21.870553 (+ 73us) server_negotiation.cc:407] Connection header received
0811 17:08:21.870780 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:21.870784 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:21.870856 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:21.870956 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:21.871531 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.872297 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.873988 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.874670 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.874812 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.874875 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:21.875173 (+ 298us) server_negotiation.cc:299] Negotiation successful
0811 17:08:21.875253 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 17:08:21.875726 7629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.870698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:51649 (local address 127.4.146.194:38813)
0811 17:08:21.870823 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:21.870827 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:21.871198 (+ 371us) server_negotiation.cc:407] Connection header received
0811 17:08:21.871305 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:21.871309 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:21.871362 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:21.871449 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:21.871872 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.872656 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.874325 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.874818 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.874970 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.875028 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:21.875413 (+ 385us) server_negotiation.cc:299] Negotiation successful
0811 17:08:21.875522 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 17:08:21.876034 7002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3afc00591d1045639706af059ad47ec6" candidate_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338736e3a7604b959e0b7195d6fb3b7c" is_pre_election: true
I20260811 17:08:21.876216 7002 raft_consensus.cc:2454] T 3afc00591d1045639706af059ad47ec6 P 338736e3a7604b959e0b7195d6fb3b7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7645a9ddc964ddc8748bcbe7180f4ab in term 0.
I20260811 17:08:21.876247 7689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.870235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:38813 (local address 127.4.146.195:51649)
0811 17:08:21.871082 (+ 847us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:21.871096 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:21.871200 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:21.871477 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:21.871482 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:21.871503 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:21.871759 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:21.871767 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.872790 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.872794 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:21.874210 (+ 1416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:21.874218 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.875090 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.875095 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:21.875247 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.875274 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 17:08:21.875873 (+ 599us) client_negotiation.cc:240] Negotiation successful
0811 17:08:21.875952 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":781,"mutex_wait_us":526,"thread_start_us":123,"threads_started":1}
I20260811 17:08:21.876705 7380 leader_election.cc:302] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338736e3a7604b959e0b7195d6fb3b7c, e7645a9ddc964ddc8748bcbe7180f4ab; no voters:
I20260811 17:08:21.877045 7650 raft_consensus.cc:2781] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:08:21.877133 7650 raft_consensus.cc:482] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:08:21.877192 7650 raft_consensus.cc:3037] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:21.877060 7258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3afc00591d1045639706af059ad47ec6" candidate_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bb3ff8a66384d13aeaa31875b446494" is_pre_election: true
I20260811 17:08:21.877429 7258 raft_consensus.cc:2454] T 3afc00591d1045639706af059ad47ec6 P 9bb3ff8a66384d13aeaa31875b446494 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7645a9ddc964ddc8748bcbe7180f4ab in term 0.
I20260811 17:08:21.878824 7650 raft_consensus.cc:504] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } }
I20260811 17:08:21.879225 7650 leader_election.cc:288] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab [CANDIDATE]: Term 1 election: Requested vote from peers 338736e3a7604b959e0b7195d6fb3b7c (127.4.146.193:34635), 9bb3ff8a66384d13aeaa31875b446494 (127.4.146.194:38813)
I20260811 17:08:21.879567 7002 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3afc00591d1045639706af059ad47ec6" candidate_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "338736e3a7604b959e0b7195d6fb3b7c"
I20260811 17:08:21.879578 7258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3afc00591d1045639706af059ad47ec6" candidate_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bb3ff8a66384d13aeaa31875b446494"
I20260811 17:08:21.879722 7258 raft_consensus.cc:3037] T 3afc00591d1045639706af059ad47ec6 P 9bb3ff8a66384d13aeaa31875b446494 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:21.879731 7002 raft_consensus.cc:3037] T 3afc00591d1045639706af059ad47ec6 P 338736e3a7604b959e0b7195d6fb3b7c [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:21.881098 7002 raft_consensus.cc:2454] T 3afc00591d1045639706af059ad47ec6 P 338736e3a7604b959e0b7195d6fb3b7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7645a9ddc964ddc8748bcbe7180f4ab in term 1.
I20260811 17:08:21.881400 7380 leader_election.cc:302] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338736e3a7604b959e0b7195d6fb3b7c, e7645a9ddc964ddc8748bcbe7180f4ab; no voters:
I20260811 17:08:21.881561 7650 raft_consensus.cc:2781] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:21.881726 7258 raft_consensus.cc:2454] T 3afc00591d1045639706af059ad47ec6 P 9bb3ff8a66384d13aeaa31875b446494 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7645a9ddc964ddc8748bcbe7180f4ab in term 1.
I20260811 17:08:21.881836 7650 raft_consensus.cc:686] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab [term 1 LEADER]: Becoming Leader. State: Replica: e7645a9ddc964ddc8748bcbe7180f4ab, State: Running, Role: LEADER
I20260811 17:08:21.882095 7650 consensus_queue.cc:237] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } }
I20260811 17:08:21.884667 6717 catalog_manager.cc:5495] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab reported cstate change: term changed from 0 to 1, leader changed from <none> to e7645a9ddc964ddc8748bcbe7180f4ab (127.4.146.195). New cstate: current_term: 1 leader_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } health_report { overall_health: HEALTHY } } }
Aug 11 17:08:21 dist-test-slave-7vjv krb5kdc[6638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468100, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:21.947822 7700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.938137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33275 (local address 127.0.0.1:41190)
0811 17:08:21.938658 (+ 521us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:21.938673 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:21.938785 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:21.939030 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:21.939032 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:21.939446 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:21.939539 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:21.939544 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.940547 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.940549 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:21.941279 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:21.941290 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.941791 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.941793 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:21.941861 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.942433 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:21.942445 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:21.944311 (+ 1866us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:21.946121 (+ 1810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:21.946133 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:21.946142 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:21.946390 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:21.946688 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:21.946691 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:21.946693 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:21.946780 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:21.947179 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:21.947187 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:21.947306 (+ 119us) client_negotiation.cc:769] Sending connection context
0811 17:08:21.947424 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 17:08:21.947617 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":179,"threads_started":1}
I20260811 17:08:21.947822 6811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:21.938190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41190 (local address 127.4.146.254:33275)
0811 17:08:21.938357 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:21.938373 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:21.938761 (+ 388us) server_negotiation.cc:407] Connection header received
0811 17:08:21.938870 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:21.938872 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:21.938916 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:21.938990 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:21.939700 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.940428 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.941416 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:21.941672 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:21.941776 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:21.944457 (+ 2681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:21.944465 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:21.944467 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:21.944490 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:21.945984 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:21.946493 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:21.946498 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:21.946500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:21.946587 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:21.946866 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:21.946871 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:21.946873 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:21.947059 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:21.947165 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:21.947484 (+ 319us) server_negotiation.cc:299] Negotiation successful
0811 17:08:21.947693 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":100,"server-negotiator.queue_time_us":61}
I20260811 17:08:21.952852 6717 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:41190:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 17:08:21.953781 6717 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:08:21.959187 6966 tablet_service.cc:1467] Processing CreateTablet for tablet c040db27a9fc40f086f23517a0920e70 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9858df460b414016b1fca13979af674c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 17:08:21.959635 6966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c040db27a9fc40f086f23517a0920e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:21.959610 7226 tablet_service.cc:1467] Processing CreateTablet for tablet c040db27a9fc40f086f23517a0920e70 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9858df460b414016b1fca13979af674c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 17:08:21.960059 7226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c040db27a9fc40f086f23517a0920e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:21.962664 7635 tablet_bootstrap.cc:492] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c: Bootstrap starting.
I20260811 17:08:21.963166 7463 tablet_service.cc:1467] Processing CreateTablet for tablet c040db27a9fc40f086f23517a0920e70 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9858df460b414016b1fca13979af674c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 17:08:21.963559 7463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c040db27a9fc40f086f23517a0920e70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:21.963791 7635 tablet_bootstrap.cc:654] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c: Neither blocks nor log segments found. Creating new log.
W20260811 17:08:21.965130 7345 tablet.cc:2369] T 3afc00591d1045639706af059ad47ec6 P 9bb3ff8a66384d13aeaa31875b446494: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 17:08:21.966764 7639 tablet_bootstrap.cc:492] T c040db27a9fc40f086f23517a0920e70 P e7645a9ddc964ddc8748bcbe7180f4ab: Bootstrap starting.
I20260811 17:08:21.966791 7641 tablet_bootstrap.cc:492] T c040db27a9fc40f086f23517a0920e70 P 9bb3ff8a66384d13aeaa31875b446494: Bootstrap starting.
I20260811 17:08:21.967747 7641 tablet_bootstrap.cc:654] T c040db27a9fc40f086f23517a0920e70 P 9bb3ff8a66384d13aeaa31875b446494: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:21.967993 7639 tablet_bootstrap.cc:654] T c040db27a9fc40f086f23517a0920e70 P e7645a9ddc964ddc8748bcbe7180f4ab: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:21.969002 7635 tablet_bootstrap.cc:492] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c: No bootstrap required, opened a new log
I20260811 17:08:21.969081 7635 ts_tablet_manager.cc:1397] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20260811 17:08:21.969650 7635 raft_consensus.cc:348] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } }
I20260811 17:08:21.969774 7635 raft_consensus.cc:374] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:21.969811 7635 raft_consensus.cc:729] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 338736e3a7604b959e0b7195d6fb3b7c, State: Initialized, Role: FOLLOWER
I20260811 17:08:21.970010 7635 consensus_queue.cc:260] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } }
I20260811 17:08:21.970186 7639 tablet_bootstrap.cc:492] T c040db27a9fc40f086f23517a0920e70 P e7645a9ddc964ddc8748bcbe7180f4ab: No bootstrap required, opened a new log
I20260811 17:08:21.970286 7639 ts_tablet_manager.cc:1397] T c040db27a9fc40f086f23517a0920e70 P e7645a9ddc964ddc8748bcbe7180f4ab: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s
I20260811 17:08:21.970378 7648 tablet_replica.cc:439] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } } }
I20260811 17:08:21.970542 7635 ts_tablet_manager.cc:1428] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 17:08:21.970614 7648 tablet_replica.cc:442] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 17:08:21.971112 7639 raft_consensus.cc:348] T c040db27a9fc40f086f23517a0920e70 P e7645a9ddc964ddc8748bcbe7180f4ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } }
I20260811 17:08:21.971275 7639 raft_consensus.cc:374] T c040db27a9fc40f086f23517a0920e70 P e7645a9ddc964ddc8748bcbe7180f4ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:21.971319 7639 raft_consensus.cc:729] T c040db27a9fc40f086f23517a0920e70 P e7645a9ddc964ddc8748bcbe7180f4ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7645a9ddc964ddc8748bcbe7180f4ab, State: Initialized, Role: FOLLOWER
I20260811 17:08:21.971465 7641 tablet_bootstrap.cc:492] T c040db27a9fc40f086f23517a0920e70 P 9bb3ff8a66384d13aeaa31875b446494: No bootstrap required, opened a new log
I20260811 17:08:21.971459 7639 consensus_queue.cc:260] T c040db27a9fc40f086f23517a0920e70 P e7645a9ddc964ddc8748bcbe7180f4ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } }
I20260811 17:08:21.971565 7641 ts_tablet_manager.cc:1397] T c040db27a9fc40f086f23517a0920e70 P 9bb3ff8a66384d13aeaa31875b446494: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260811 17:08:21.971702 7650 tablet_replica.cc:439] T c040db27a9fc40f086f23517a0920e70 P e7645a9ddc964ddc8748bcbe7180f4ab: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } } }
I20260811 17:08:21.971825 7650 tablet_replica.cc:442] T c040db27a9fc40f086f23517a0920e70 P e7645a9ddc964ddc8748bcbe7180f4ab: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 17:08:21.972064 7641 raft_consensus.cc:348] T c040db27a9fc40f086f23517a0920e70 P 9bb3ff8a66384d13aeaa31875b446494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } }
I20260811 17:08:21.972226 7641 raft_consensus.cc:374] T c040db27a9fc40f086f23517a0920e70 P 9bb3ff8a66384d13aeaa31875b446494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:21.972263 7641 raft_consensus.cc:729] T c040db27a9fc40f086f23517a0920e70 P 9bb3ff8a66384d13aeaa31875b446494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bb3ff8a66384d13aeaa31875b446494, State: Initialized, Role: FOLLOWER
I20260811 17:08:21.972385 7641 consensus_queue.cc:260] T c040db27a9fc40f086f23517a0920e70 P 9bb3ff8a66384d13aeaa31875b446494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } }
I20260811 17:08:21.972649 7641 ts_tablet_manager.cc:1428] T c040db27a9fc40f086f23517a0920e70 P 9bb3ff8a66384d13aeaa31875b446494: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 17:08:21.972751 7639 ts_tablet_manager.cc:1428] T c040db27a9fc40f086f23517a0920e70 P e7645a9ddc964ddc8748bcbe7180f4ab: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260811 17:08:21.972867 7656 tablet_replica.cc:439] T c040db27a9fc40f086f23517a0920e70 P 9bb3ff8a66384d13aeaa31875b446494: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } } }
I20260811 17:08:21.972996 7656 tablet_replica.cc:442] T c040db27a9fc40f086f23517a0920e70 P 9bb3ff8a66384d13aeaa31875b446494: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 17:08:22.083690 7648 raft_consensus.cc:482] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:08:22.083875 7648 raft_consensus.cc:504] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } }
I20260811 17:08:22.085250 7648 leader_election.cc:288] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9bb3ff8a66384d13aeaa31875b446494 (127.4.146.194:38813), e7645a9ddc964ddc8748bcbe7180f4ab (127.4.146.195:39089)
I20260811 17:08:22.090967 7632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:22.085789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:39153 (local address 127.4.146.195:39089)
0811 17:08:22.085943 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:22.085949 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:22.086339 (+ 390us) server_negotiation.cc:407] Connection header received
0811 17:08:22.086513 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:22.086516 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:22.086563 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:22.086676 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:22.087164 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.087799 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.089821 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.090320 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.090453 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:22.090514 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:22.090761 (+ 247us) server_negotiation.cc:299] Negotiation successful
0811 17:08:22.090837 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 17:08:22.091156 7629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:22.085910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:54697 (local address 127.4.146.194:38813)
0811 17:08:22.086030 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:22.086035 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:22.086294 (+ 259us) server_negotiation.cc:407] Connection header received
0811 17:08:22.086477 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:22.086481 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:22.086537 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:22.086602 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:22.087111 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.087711 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.089791 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.090402 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.090548 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:22.090653 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:22.090939 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 17:08:22.091018 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 17:08:22.091220 7711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:22.085632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:38813 (local address 127.4.146.193:54697)
0811 17:08:22.086158 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:22.086173 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:22.086339 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:22.086649 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:22.086653 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:22.086675 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:22.086972 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:22.086981 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.087842 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.087845 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:22.089625 (+ 1780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:22.089638 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.090667 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.090674 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:22.090802 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:22.090822 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 17:08:22.090920 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 17:08:22.090998 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"mutex_wait_us":106,"thread_start_us":159,"threads_started":1}
I20260811 17:08:22.091030 7705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:22.085696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:39089 (local address 127.4.146.193:39153)
0811 17:08:22.086187 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:22.086200 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:22.086355 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:22.086715 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:22.086718 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:22.086734 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:22.087013 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:22.087020 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.088065 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.088068 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:22.089641 (+ 1573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:22.089648 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.090449 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.090453 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:22.090625 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:22.090645 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 17:08:22.090741 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 17:08:22.090822 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":424,"mutex_wait_us":59,"thread_start_us":140,"threads_started":1}
I20260811 17:08:22.091744 7258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c040db27a9fc40f086f23517a0920e70" candidate_uuid: "338736e3a7604b959e0b7195d6fb3b7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bb3ff8a66384d13aeaa31875b446494" is_pre_election: true
I20260811 17:08:22.091933 7258 raft_consensus.cc:2454] T c040db27a9fc40f086f23517a0920e70 P 9bb3ff8a66384d13aeaa31875b446494 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338736e3a7604b959e0b7195d6fb3b7c in term 0.
I20260811 17:08:22.091997 7507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c040db27a9fc40f086f23517a0920e70" candidate_uuid: "338736e3a7604b959e0b7195d6fb3b7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" is_pre_election: true
I20260811 17:08:22.092201 7507 raft_consensus.cc:2454] T c040db27a9fc40f086f23517a0920e70 P e7645a9ddc964ddc8748bcbe7180f4ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 338736e3a7604b959e0b7195d6fb3b7c in term 0.
I20260811 17:08:22.092437 6882 leader_election.cc:302] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338736e3a7604b959e0b7195d6fb3b7c, 9bb3ff8a66384d13aeaa31875b446494; no voters:
I20260811 17:08:22.092751 7648 raft_consensus.cc:2781] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:08:22.092818 7648 raft_consensus.cc:482] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:08:22.092856 7648 raft_consensus.cc:3037] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:22.095098 7648 raft_consensus.cc:504] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } }
I20260811 17:08:22.095757 7648 leader_election.cc:288] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c [CANDIDATE]: Term 1 election: Requested vote from peers 9bb3ff8a66384d13aeaa31875b446494 (127.4.146.194:38813), e7645a9ddc964ddc8748bcbe7180f4ab (127.4.146.195:39089)
I20260811 17:08:22.096282 7258 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c040db27a9fc40f086f23517a0920e70" candidate_uuid: "338736e3a7604b959e0b7195d6fb3b7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9bb3ff8a66384d13aeaa31875b446494"
I20260811 17:08:22.096321 7507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c040db27a9fc40f086f23517a0920e70" candidate_uuid: "338736e3a7604b959e0b7195d6fb3b7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab"
I20260811 17:08:22.096446 7507 raft_consensus.cc:3037] T c040db27a9fc40f086f23517a0920e70 P e7645a9ddc964ddc8748bcbe7180f4ab [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:22.096446 7258 raft_consensus.cc:3037] T c040db27a9fc40f086f23517a0920e70 P 9bb3ff8a66384d13aeaa31875b446494 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:22.097903 7258 raft_consensus.cc:2454] T c040db27a9fc40f086f23517a0920e70 P 9bb3ff8a66384d13aeaa31875b446494 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338736e3a7604b959e0b7195d6fb3b7c in term 1.
I20260811 17:08:22.097903 7507 raft_consensus.cc:2454] T c040db27a9fc40f086f23517a0920e70 P e7645a9ddc964ddc8748bcbe7180f4ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 338736e3a7604b959e0b7195d6fb3b7c in term 1.
I20260811 17:08:22.098309 6877 leader_election.cc:302] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 338736e3a7604b959e0b7195d6fb3b7c, e7645a9ddc964ddc8748bcbe7180f4ab; no voters:
I20260811 17:08:22.098565 7648 raft_consensus.cc:2781] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:22.098878 7648 raft_consensus.cc:686] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c [term 1 LEADER]: Becoming Leader. State: Replica: 338736e3a7604b959e0b7195d6fb3b7c, State: Running, Role: LEADER
I20260811 17:08:22.099191 7648 consensus_queue.cc:237] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } }
I20260811 17:08:22.100616 7712 tablet_replica.cc:439] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c: TxnStatusTablet state changed. Reason: New leader 338736e3a7604b959e0b7195d6fb3b7c. Latest consensus state: current_term: 1 leader_uuid: "338736e3a7604b959e0b7195d6fb3b7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } } }
I20260811 17:08:22.100781 7712 tablet_replica.cc:442] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c: This TxnStatusTablet replica's current role is: LEADER
I20260811 17:08:22.101266 7715 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 17:08:22.101468 7715 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 17:08:22.102013 6716 catalog_manager.cc:5495] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 338736e3a7604b959e0b7195d6fb3b7c (127.4.146.193). New cstate: current_term: 1 leader_uuid: "338736e3a7604b959e0b7195d6fb3b7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } health_report { overall_health: UNKNOWN } } }
I20260811 17:08:22.129760 7634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:22.125219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44628 (local address 127.4.146.193:34635)
0811 17:08:22.125372 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:22.125376 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:22.125394 (+ 18us) server_negotiation.cc:407] Connection header received
0811 17:08:22.125569 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:22.125572 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:22.125646 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:22.125760 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:08:22.126027 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.126957 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.128027 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.128341 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.128464 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:22.128824 (+ 360us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:08:22.129311 (+ 487us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:08:22.129452 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:22.129539 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 17:08:22.129603 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 17:08:22.129760 7700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:22.125042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:34635 (local address 127.0.0.1:44628)
0811 17:08:22.125221 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:22.125241 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:22.125398 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:22.125794 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:22.125796 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:22.125804 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 17:08:22.125908 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:22.125913 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.127084 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.127087 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:22.127880 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:22.127891 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.128473 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.128477 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:22.128582 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:22.128647 (+ 65us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 17:08:22.129424 (+ 777us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 17:08:22.129447 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 17:08:22.129518 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 17:08:22.129616 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 17:08:22.133520 7507 raft_consensus.cc:1261] T c040db27a9fc40f086f23517a0920e70 P e7645a9ddc964ddc8748bcbe7180f4ab [term 1 FOLLOWER]: Refusing update from remote peer 338736e3a7604b959e0b7195d6fb3b7c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:08:22.133738 7258 raft_consensus.cc:1261] T c040db27a9fc40f086f23517a0920e70 P 9bb3ff8a66384d13aeaa31875b446494 [term 1 FOLLOWER]: Refusing update from remote peer 338736e3a7604b959e0b7195d6fb3b7c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:08:22.134343 7648 consensus_queue.cc:1035] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:08:22.134627 7712 consensus_queue.cc:1035] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:08:22.136647 7650 tablet_replica.cc:439] T c040db27a9fc40f086f23517a0920e70 P e7645a9ddc964ddc8748bcbe7180f4ab: TxnStatusTablet state changed. Reason: New leader 338736e3a7604b959e0b7195d6fb3b7c. Latest consensus state: current_term: 1 leader_uuid: "338736e3a7604b959e0b7195d6fb3b7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } } }
I20260811 17:08:22.136796 7650 tablet_replica.cc:442] T c040db27a9fc40f086f23517a0920e70 P e7645a9ddc964ddc8748bcbe7180f4ab: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 17:08:22.136914 7656 tablet_replica.cc:439] T c040db27a9fc40f086f23517a0920e70 P 9bb3ff8a66384d13aeaa31875b446494: TxnStatusTablet state changed. Reason: New leader 338736e3a7604b959e0b7195d6fb3b7c. Latest consensus state: current_term: 1 leader_uuid: "338736e3a7604b959e0b7195d6fb3b7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } } }
I20260811 17:08:22.137070 7656 tablet_replica.cc:442] T c040db27a9fc40f086f23517a0920e70 P 9bb3ff8a66384d13aeaa31875b446494: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 17:08:22.139796 7648 tablet_replica.cc:439] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "338736e3a7604b959e0b7195d6fb3b7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } } }
I20260811 17:08:22.139957 7648 tablet_replica.cc:442] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c: This TxnStatusTablet replica's current role is: LEADER
I20260811 17:08:22.140947 7659 mvcc.cc:205] Tried to move back new op lower bound from 7317373346332340224 to 7317373346200883200. Current Snapshot: MvccSnapshot[applied={T|T < 7317373346332340224 or (T in {7317373346332340224})}]
I20260811 17:08:22.144445 7650 tablet_replica.cc:439] T c040db27a9fc40f086f23517a0920e70 P e7645a9ddc964ddc8748bcbe7180f4ab: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "338736e3a7604b959e0b7195d6fb3b7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } } }
I20260811 17:08:22.144593 7650 tablet_replica.cc:442] T c040db27a9fc40f086f23517a0920e70 P e7645a9ddc964ddc8748bcbe7180f4ab: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 17:08:22.145367 7656 tablet_replica.cc:439] T c040db27a9fc40f086f23517a0920e70 P 9bb3ff8a66384d13aeaa31875b446494: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "338736e3a7604b959e0b7195d6fb3b7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } } }
I20260811 17:08:22.145531 7656 tablet_replica.cc:442] T c040db27a9fc40f086f23517a0920e70 P 9bb3ff8a66384d13aeaa31875b446494: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 17:08:22.146011 7648 tablet_replica.cc:439] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "338736e3a7604b959e0b7195d6fb3b7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 } } peers { permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 } } peers { permanent_uuid: "e7645a9ddc964ddc8748bcbe7180f4ab" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39089 } } }
I20260811 17:08:22.146133 7648 tablet_replica.cc:442] T c040db27a9fc40f086f23517a0920e70 P 338736e3a7604b959e0b7195d6fb3b7c: This TxnStatusTablet replica's current role is: LEADER
I20260811 17:08:22.151598 7632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:22.147035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34094 (local address 127.4.146.195:39089)
0811 17:08:22.147162 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:22.147168 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:22.147183 (+ 15us) server_negotiation.cc:407] Connection header received
0811 17:08:22.147420 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:22.147424 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:22.147500 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:22.147622 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:08:22.147902 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.148718 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.149588 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.150024 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.150139 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:22.150427 (+ 288us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:08:22.151123 (+ 696us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:08:22.151249 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:22.151318 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 17:08:22.151408 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 17:08:22.166654 7727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:22.161342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:34635 (local address 127.4.146.195:49167)
0811 17:08:22.161957 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:22.161982 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:22.162104 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:22.162400 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:22.162403 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:22.162410 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 17:08:22.162586 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:22.162591 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.163690 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.163694 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:22.164848 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:22.164864 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.165550 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.165553 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:22.165720 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:22.165789 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 17:08:22.166229 (+ 440us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 17:08:22.166238 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 17:08:22.166402 (+ 164us) client_negotiation.cc:240] Negotiation successful
0811 17:08:22.166485 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":185,"threads_started":1}
I20260811 17:08:22.166653 7634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:22.161512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:49167 (local address 127.4.146.193:34635)
0811 17:08:22.161677 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:22.161682 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:22.162075 (+ 393us) server_negotiation.cc:407] Connection header received
0811 17:08:22.162217 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:22.162220 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:22.162282 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:22.162377 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:08:22.162718 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.163533 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.164993 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.165353 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.165471 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:22.165978 (+ 507us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:08:22.166086 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:08:22.166174 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:22.166435 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 17:08:22.166509 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 17:08:22.175994 7258 raft_consensus.cc:1261] T 3afc00591d1045639706af059ad47ec6 P 9bb3ff8a66384d13aeaa31875b446494 [term 1 FOLLOWER]: Refusing update from remote peer e7645a9ddc964ddc8748bcbe7180f4ab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:08:22.176286 7002 raft_consensus.cc:1261] T 3afc00591d1045639706af059ad47ec6 P 338736e3a7604b959e0b7195d6fb3b7c [term 1 FOLLOWER]: Refusing update from remote peer e7645a9ddc964ddc8748bcbe7180f4ab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:08:22.176828 7691 consensus_queue.cc:1035] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "9bb3ff8a66384d13aeaa31875b446494" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:08:22.177074 7650 consensus_queue.cc:1035] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "338736e3a7604b959e0b7195d6fb3b7c" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:08:22.208326 7632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:22.201835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:37503 (local address 127.4.146.195:39089)
0811 17:08:22.201998 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:22.202003 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:22.202598 (+ 595us) server_negotiation.cc:407] Connection header received
0811 17:08:22.202821 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:22.202824 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:22.202883 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:22.202965 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:08:22.203606 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.204397 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.206617 (+ 2220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.206976 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.207054 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:22.207704 (+ 650us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:08:22.207789 (+ 85us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:08:22.207865 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:22.208067 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 17:08:22.208213 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 17:08:22.208361 7732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:22.201759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:39089 (local address 127.4.146.193:37503)
0811 17:08:22.202437 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:22.202456 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:22.202687 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:22.203126 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:22.203129 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:22.203139 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 17:08:22.203427 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:22.203436 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.204618 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.204622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:22.206444 (+ 1822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:22.206459 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.207358 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.207363 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:22.207475 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:22.207538 (+ 63us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 17:08:22.207959 (+ 421us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 17:08:22.207967 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 17:08:22.208047 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 17:08:22.208176 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":248,"threads_started":1}
I20260811 17:08:22.247915 6717 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41178:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:08:22.248198 6717 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41178:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:08:22.251554 6717 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a3a9c007eca349dd9425e8553e81fd7d: Sending DeleteTablet for 3 replicas of tablet 3afc00591d1045639706af059ad47ec6
I20260811 17:08:22.252633 6966 tablet_service.cc:1514] Processing DeleteTablet for tablet 3afc00591d1045639706af059ad47ec6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:22 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:44620
I20260811 17:08:22.252714 7226 tablet_service.cc:1514] Processing DeleteTablet for tablet 3afc00591d1045639706af059ad47ec6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:22 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:50766
I20260811 17:08:22.253111 7684 tablet_replica.cc:330] T 3afc00591d1045639706af059ad47ec6 P 338736e3a7604b959e0b7195d6fb3b7c: stopping tablet replica
I20260811 17:08:22.253283 7684 raft_consensus.cc:2229] T 3afc00591d1045639706af059ad47ec6 P 338736e3a7604b959e0b7195d6fb3b7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:08:22.253383 7463 tablet_service.cc:1514] Processing DeleteTablet for tablet 3afc00591d1045639706af059ad47ec6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:22 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:34082
I20260811 17:08:22.253463 7684 raft_consensus.cc:2258] T 3afc00591d1045639706af059ad47ec6 P 338736e3a7604b959e0b7195d6fb3b7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:22.253593 7683 tablet_replica.cc:330] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab: stopping tablet replica
I20260811 17:08:22.253738 7683 raft_consensus.cc:2229] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab [term 1 LEADER]: Raft consensus shutting down.
I20260811 17:08:22.254194 7683 raft_consensus.cc:2258] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:22.255384 7683 ts_tablet_manager.cc:1905] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:22.256251 7684 ts_tablet_manager.cc:1905] T 3afc00591d1045639706af059ad47ec6 P 338736e3a7604b959e0b7195d6fb3b7c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:22.259824 7683 ts_tablet_manager.cc:1918] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 17:08:22.260063 7683 log.cc:1196] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/3afc00591d1045639706af059ad47ec6
I20260811 17:08:22.260326 7684 ts_tablet_manager.cc:1918] T 3afc00591d1045639706af059ad47ec6 P 338736e3a7604b959e0b7195d6fb3b7c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 17:08:22.260457 7684 log.cc:1196] T 3afc00591d1045639706af059ad47ec6 P 338736e3a7604b959e0b7195d6fb3b7c: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-0/wal/wals/3afc00591d1045639706af059ad47ec6
I20260811 17:08:22.260777 7683 ts_tablet_manager.cc:1939] T 3afc00591d1045639706af059ad47ec6 P e7645a9ddc964ddc8748bcbe7180f4ab: Deleting consensus metadata
I20260811 17:08:22.261015 7684 ts_tablet_manager.cc:1939] T 3afc00591d1045639706af059ad47ec6 P 338736e3a7604b959e0b7195d6fb3b7c: Deleting consensus metadata
I20260811 17:08:22.262187 6690 catalog_manager.cc:4841] TS e7645a9ddc964ddc8748bcbe7180f4ab (127.4.146.195:39089): tablet 3afc00591d1045639706af059ad47ec6 (table test-table [id=734ffc6a3d244d6aa58042842947840d]) successfully deleted
I20260811 17:08:22.262449 6690 catalog_manager.cc:4841] TS 338736e3a7604b959e0b7195d6fb3b7c (127.4.146.193:34635): tablet 3afc00591d1045639706af059ad47ec6 (table test-table [id=734ffc6a3d244d6aa58042842947840d]) successfully deleted
I20260811 17:08:22.263011 7735 tablet_replica.cc:330] T 3afc00591d1045639706af059ad47ec6 P 9bb3ff8a66384d13aeaa31875b446494: stopping tablet replica
I20260811 17:08:22.263209 7735 raft_consensus.cc:2229] T 3afc00591d1045639706af059ad47ec6 P 9bb3ff8a66384d13aeaa31875b446494 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:08:22.263401 7735 raft_consensus.cc:2258] T 3afc00591d1045639706af059ad47ec6 P 9bb3ff8a66384d13aeaa31875b446494 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:22.264511 7735 ts_tablet_manager.cc:1905] T 3afc00591d1045639706af059ad47ec6 P 9bb3ff8a66384d13aeaa31875b446494: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:22.268893 7735 ts_tablet_manager.cc:1918] T 3afc00591d1045639706af059ad47ec6 P 9bb3ff8a66384d13aeaa31875b446494: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 17:08:22.269106 7735 log.cc:1196] T 3afc00591d1045639706af059ad47ec6 P 9bb3ff8a66384d13aeaa31875b446494: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786468091870818-4683-0/minicluster-data/ts-1/wal/wals/3afc00591d1045639706af059ad47ec6
I20260811 17:08:22.269557 7735 ts_tablet_manager.cc:1939] T 3afc00591d1045639706af059ad47ec6 P 9bb3ff8a66384d13aeaa31875b446494: Deleting consensus metadata
I20260811 17:08:22.270681 6693 catalog_manager.cc:4841] TS 9bb3ff8a66384d13aeaa31875b446494 (127.4.146.194:38813): tablet 3afc00591d1045639706af059ad47ec6 (table test-table [id=734ffc6a3d244d6aa58042842947840d]) successfully deleted
Aug 11 17:08:22 dist-test-slave-7vjv krb5kdc[6638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468101, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.146.193@KRBTEST.COM
I20260811 17:08:22.285561 7634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:22.262706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44642 (local address 127.4.146.193:34635)
0811 17:08:22.262882 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:22.262887 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:22.268765 (+ 5878us) server_negotiation.cc:407] Connection header received
0811 17:08:22.268990 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:22.268993 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:22.269059 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:22.269113 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:22.271008 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.271967 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.273895 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.274336 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.274488 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:22.280182 (+ 5694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:22.280194 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:22.280215 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:22.280258 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:22.282803 (+ 2545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:22.283555 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:22.283562 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:22.283564 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:22.283768 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:22.284249 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:22.284253 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:22.284256 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:22.284648 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:22.284902 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:22.285175 (+ 273us) server_negotiation.cc:299] Negotiation successful
0811 17:08:22.285329 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
W20260811 17:08:22.286795 7064 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44642
I20260811 17:08:22.300663 6811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:22.289256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41204 (local address 127.4.146.254:33275)
0811 17:08:22.289399 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:22.289404 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:22.289421 (+ 17us) server_negotiation.cc:407] Connection header received
0811 17:08:22.289573 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:22.289576 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:22.289633 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:22.289765 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:22.290685 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.291562 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.293012 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:22.293446 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:22.293611 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:22.295740 (+ 2129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:22.295744 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:22.295748 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:22.295783 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:22.298209 (+ 2426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:22.298871 (+ 662us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:22.298875 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:22.298877 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:22.298985 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:22.299366 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:22.299370 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:22.299372 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:22.299691 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:22.299829 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:22.300321 (+ 492us) server_negotiation.cc:299] Negotiation successful
0811 17:08:22.300466 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260811 17:08:22.301544 6717 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41204
I20260811 17:08:22.303705 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 6852
I20260811 17:08:22.325843 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 7089
I20260811 17:08:22.349846 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 7359
I20260811 17:08:22.362836 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 6658
2026-08-11T17:08:22Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3408 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:08:22 dist-test-slave-7vjv krb5kdc[7754](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:08:22 dist-test-slave-7vjv krb5kdc[7754](info): set up 2 sockets
Aug 11 17:08:22 dist-test-slave-7vjv krb5kdc[7754](info): commencing operation
krb5kdc: starting...
W20260811 17:08:23.717201 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.313s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:08:23 dist-test-slave-7vjv krb5kdc[7754](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468103, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:08:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:08:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:08:23.851468 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:33671
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:42145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:33671
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:23.971854 7784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:23.972303 7784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:23.972391 7784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:23.976936 7784 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:08:23.977042 7784 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 17:08:23.977075 7784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:23.977121 7784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:23.977181 7784 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:08:23.977221 7784 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:08:23.983258 7784 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:42145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:33671
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:33671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7784
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:23.984611 7784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:23.985719 7784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:23.995955 7793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:23.995954 7795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:23.995961 7800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:23.996604 7784 server_base.cc:1034] running on GCE node
I20260811 17:08:23.997304 7784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:23.998554 7784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:23.999801 7784 hybrid_clock.cc:648] HybridClock initialized: now 1786468103999769 us; error 54 us; skew 500 ppm
Aug 11 17:08:24 dist-test-slave-7vjv krb5kdc[7754](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468104, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:24.008499 7784 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:08:24.009696 7784 webserver.cc:460] Webserver started at http://127.4.146.254:40513/ using document root <none> and password file <none>
I20260811 17:08:24.010334 7784 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:24.010404 7784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:24.010597 7784 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:24.012987 7784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "5bc64f4d4b8249b8ae14213409f2635c"
format_stamp: "Formatted at 2026-08-11 17:08:24 on dist-test-slave-7vjv"
server_key: "fdac782e29c41484fd70219e5d9ace12"
server_key_iv: "7eceafa2a055e7893ef5eb057ff7b10c"
server_key_version: "encryptionkey@0"
I20260811 17:08:24.013586 7784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "5bc64f4d4b8249b8ae14213409f2635c"
format_stamp: "Formatted at 2026-08-11 17:08:24 on dist-test-slave-7vjv"
server_key: "fdac782e29c41484fd70219e5d9ace12"
server_key_iv: "7eceafa2a055e7893ef5eb057ff7b10c"
server_key_version: "encryptionkey@0"
I20260811 17:08:24.017951 7784 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 17:08:24.020895 7812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:24.022704 7784 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:08:24.022868 7784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "5bc64f4d4b8249b8ae14213409f2635c"
format_stamp: "Formatted at 2026-08-11 17:08:24 on dist-test-slave-7vjv"
server_key: "fdac782e29c41484fd70219e5d9ace12"
server_key_iv: "7eceafa2a055e7893ef5eb057ff7b10c"
server_key_version: "encryptionkey@0"
I20260811 17:08:24.023003 7784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:24.035194 7784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:24.039189 7784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:24.039387 7784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:24.049377 7784 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:33671
I20260811 17:08:24.049515 7920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:33671 every 8 connection(s)
I20260811 17:08:24.050496 7784 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:08:24.053886 7921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:24.059952 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 7784
I20260811 17:08:24.060123 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:08:24.060331 7921 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c: Bootstrap starting.
I20260811 17:08:24.060442 4683 external_mini_cluster.cc:1428] Setting key d786520403ee3eaed75a0bb477b0e438
I20260811 17:08:24.063138 7921 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:24.064033 7921 log.cc:824] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:24.066299 7921 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c: No bootstrap required, opened a new log
Aug 11 17:08:24 dist-test-slave-7vjv krb5kdc[7754](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468103, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:24.071064 7921 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bc64f4d4b8249b8ae14213409f2635c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33671 } }
I20260811 17:08:24.071369 7921 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:24.071437 7921 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bc64f4d4b8249b8ae14213409f2635c, State: Initialized, Role: FOLLOWER
I20260811 17:08:24.071935 7921 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bc64f4d4b8249b8ae14213409f2635c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33671 } }
I20260811 17:08:24.072104 7921 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:08:24.072206 7921 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:08:24.072341 7921 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:24.073341 7921 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bc64f4d4b8249b8ae14213409f2635c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33671 } }
I20260811 17:08:24.073730 7921 leader_election.cc:302] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5bc64f4d4b8249b8ae14213409f2635c; no voters:
I20260811 17:08:24.074134 7921 leader_election.cc:288] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:08:24.074237 7933 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:24.074421 7933 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c [term 1 LEADER]: Becoming Leader. State: Replica: 5bc64f4d4b8249b8ae14213409f2635c, State: Running, Role: LEADER
I20260811 17:08:24.074729 7933 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bc64f4d4b8249b8ae14213409f2635c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33671 } }
I20260811 17:08:24.075557 7921 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:08:24.076020 7935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5bc64f4d4b8249b8ae14213409f2635c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bc64f4d4b8249b8ae14213409f2635c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33671 } } }
I20260811 17:08:24.076067 7937 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5bc64f4d4b8249b8ae14213409f2635c. Latest consensus state: current_term: 1 leader_uuid: "5bc64f4d4b8249b8ae14213409f2635c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5bc64f4d4b8249b8ae14213409f2635c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33671 } } }
I20260811 17:08:24.076197 7935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:24.076220 7937 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:24.076642 7941 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:08:24.077787 7927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:24.061911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35346 (local address 127.4.146.254:33671)
0811 17:08:24.062406 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:24.062426 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:24.062464 (+ 38us) server_negotiation.cc:407] Connection header received
0811 17:08:24.063145 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:24.063165 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:24.063579 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:24.063873 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:24.064888 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.065940 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.067171 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.067660 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.067795 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:24.070992 (+ 3197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:24.070999 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:24.071016 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:24.071051 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:24.073240 (+ 2189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:24.073873 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:24.073883 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:24.073890 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:24.074051 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:24.074422 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:24.074425 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:24.074439 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:24.075046 (+ 607us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:24.075284 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:24.076357 (+ 1073us) server_negotiation.cc:299] Negotiation successful
0811 17:08:24.076726 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":170,"threads_started":1}
I20260811 17:08:24.080257 7941 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:08:24.086910 7941 catalog_manager.cc:1347] Generated new cluster ID: 48515f85dcf94d1ca52fd34f396548f6
I20260811 17:08:24.087009 7941 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:08:24.096850 7941 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:08:24.097935 7941 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:08:24.112645 7941 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c: Generated new TSK 0
I20260811 17:08:24.113603 7941 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
I20260811 17:08:24.157415 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:33671
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:42145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:24.299485 7967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:24.299831 7967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:24.299885 7967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:24.304082 7967 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:24.304224 7967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:24.304267 7967 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 17:08:24.304282 7967 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 17:08:24.304317 7967 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:08:24.309998 7967 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:42145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.146.254:33671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7967
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:24.311092 7967 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:24.312153 7967 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:24.322073 7975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:24.322073 7976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:24.322103 7989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:24.322355 7967 server_base.cc:1034] running on GCE node
I20260811 17:08:24.322891 7967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:24.323617 7967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:24.324811 7967 hybrid_clock.cc:648] HybridClock initialized: now 1786468104324793 us; error 30 us; skew 500 ppm
Aug 11 17:08:24 dist-test-slave-7vjv krb5kdc[7754](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468104, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:24.327986 7967 init.cc:377] Logged in from keytab as kudu/127.4.146.193@KRBTEST.COM (short username kudu)
I20260811 17:08:24.329109 7967 webserver.cc:460] Webserver started at http://127.4.146.193:45525/ using document root <none> and password file <none>
I20260811 17:08:24.329726 7967 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:24.329828 7967 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:24.330088 7967 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:24.332437 7967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "75a9e5d1ffbb4491b91fb0620097ebbc"
format_stamp: "Formatted at 2026-08-11 17:08:24 on dist-test-slave-7vjv"
server_key: "ec3894815a8caf7de51b07cd0fcbf22e"
server_key_iv: "cf4dd0d2455c117066dd6c0842d912d5"
server_key_version: "encryptionkey@0"
I20260811 17:08:24.333076 7967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "75a9e5d1ffbb4491b91fb0620097ebbc"
format_stamp: "Formatted at 2026-08-11 17:08:24 on dist-test-slave-7vjv"
server_key: "ec3894815a8caf7de51b07cd0fcbf22e"
server_key_iv: "cf4dd0d2455c117066dd6c0842d912d5"
server_key_version: "encryptionkey@0"
I20260811 17:08:24.338810 7967 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 17:08:24.342793 7998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:24.344370 7967 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:08:24.344556 7967 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "75a9e5d1ffbb4491b91fb0620097ebbc"
format_stamp: "Formatted at 2026-08-11 17:08:24 on dist-test-slave-7vjv"
server_key: "ec3894815a8caf7de51b07cd0fcbf22e"
server_key_iv: "cf4dd0d2455c117066dd6c0842d912d5"
server_key_version: "encryptionkey@0"
I20260811 17:08:24.344707 7967 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:24.366703 7967 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:24.370704 7967 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:24.370954 7967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:24.372730 7967 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:24.372813 7967 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:24.372887 7967 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:24.372946 7967 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:24.383920 7967 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:41559
I20260811 17:08:24.383978 8213 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:41559 every 8 connection(s)
Aug 11 17:08:24 dist-test-slave-7vjv krb5kdc[7754](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468104, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:24.385236 7967 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:08:24.386895 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 7967
I20260811 17:08:24.387036 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
I20260811 17:08:24.387321 4683 external_mini_cluster.cc:1428] Setting key c612beab70a68557cf312de725e1d804
I20260811 17:08:24.389285 7927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:24.373512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:54221 (local address 127.4.146.254:33671)
0811 17:08:24.373653 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:24.373657 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:24.375438 (+ 1781us) server_negotiation.cc:407] Connection header received
0811 17:08:24.376861 (+ 1423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:24.376865 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:24.376932 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:24.377010 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:24.378913 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.379842 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.381407 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.381810 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.381954 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:24.385197 (+ 3243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:24.385204 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:24.385211 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:24.385247 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:24.386942 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:24.387569 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:24.387572 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:24.387574 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:24.387668 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:24.388062 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:24.388065 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:24.388067 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:24.388317 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:24.388433 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:24.388962 (+ 529us) server_negotiation.cc:299] Negotiation successful
0811 17:08:24.389109 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 17:08:24.390100 8022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:24.374698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33671 (local address 127.4.146.193:54221)
0811 17:08:24.375271 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:24.375319 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:24.376595 (+ 1276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:24.377261 (+ 666us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:24.377270 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:24.377932 (+ 662us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:24.378706 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:24.378732 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.380020 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.380024 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:24.381266 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:24.381277 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.381993 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.381999 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:24.382238 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:24.383046 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:24.383065 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:24.384987 (+ 1922us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:24.387124 (+ 2137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:24.387131 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:24.387152 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:24.387449 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:24.387766 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:24.387769 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:24.387771 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:24.387938 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:24.388433 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:24.388442 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:24.388706 (+ 264us) client_negotiation.cc:769] Sending connection context
0811 17:08:24.388900 (+ 194us) client_negotiation.cc:240] Negotiation successful
0811 17:08:24.389249 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":136,"threads_started":1}
I20260811 17:08:24.391852 8214 heartbeater.cc:347] Connected to a master server at 127.4.146.254:33671
I20260811 17:08:24.392050 8214 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:24.392609 8214 heartbeater.cc:511] Master 127.4.146.254:33671 requested a full tablet report, sending...
I20260811 17:08:24.394446 7845 ts_manager.cc:194] Registered new tserver with Master: 75a9e5d1ffbb4491b91fb0620097ebbc (127.4.146.193:41559)
I20260811 17:08:24.396054 7845 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.193@KRBTEST.COM'} at 127.4.146.193:54221
WARNING: no policy specified for kudu/127.4.146.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.194@KRBTEST.COM" created.
I20260811 17:08:24.404646 8224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:24.394319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33671 (local address 127.4.146.193:46391)
0811 17:08:24.394846 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:24.394861 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:24.394964 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:24.395255 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:24.395259 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:24.395498 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:24.395629 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:24.395636 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.396853 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.396856 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:24.398777 (+ 1921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:24.398787 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.399473 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.399477 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:24.399567 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:24.400353 (+ 786us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:24.400367 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:24.400836 (+ 469us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:24.402797 (+ 1961us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:24.402800 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:24.402803 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:24.403114 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:24.403425 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:24.403431 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:24.403436 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:24.403541 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:24.404142 (+ 601us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:24.404145 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:24.404250 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 17:08:24.404342 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 17:08:24.404477 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":297,"threads_started":1}
I20260811 17:08:24.404860 7927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:24.394427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:46391 (local address 127.4.146.254:33671)
0811 17:08:24.394560 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:24.394566 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:24.394947 (+ 381us) server_negotiation.cc:407] Connection header received
0811 17:08:24.395049 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:24.395055 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:24.395113 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:24.395211 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:24.395771 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.396694 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.398925 (+ 2231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.399306 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.399432 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:24.401004 (+ 1572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:24.401007 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:24.401009 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:24.401036 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:24.402618 (+ 1582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:24.403216 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:24.403219 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:24.403220 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:24.403303 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:24.403667 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:24.403674 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:24.403678 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:24.403956 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:24.404067 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:24.404447 (+ 380us) server_negotiation.cc:299] Negotiation successful
0811 17:08:24.404597 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":39}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
I20260811 17:08:24.424747 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:33671
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:42145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:24.554986 8226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:24.555299 8226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:24.555353 8226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:24.559474 8226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:24.559557 8226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:24.559600 8226 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 17:08:24.559614 8226 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 17:08:24.559649 8226 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:08:24.565349 8226 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:42145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.146.254:33671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:24.566485 8226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:24.567546 8226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:24.578356 8245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:24.578356 8241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:24.578351 8240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:24.578953 8226 server_base.cc:1034] running on GCE node
I20260811 17:08:24.579413 8226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:24.580258 8226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:24.581470 8226 hybrid_clock.cc:648] HybridClock initialized: now 1786468104581426 us; error 55 us; skew 500 ppm
Aug 11 17:08:24 dist-test-slave-7vjv krb5kdc[7754](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468104, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:24.585079 8226 init.cc:377] Logged in from keytab as kudu/127.4.146.194@KRBTEST.COM (short username kudu)
I20260811 17:08:24.586140 8226 webserver.cc:460] Webserver started at http://127.4.146.194:36765/ using document root <none> and password file <none>
I20260811 17:08:24.586812 8226 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:24.586920 8226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:24.587204 8226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:24.589708 8226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "b5d0843bd1b14764bc406bb244fe2af4"
format_stamp: "Formatted at 2026-08-11 17:08:24 on dist-test-slave-7vjv"
server_key: "cfdd58f724d736393e22731b8e20519d"
server_key_iv: "3cebcba6615e8091f62633ca68b131d8"
server_key_version: "encryptionkey@0"
I20260811 17:08:24.590409 8226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "b5d0843bd1b14764bc406bb244fe2af4"
format_stamp: "Formatted at 2026-08-11 17:08:24 on dist-test-slave-7vjv"
server_key: "cfdd58f724d736393e22731b8e20519d"
server_key_iv: "3cebcba6615e8091f62633ca68b131d8"
server_key_version: "encryptionkey@0"
I20260811 17:08:24.595057 8226 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 17:08:24.597941 8255 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:24.599359 8226 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 17:08:24.599519 8226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "b5d0843bd1b14764bc406bb244fe2af4"
format_stamp: "Formatted at 2026-08-11 17:08:24 on dist-test-slave-7vjv"
server_key: "cfdd58f724d736393e22731b8e20519d"
server_key_iv: "3cebcba6615e8091f62633ca68b131d8"
server_key_version: "encryptionkey@0"
I20260811 17:08:24.599654 8226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:24.630151 8226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:24.634131 8226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:24.634382 8226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:24.636209 8226 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:24.636288 8226 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:24.636379 8226 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:24.636423 8226 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 17:08:24 dist-test-slave-7vjv krb5kdc[7754](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468104, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:24.649070 8226 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:35749
I20260811 17:08:24.649551 8454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:35749 every 8 connection(s)
I20260811 17:08:24.650300 8226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:08:24.652786 7927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:24.637145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:42841 (local address 127.4.146.254:33671)
0811 17:08:24.637328 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:24.637333 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:24.638745 (+ 1412us) server_negotiation.cc:407] Connection header received
0811 17:08:24.640080 (+ 1335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:24.640112 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:24.640194 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:24.640312 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:24.642059 (+ 1747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.643080 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.644971 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.645266 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.645388 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:24.648431 (+ 3043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:24.648435 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:24.648437 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:24.648465 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:24.650270 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:24.650830 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:24.650833 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:24.650835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:24.650926 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:24.651345 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:24.651348 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:24.651350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:24.651558 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:24.651678 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:24.652363 (+ 685us) server_negotiation.cc:299] Negotiation successful
0811 17:08:24.652570 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 17:08:24.653680 8271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:24.638059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33671 (local address 127.4.146.194:42841)
0811 17:08:24.638549 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:24.638606 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:24.639786 (+ 1180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:24.640521 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:24.640533 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:24.641036 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:24.641846 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:24.641871 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.643250 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.643255 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:24.644843 (+ 1588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:24.644859 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.645436 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.645441 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:24.645639 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:24.646395 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:24.646420 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:24.648233 (+ 1813us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:24.650405 (+ 2172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:24.650414 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:24.650434 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:24.650720 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:24.651022 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:24.651026 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:24.651029 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:24.651242 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:24.651680 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:24.651690 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:24.651982 (+ 292us) client_negotiation.cc:769] Sending connection context
0811 17:08:24.652235 (+ 253us) client_negotiation.cc:240] Negotiation successful
0811 17:08:24.652661 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":146,"threads_started":1}
I20260811 17:08:24.654676 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 8226
I20260811 17:08:24.654829 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:08:24.655156 4683 external_mini_cluster.cc:1428] Setting key e5f772dd0efd1c1314085931a40a7bb7
I20260811 17:08:24.655157 8462 heartbeater.cc:347] Connected to a master server at 127.4.146.254:33671
I20260811 17:08:24.655303 8462 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:24.655892 8462 heartbeater.cc:511] Master 127.4.146.254:33671 requested a full tablet report, sending...
I20260811 17:08:24.657023 7846 ts_manager.cc:194] Registered new tserver with Master: b5d0843bd1b14764bc406bb244fe2af4 (127.4.146.194:35749)
I20260811 17:08:24.657817 7846 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.194@KRBTEST.COM'} at 127.4.146.194:42841
I20260811 17:08:24.666016 7927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:24.657615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:56303 (local address 127.4.146.254:33671)
0811 17:08:24.657936 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:24.657942 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:24.658210 (+ 268us) server_negotiation.cc:407] Connection header received
0811 17:08:24.658259 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:24.658264 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:24.658319 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:24.658398 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:24.658967 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.659591 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.660638 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.660873 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.660988 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:24.662249 (+ 1261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:24.662253 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:24.662256 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:24.662290 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:24.663943 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:24.664521 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:24.664527 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:24.664529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:24.664639 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:24.664985 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:24.664990 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:24.664992 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:24.665262 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:24.665390 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:24.665697 (+ 307us) server_negotiation.cc:299] Negotiation successful
0811 17:08:24.665831 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216}
I20260811 17:08:24.666036 8475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:24.657591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33671 (local address 127.4.146.194:56303)
0811 17:08:24.657978 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:24.657995 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:24.658107 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:24.658436 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:24.658438 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:24.658690 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:24.658826 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:24.658834 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.659751 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.659754 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:24.660504 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:24.660514 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.660994 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.660998 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:24.661101 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:24.661694 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:24.661706 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:24.662042 (+ 336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:24.664094 (+ 2052us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:24.664130 (+ 36us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:24.664134 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:24.664395 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:24.664755 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:24.664759 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:24.664761 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:24.664870 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:24.665377 (+ 507us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:24.665381 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:24.665502 (+ 121us) client_negotiation.cc:769] Sending connection context
0811 17:08:24.665623 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 17:08:24.665816 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"mutex_wait_us":8,"thread_start_us":107,"threads_started":1}
WARNING: no policy specified for kudu/127.4.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
I20260811 17:08:24.690626 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:33671
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:42145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:24.817653 8479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:24.817958 8479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:24.818056 8479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:24.822273 8479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:24.822351 8479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:24.822393 8479 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 17:08:24.822438 8479 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 17:08:24.822506 8479 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:08:24.828341 8479 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:42145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.146.254:33671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8479
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:24.829511 8479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:24.830650 8479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:24.841527 8492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:24.841506 8488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:24.841506 8489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:24.842197 8479 server_base.cc:1034] running on GCE node
I20260811 17:08:24.842773 8479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:24.843528 8479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:24.844717 8479 hybrid_clock.cc:648] HybridClock initialized: now 1786468104844676 us; error 51 us; skew 500 ppm
Aug 11 17:08:24 dist-test-slave-7vjv krb5kdc[7754](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468104, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:24.847832 8479 init.cc:377] Logged in from keytab as kudu/127.4.146.195@KRBTEST.COM (short username kudu)
I20260811 17:08:24.848946 8479 webserver.cc:460] Webserver started at http://127.4.146.195:43705/ using document root <none> and password file <none>
I20260811 17:08:24.849655 8479 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:24.849730 8479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:24.849959 8479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:24.852272 8479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "86efb8381af54b1abd808662118f8b34"
format_stamp: "Formatted at 2026-08-11 17:08:24 on dist-test-slave-7vjv"
server_key: "7c438ebbc70e01b5e5dbe7d963d99ba9"
server_key_iv: "11e31461f5bc755a7c18e19420527902"
server_key_version: "encryptionkey@0"
I20260811 17:08:24.852938 8479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "86efb8381af54b1abd808662118f8b34"
format_stamp: "Formatted at 2026-08-11 17:08:24 on dist-test-slave-7vjv"
server_key: "7c438ebbc70e01b5e5dbe7d963d99ba9"
server_key_iv: "11e31461f5bc755a7c18e19420527902"
server_key_version: "encryptionkey@0"
I20260811 17:08:24.857203 8479 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 17:08:24.859935 8500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:24.861342 8479 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 17:08:24.861481 8479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "86efb8381af54b1abd808662118f8b34"
format_stamp: "Formatted at 2026-08-11 17:08:24 on dist-test-slave-7vjv"
server_key: "7c438ebbc70e01b5e5dbe7d963d99ba9"
server_key_iv: "11e31461f5bc755a7c18e19420527902"
server_key_version: "encryptionkey@0"
I20260811 17:08:24.861603 8479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:24.878794 8479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:24.882452 8479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:24.882704 8479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:24.884599 8479 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:24.884680 8479 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:24.884778 8479 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:24.884824 8479 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 17:08:24 dist-test-slave-7vjv krb5kdc[7754](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468104, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:24.897011 8479 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:35507
I20260811 17:08:24.897257 8722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:35507 every 8 connection(s)
I20260811 17:08:24.898284 8479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:08:24.899298 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 8479
I20260811 17:08:24.899426 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:08:24.899778 4683 external_mini_cluster.cc:1428] Setting key 5669a491ed242b9fcff1cdf349f3b183
I20260811 17:08:24.900503 7927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:24.885279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:54413 (local address 127.4.146.254:33671)
0811 17:08:24.885456 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:24.885462 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:24.887006 (+ 1544us) server_negotiation.cc:407] Connection header received
0811 17:08:24.888484 (+ 1478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:24.888487 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:24.888539 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:24.888664 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:24.889916 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.890642 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.892079 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.892409 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.892539 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:24.895808 (+ 3269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:24.895812 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:24.895814 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:24.895845 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:24.897756 (+ 1911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:24.898482 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:24.898486 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:24.898488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:24.898590 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:24.899104 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:24.899109 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:24.899111 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:24.899429 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:24.899544 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:24.900181 (+ 637us) server_negotiation.cc:299] Negotiation successful
0811 17:08:24.900327 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 17:08:24.901516 8522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:24.886236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33671 (local address 127.4.146.195:54413)
0811 17:08:24.886799 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:24.886877 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:24.888219 (+ 1342us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:24.888837 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:24.888848 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:24.889246 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:24.889750 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:24.889765 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.890797 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.890801 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:24.891944 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:24.891955 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.892607 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.892612 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:24.892821 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:24.893556 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:24.893574 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:24.895586 (+ 2012us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:24.897893 (+ 2307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:24.897899 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:24.897915 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:24.898335 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:24.898758 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:24.898765 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:24.898769 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:24.898970 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:24.899538 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:24.899547 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:24.899838 (+ 291us) client_negotiation.cc:769] Sending connection context
0811 17:08:24.900062 (+ 224us) client_negotiation.cc:240] Negotiation successful
0811 17:08:24.900498 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":161,"threads_started":1}
I20260811 17:08:24.902935 8724 heartbeater.cc:347] Connected to a master server at 127.4.146.254:33671
I20260811 17:08:24.903201 8724 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:24.903998 8724 heartbeater.cc:511] Master 127.4.146.254:33671 requested a full tablet report, sending...
I20260811 17:08:24.905386 7846 ts_manager.cc:194] Registered new tserver with Master: 86efb8381af54b1abd808662118f8b34 (127.4.146.195:35507)
I20260811 17:08:24.906273 7846 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.195@KRBTEST.COM'} at 127.4.146.195:54413
I20260811 17:08:24.914438 8733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:24.905844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33671 (local address 127.4.146.195:35381)
0811 17:08:24.906193 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:24.906205 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:24.906356 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:24.906621 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:24.906624 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:24.906862 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:24.906967 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:24.906973 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.907747 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.907755 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:24.908756 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:24.908768 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.909268 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.909271 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:24.909400 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:24.910102 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:24.910114 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:24.910466 (+ 352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:24.912606 (+ 2140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:24.912609 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:24.912610 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:24.912844 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:24.913274 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:24.913281 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:24.913286 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:24.913412 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:24.913871 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:24.913874 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:24.913994 (+ 120us) client_negotiation.cc:769] Sending connection context
0811 17:08:24.914084 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 17:08:24.914256 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":175,"threads_started":1}
I20260811 17:08:24.914529 7927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:24.905923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:35381 (local address 127.4.146.254:33671)
0811 17:08:24.906045 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:24.906051 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:24.906301 (+ 250us) server_negotiation.cc:407] Connection header received
0811 17:08:24.906459 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:24.906462 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:24.906507 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:24.906603 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:24.907086 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.907600 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.908892 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.909146 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.909236 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:24.910637 (+ 1401us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:24.910641 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:24.910643 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:24.910672 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:24.912460 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:24.912962 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:24.912965 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:24.912967 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:24.913092 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:24.913520 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:24.913524 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:24.913526 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:24.913782 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:24.913873 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:24.914170 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 17:08:24.914343 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 17:08:24.914553 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 17:08:24 dist-test-slave-7vjv krb5kdc[7754](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468104, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 17:08:24 dist-test-slave-7vjv krb5kdc[7754](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468104, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:24.945469 7927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:24.937115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35360 (local address 127.4.146.254:33671)
0811 17:08:24.937279 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:24.937283 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:24.937296 (+ 13us) server_negotiation.cc:407] Connection header received
0811 17:08:24.937342 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:24.937344 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:24.937382 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:24.937479 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:24.938285 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.938816 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.939711 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.939927 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.940039 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:24.942575 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:24.942578 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:24.942580 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:24.942607 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:24.943902 (+ 1295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:24.944373 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:24.944376 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:24.944377 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:24.944461 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:24.944738 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:24.944741 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:24.944742 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:24.944925 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:24.945037 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:24.945234 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 17:08:24.945339 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 17:08:24.948827 7846 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35360:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 17:08:24.952247 7846 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:08:24.968305 8749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:24.961873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:35507 (local address 127.0.0.1:36852)
0811 17:08:24.962351 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:24.962403 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:24.962553 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:24.963365 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:24.963372 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:24.963399 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:24.963576 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:24.963585 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.965125 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.965128 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:24.966520 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:24.966531 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.967686 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.967689 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:24.967805 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:24.967846 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 17:08:24.967968 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 17:08:24.968135 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":112,"threads_started":1}
I20260811 17:08:24.968415 8751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:24.962041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36852 (local address 127.4.146.195:35507)
0811 17:08:24.962598 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:24.962612 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:24.962684 (+ 72us) server_negotiation.cc:407] Connection header received
0811 17:08:24.962772 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:24.962778 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:24.963005 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:24.963171 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:24.963739 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.964986 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.966665 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.967529 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.967652 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:24.967835 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:24.968022 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 17:08:24.968253 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":165,"threads_started":1}
I20260811 17:08:24.969216 8759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:24.963901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:41559 (local address 127.0.0.1:37494)
0811 17:08:24.964178 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:24.964193 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:24.964325 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:24.964875 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:24.964880 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:24.964902 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:24.964995 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:24.965000 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.966432 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.966435 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:24.967300 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:24.967310 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.968797 (+ 1487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.968800 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:24.968894 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:24.968916 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 17:08:24.968991 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 17:08:24.969080 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"mutex_wait_us":74,"thread_start_us":118,"threads_started":1}
I20260811 17:08:24.969733 8755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:24.962644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:35749 (local address 127.0.0.1:46800)
0811 17:08:24.963890 (+ 1246us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:24.963908 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:24.964018 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:24.964662 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:24.964665 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:24.964684 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:24.964846 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:24.964856 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.966389 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.966395 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:24.967607 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:24.967621 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.969293 (+ 1672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.969296 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:24.969388 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:24.969420 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 17:08:24.969506 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 17:08:24.969587 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1162,"mutex_wait_us":3,"thread_start_us":102,"threads_started":1}
I20260811 17:08:24.969885 8758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:24.963331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37494 (local address 127.4.146.193:41559)
0811 17:08:24.964344 (+ 1013us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:24.964351 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:24.964373 (+ 22us) server_negotiation.cc:407] Connection header received
0811 17:08:24.964449 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:24.964453 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:24.964627 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:24.964775 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:24.965158 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.966313 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.967438 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.968450 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.968580 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:24.968730 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:24.969615 (+ 885us) server_negotiation.cc:299] Negotiation successful
0811 17:08:24.969726 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":911,"thread_start_us":190,"threads_started":1}
I20260811 17:08:24.970357 8756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:24.962939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46800 (local address 127.4.146.194:35749)
0811 17:08:24.963635 (+ 696us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:24.963691 (+ 56us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:24.964161 (+ 470us) server_negotiation.cc:407] Connection header received
0811 17:08:24.964269 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:24.964277 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:24.964479 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:24.964691 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:24.965161 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.966275 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.967757 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:24.968969 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:24.969082 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:24.969226 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:24.969889 (+ 663us) server_negotiation.cc:299] Negotiation successful
0811 17:08:24.969994 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560,"thread_start_us":241,"threads_started":1}
I20260811 17:08:24.972419 8563 tablet_service.cc:1467] Processing CreateTablet for tablet 091e7fbd21a74da6b9091382bb1fbaf2 (DEFAULT_TABLE table=test-table [id=b7b1d17f81a446aaafe8efe549015e70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:24.973032 8088 tablet_service.cc:1467] Processing CreateTablet for tablet 091e7fbd21a74da6b9091382bb1fbaf2 (DEFAULT_TABLE table=test-table [id=b7b1d17f81a446aaafe8efe549015e70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:24.973034 8346 tablet_service.cc:1467] Processing CreateTablet for tablet 091e7fbd21a74da6b9091382bb1fbaf2 (DEFAULT_TABLE table=test-table [id=b7b1d17f81a446aaafe8efe549015e70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:24.973664 8563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 091e7fbd21a74da6b9091382bb1fbaf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:24.974061 8088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 091e7fbd21a74da6b9091382bb1fbaf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:24.974061 8346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 091e7fbd21a74da6b9091382bb1fbaf2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:24.982671 8761 tablet_bootstrap.cc:492] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34: Bootstrap starting.
I20260811 17:08:24.984577 8762 tablet_bootstrap.cc:492] T 091e7fbd21a74da6b9091382bb1fbaf2 P 75a9e5d1ffbb4491b91fb0620097ebbc: Bootstrap starting.
I20260811 17:08:24.985699 8761 tablet_bootstrap.cc:654] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:24.986922 8761 log.cc:824] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:24.987397 8762 tablet_bootstrap.cc:654] T 091e7fbd21a74da6b9091382bb1fbaf2 P 75a9e5d1ffbb4491b91fb0620097ebbc: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:24.987702 8767 tablet_bootstrap.cc:492] T 091e7fbd21a74da6b9091382bb1fbaf2 P b5d0843bd1b14764bc406bb244fe2af4: Bootstrap starting.
I20260811 17:08:24.988673 8762 log.cc:824] T 091e7fbd21a74da6b9091382bb1fbaf2 P 75a9e5d1ffbb4491b91fb0620097ebbc: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:24.990060 8761 tablet_bootstrap.cc:492] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34: No bootstrap required, opened a new log
I20260811 17:08:24.990284 8761 ts_tablet_manager.cc:1397] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260811 17:08:24.990626 8762 tablet_bootstrap.cc:492] T 091e7fbd21a74da6b9091382bb1fbaf2 P 75a9e5d1ffbb4491b91fb0620097ebbc: No bootstrap required, opened a new log
I20260811 17:08:24.990818 8767 tablet_bootstrap.cc:654] T 091e7fbd21a74da6b9091382bb1fbaf2 P b5d0843bd1b14764bc406bb244fe2af4: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:24.990835 8762 ts_tablet_manager.cc:1397] T 091e7fbd21a74da6b9091382bb1fbaf2 P 75a9e5d1ffbb4491b91fb0620097ebbc: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 17:08:24.991997 8767 log.cc:824] T 091e7fbd21a74da6b9091382bb1fbaf2 P b5d0843bd1b14764bc406bb244fe2af4: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:24.995755 8767 tablet_bootstrap.cc:492] T 091e7fbd21a74da6b9091382bb1fbaf2 P b5d0843bd1b14764bc406bb244fe2af4: No bootstrap required, opened a new log
I20260811 17:08:24.995702 8761 raft_consensus.cc:348] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } }
I20260811 17:08:24.995996 8767 ts_tablet_manager.cc:1397] T 091e7fbd21a74da6b9091382bb1fbaf2 P b5d0843bd1b14764bc406bb244fe2af4: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260811 17:08:24.996071 8761 raft_consensus.cc:374] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:24.996210 8761 raft_consensus.cc:729] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86efb8381af54b1abd808662118f8b34, State: Initialized, Role: FOLLOWER
I20260811 17:08:24.996740 8761 consensus_queue.cc:260] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } }
I20260811 17:08:24.997478 8724 heartbeater.cc:503] Master 127.4.146.254:33671 was elected leader, sending a full tablet report...
I20260811 17:08:24.997534 8762 raft_consensus.cc:348] T 091e7fbd21a74da6b9091382bb1fbaf2 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } }
I20260811 17:08:24.997893 8762 raft_consensus.cc:374] T 091e7fbd21a74da6b9091382bb1fbaf2 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:24.997959 8762 raft_consensus.cc:729] T 091e7fbd21a74da6b9091382bb1fbaf2 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75a9e5d1ffbb4491b91fb0620097ebbc, State: Initialized, Role: FOLLOWER
I20260811 17:08:24.998423 8762 consensus_queue.cc:260] T 091e7fbd21a74da6b9091382bb1fbaf2 P 75a9e5d1ffbb4491b91fb0620097ebbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } }
I20260811 17:08:24.999127 8761 ts_tablet_manager.cc:1428] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34: Time spent starting tablet: real 0.009s user 0.009s sys 0.000s
I20260811 17:08:24.999574 8762 ts_tablet_manager.cc:1428] T 091e7fbd21a74da6b9091382bb1fbaf2 P 75a9e5d1ffbb4491b91fb0620097ebbc: Time spent starting tablet: real 0.009s user 0.004s sys 0.005s
I20260811 17:08:24.999794 8214 heartbeater.cc:503] Master 127.4.146.254:33671 was elected leader, sending a full tablet report...
I20260811 17:08:25.000648 8767 raft_consensus.cc:348] T 091e7fbd21a74da6b9091382bb1fbaf2 P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } }
I20260811 17:08:25.000998 8767 raft_consensus.cc:374] T 091e7fbd21a74da6b9091382bb1fbaf2 P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:25.001085 8767 raft_consensus.cc:729] T 091e7fbd21a74da6b9091382bb1fbaf2 P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5d0843bd1b14764bc406bb244fe2af4, State: Initialized, Role: FOLLOWER
I20260811 17:08:25.001600 8767 consensus_queue.cc:260] T 091e7fbd21a74da6b9091382bb1fbaf2 P b5d0843bd1b14764bc406bb244fe2af4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } }
I20260811 17:08:25.002535 8462 heartbeater.cc:503] Master 127.4.146.254:33671 was elected leader, sending a full tablet report...
I20260811 17:08:25.002831 8767 ts_tablet_manager.cc:1428] T 091e7fbd21a74da6b9091382bb1fbaf2 P b5d0843bd1b14764bc406bb244fe2af4: Time spent starting tablet: real 0.007s user 0.009s sys 0.000s
W20260811 17:08:25.136861 8217 tablet.cc:2369] T 091e7fbd21a74da6b9091382bb1fbaf2 P 75a9e5d1ffbb4491b91fb0620097ebbc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 17:08:25.149663 8726 tablet.cc:2369] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 17:08:25.152257 8465 tablet.cc:2369] T 091e7fbd21a74da6b9091382bb1fbaf2 P b5d0843bd1b14764bc406bb244fe2af4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 17:08:25.168697 8774 raft_consensus.cc:482] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:08:25.168957 8774 raft_consensus.cc:504] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } }
I20260811 17:08:25.170217 8774 leader_election.cc:288] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5d0843bd1b14764bc406bb244fe2af4 (127.4.146.194:35749), 75a9e5d1ffbb4491b91fb0620097ebbc (127.4.146.193:41559)
I20260811 17:08:25.175159 8756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:25.170829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:60761 (local address 127.4.146.194:35749)
0811 17:08:25.170966 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:25.170971 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:25.170991 (+ 20us) server_negotiation.cc:407] Connection header received
0811 17:08:25.171059 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:25.171063 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:25.171122 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:25.171213 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:25.171582 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.172540 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.173843 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.174559 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.174717 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:25.174780 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:25.174975 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 17:08:25.175044 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 17:08:25.175168 8522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:25.170608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:35749 (local address 127.4.146.195:60761)
0811 17:08:25.170802 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:25.170821 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:25.170959 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:25.171246 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:25.171249 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:25.171270 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:25.171428 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:25.171435 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.172663 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.172667 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:25.173708 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:25.173717 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.174715 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.174719 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:25.174832 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:25.174863 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 17:08:25.174949 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 17:08:25.175025 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84}
I20260811 17:08:25.176035 8781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:25.170888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:41559 (local address 127.4.146.195:59449)
0811 17:08:25.171247 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:25.171262 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:25.171374 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:25.171658 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:25.171661 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:25.171682 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:25.172363 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:25.172375 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.173366 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.173369 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:25.174599 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:25.174613 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.175529 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.175532 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:25.175647 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:25.175665 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 17:08:25.175818 (+ 153us) client_negotiation.cc:240] Negotiation successful
0811 17:08:25.175898 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":156,"threads_started":1}
I20260811 17:08:25.176074 8758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:25.171034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:59449 (local address 127.4.146.193:41559)
0811 17:08:25.171186 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:25.171192 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:25.171346 (+ 154us) server_negotiation.cc:407] Connection header received
0811 17:08:25.171479 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:25.171485 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:25.171544 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:25.171614 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:25.172490 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.173234 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.174729 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.175380 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.175509 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:25.175565 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:25.175880 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 17:08:25.175960 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 17:08:25.176007 8377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "091e7fbd21a74da6b9091382bb1fbaf2" candidate_uuid: "86efb8381af54b1abd808662118f8b34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5d0843bd1b14764bc406bb244fe2af4" is_pre_election: true
I20260811 17:08:25.176492 8377 raft_consensus.cc:2454] T 091e7fbd21a74da6b9091382bb1fbaf2 P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86efb8381af54b1abd808662118f8b34 in term 0.
I20260811 17:08:25.176867 8121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "091e7fbd21a74da6b9091382bb1fbaf2" candidate_uuid: "86efb8381af54b1abd808662118f8b34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" is_pre_election: true
I20260811 17:08:25.177096 8504 leader_election.cc:302] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86efb8381af54b1abd808662118f8b34, b5d0843bd1b14764bc406bb244fe2af4; no voters:
I20260811 17:08:25.177201 8121 raft_consensus.cc:2454] T 091e7fbd21a74da6b9091382bb1fbaf2 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86efb8381af54b1abd808662118f8b34 in term 0.
I20260811 17:08:25.177433 8774 raft_consensus.cc:2781] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:08:25.177570 8774 raft_consensus.cc:482] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:08:25.177642 8774 raft_consensus.cc:3037] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:25.178815 8774 raft_consensus.cc:504] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } }
I20260811 17:08:25.179210 8774 leader_election.cc:288] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34 [CANDIDATE]: Term 1 election: Requested vote from peers b5d0843bd1b14764bc406bb244fe2af4 (127.4.146.194:35749), 75a9e5d1ffbb4491b91fb0620097ebbc (127.4.146.193:41559)
I20260811 17:08:25.179627 8377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "091e7fbd21a74da6b9091382bb1fbaf2" candidate_uuid: "86efb8381af54b1abd808662118f8b34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5d0843bd1b14764bc406bb244fe2af4"
I20260811 17:08:25.179669 8121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "091e7fbd21a74da6b9091382bb1fbaf2" candidate_uuid: "86efb8381af54b1abd808662118f8b34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc"
I20260811 17:08:25.179803 8377 raft_consensus.cc:3037] T 091e7fbd21a74da6b9091382bb1fbaf2 P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:25.179809 8121 raft_consensus.cc:3037] T 091e7fbd21a74da6b9091382bb1fbaf2 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:25.181020 8377 raft_consensus.cc:2454] T 091e7fbd21a74da6b9091382bb1fbaf2 P b5d0843bd1b14764bc406bb244fe2af4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86efb8381af54b1abd808662118f8b34 in term 1.
I20260811 17:08:25.181035 8121 raft_consensus.cc:2454] T 091e7fbd21a74da6b9091382bb1fbaf2 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86efb8381af54b1abd808662118f8b34 in term 1.
I20260811 17:08:25.181366 8504 leader_election.cc:302] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86efb8381af54b1abd808662118f8b34, b5d0843bd1b14764bc406bb244fe2af4; no voters:
I20260811 17:08:25.181610 8774 raft_consensus.cc:2781] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:25.181839 8774 raft_consensus.cc:686] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34 [term 1 LEADER]: Becoming Leader. State: Replica: 86efb8381af54b1abd808662118f8b34, State: Running, Role: LEADER
I20260811 17:08:25.182183 8774 consensus_queue.cc:237] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } }
I20260811 17:08:25.185740 7845 catalog_manager.cc:5495] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86efb8381af54b1abd808662118f8b34 (127.4.146.195). New cstate: current_term: 1 leader_uuid: "86efb8381af54b1abd808662118f8b34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } health_report { overall_health: UNKNOWN } } }
Aug 11 17:08:25 dist-test-slave-7vjv krb5kdc[7754](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468104, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:25.240235 8792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:25.230207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33671 (local address 127.0.0.1:35362)
0811 17:08:25.230550 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:25.230562 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:25.230731 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:25.231000 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:25.231002 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:25.231509 (+ 507us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:25.231609 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:25.231617 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.232475 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.232482 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:25.233046 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:25.233055 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.233514 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.233517 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:25.233614 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:25.234363 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:25.234377 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:25.236185 (+ 1808us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:25.238528 (+ 2343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:25.238540 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:25.238548 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:25.238814 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:25.239105 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:25.239108 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:25.239109 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:25.239220 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:25.239610 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:25.239617 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:25.239751 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 17:08:25.239850 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 17:08:25.239988 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":1,"thread_start_us":122,"threads_started":1}
I20260811 17:08:25.240384 7927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:25.230301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35362 (local address 127.4.146.254:33671)
0811 17:08:25.230443 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:25.230448 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:25.230666 (+ 218us) server_negotiation.cc:407] Connection header received
0811 17:08:25.230839 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:25.230842 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:25.230886 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:25.230980 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:25.231750 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.232360 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.233178 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.233393 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.233505 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:25.236334 (+ 2829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:25.236338 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:25.236341 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:25.236373 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:25.238399 (+ 2026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:25.238914 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:25.238917 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:25.238918 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:25.239002 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:25.239306 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:25.239308 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:25.239310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:25.239508 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:25.239595 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:25.239958 (+ 363us) server_negotiation.cc:299] Negotiation successful
0811 17:08:25.240178 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":47}
I20260811 17:08:25.245760 7845 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:35362:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 17:08:25.246608 7845 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:08:25.252202 8088 tablet_service.cc:1467] Processing CreateTablet for tablet 1bcf790fd94d43d28d3eea49b2f7a15c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0579b44d10e4466b93c6c46b0187596c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 17:08:25.252233 8563 tablet_service.cc:1467] Processing CreateTablet for tablet 1bcf790fd94d43d28d3eea49b2f7a15c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0579b44d10e4466b93c6c46b0187596c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 17:08:25.252172 8346 tablet_service.cc:1467] Processing CreateTablet for tablet 1bcf790fd94d43d28d3eea49b2f7a15c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0579b44d10e4466b93c6c46b0187596c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 17:08:25.253021 8088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1bcf790fd94d43d28d3eea49b2f7a15c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:25.253021 8563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1bcf790fd94d43d28d3eea49b2f7a15c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:25.253022 8346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1bcf790fd94d43d28d3eea49b2f7a15c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:25.256072 8761 tablet_bootstrap.cc:492] T 1bcf790fd94d43d28d3eea49b2f7a15c P 86efb8381af54b1abd808662118f8b34: Bootstrap starting.
I20260811 17:08:25.256148 8762 tablet_bootstrap.cc:492] T 1bcf790fd94d43d28d3eea49b2f7a15c P 75a9e5d1ffbb4491b91fb0620097ebbc: Bootstrap starting.
I20260811 17:08:25.257038 8761 tablet_bootstrap.cc:654] T 1bcf790fd94d43d28d3eea49b2f7a15c P 86efb8381af54b1abd808662118f8b34: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:25.257328 8762 tablet_bootstrap.cc:654] T 1bcf790fd94d43d28d3eea49b2f7a15c P 75a9e5d1ffbb4491b91fb0620097ebbc: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:25.258165 8767 tablet_bootstrap.cc:492] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4: Bootstrap starting.
I20260811 17:08:25.258560 8761 tablet_bootstrap.cc:492] T 1bcf790fd94d43d28d3eea49b2f7a15c P 86efb8381af54b1abd808662118f8b34: No bootstrap required, opened a new log
I20260811 17:08:25.258677 8761 ts_tablet_manager.cc:1397] T 1bcf790fd94d43d28d3eea49b2f7a15c P 86efb8381af54b1abd808662118f8b34: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 17:08:25.259135 8767 tablet_bootstrap.cc:654] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:25.259097 8761 raft_consensus.cc:348] T 1bcf790fd94d43d28d3eea49b2f7a15c P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:25.259229 8761 raft_consensus.cc:374] T 1bcf790fd94d43d28d3eea49b2f7a15c P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:25.259270 8761 raft_consensus.cc:729] T 1bcf790fd94d43d28d3eea49b2f7a15c P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86efb8381af54b1abd808662118f8b34, State: Initialized, Role: FOLLOWER
I20260811 17:08:25.259407 8761 consensus_queue.cc:260] T 1bcf790fd94d43d28d3eea49b2f7a15c P 86efb8381af54b1abd808662118f8b34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:25.259670 8774 tablet_replica.cc:439] T 1bcf790fd94d43d28d3eea49b2f7a15c P 86efb8381af54b1abd808662118f8b34: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } } }
I20260811 17:08:25.259819 8774 tablet_replica.cc:442] T 1bcf790fd94d43d28d3eea49b2f7a15c P 86efb8381af54b1abd808662118f8b34: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 17:08:25.260310 8761 ts_tablet_manager.cc:1428] T 1bcf790fd94d43d28d3eea49b2f7a15c P 86efb8381af54b1abd808662118f8b34: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260811 17:08:25.260483 8767 tablet_bootstrap.cc:492] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4: No bootstrap required, opened a new log
I20260811 17:08:25.260581 8767 ts_tablet_manager.cc:1397] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 17:08:25.261083 8767 raft_consensus.cc:348] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:25.261226 8767 raft_consensus.cc:374] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:25.261264 8767 raft_consensus.cc:729] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5d0843bd1b14764bc406bb244fe2af4, State: Initialized, Role: FOLLOWER
I20260811 17:08:25.261386 8767 consensus_queue.cc:260] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:25.261646 8767 ts_tablet_manager.cc:1428] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 17:08:25.261675 8777 tablet_replica.cc:439] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } } }
I20260811 17:08:25.261817 8777 tablet_replica.cc:442] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 17:08:25.262620 8762 tablet_bootstrap.cc:492] T 1bcf790fd94d43d28d3eea49b2f7a15c P 75a9e5d1ffbb4491b91fb0620097ebbc: No bootstrap required, opened a new log
I20260811 17:08:25.262722 8762 ts_tablet_manager.cc:1397] T 1bcf790fd94d43d28d3eea49b2f7a15c P 75a9e5d1ffbb4491b91fb0620097ebbc: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260811 17:08:25.263257 8762 raft_consensus.cc:348] T 1bcf790fd94d43d28d3eea49b2f7a15c P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:25.263381 8762 raft_consensus.cc:374] T 1bcf790fd94d43d28d3eea49b2f7a15c P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:25.263415 8762 raft_consensus.cc:729] T 1bcf790fd94d43d28d3eea49b2f7a15c P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75a9e5d1ffbb4491b91fb0620097ebbc, State: Initialized, Role: FOLLOWER
I20260811 17:08:25.263545 8762 consensus_queue.cc:260] T 1bcf790fd94d43d28d3eea49b2f7a15c P 75a9e5d1ffbb4491b91fb0620097ebbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:25.263823 8762 ts_tablet_manager.cc:1428] T 1bcf790fd94d43d28d3eea49b2f7a15c P 75a9e5d1ffbb4491b91fb0620097ebbc: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 17:08:25.263845 8775 tablet_replica.cc:439] T 1bcf790fd94d43d28d3eea49b2f7a15c P 75a9e5d1ffbb4491b91fb0620097ebbc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } } }
I20260811 17:08:25.264038 8775 tablet_replica.cc:442] T 1bcf790fd94d43d28d3eea49b2f7a15c P 75a9e5d1ffbb4491b91fb0620097ebbc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 17:08:25.344080 8777 raft_consensus.cc:482] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:08:25.344331 8777 raft_consensus.cc:504] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:25.345646 8777 leader_election.cc:288] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75a9e5d1ffbb4491b91fb0620097ebbc (127.4.146.193:41559), 86efb8381af54b1abd808662118f8b34 (127.4.146.195:35507)
I20260811 17:08:25.351491 8751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:25.346563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:54193 (local address 127.4.146.195:35507)
0811 17:08:25.346722 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:25.346726 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:25.346947 (+ 221us) server_negotiation.cc:407] Connection header received
0811 17:08:25.347009 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:25.347012 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:25.347061 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:25.347142 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:25.347957 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.348615 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.350050 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.350692 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.350824 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:25.350881 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:25.351281 (+ 400us) server_negotiation.cc:299] Negotiation successful
0811 17:08:25.351370 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 17:08:25.351464 8758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:25.346307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:38331 (local address 127.4.146.193:41559)
0811 17:08:25.346464 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:25.346472 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:25.346536 (+ 64us) server_negotiation.cc:407] Connection header received
0811 17:08:25.346964 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:25.346969 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:25.347030 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:25.347136 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:25.347563 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.348234 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.350037 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.350703 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.350824 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:25.350881 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:25.351244 (+ 363us) server_negotiation.cc:299] Negotiation successful
0811 17:08:25.351331 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 17:08:25.351549 8799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:25.346010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:41559 (local address 127.4.146.194:38331)
0811 17:08:25.346427 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:25.346446 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:25.346601 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:25.347172 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:25.347175 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:25.347197 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:25.347427 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:25.347438 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.348352 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.348354 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:25.349883 (+ 1529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:25.349896 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.350942 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.350950 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:25.351085 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:25.351110 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 17:08:25.351220 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 17:08:25.351303 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"mutex_wait_us":101,"thread_start_us":103,"threads_started":1}
I20260811 17:08:25.352005 8800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:25.346439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:35507 (local address 127.4.146.194:54193)
0811 17:08:25.346749 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:25.346764 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:25.346861 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:25.347197 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:25.347199 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:25.347211 (+ 12us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:25.347820 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:25.347829 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.348737 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.348741 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:25.349931 (+ 1190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:25.349943 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.350993 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.350997 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:25.351124 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:25.351151 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 17:08:25.351777 (+ 626us) client_negotiation.cc:240] Negotiation successful
0811 17:08:25.351857 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"mutex_wait_us":58,"thread_start_us":72,"threads_started":1}
I20260811 17:08:25.352227 8121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bcf790fd94d43d28d3eea49b2f7a15c" candidate_uuid: "b5d0843bd1b14764bc406bb244fe2af4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" is_pre_election: true
I20260811 17:08:25.352420 8121 raft_consensus.cc:2454] T 1bcf790fd94d43d28d3eea49b2f7a15c P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5d0843bd1b14764bc406bb244fe2af4 in term 0.
I20260811 17:08:25.352718 8612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bcf790fd94d43d28d3eea49b2f7a15c" candidate_uuid: "b5d0843bd1b14764bc406bb244fe2af4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86efb8381af54b1abd808662118f8b34" is_pre_election: true
I20260811 17:08:25.352849 8256 leader_election.cc:302] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75a9e5d1ffbb4491b91fb0620097ebbc, b5d0843bd1b14764bc406bb244fe2af4; no voters:
I20260811 17:08:25.352993 8612 raft_consensus.cc:2454] T 1bcf790fd94d43d28d3eea49b2f7a15c P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5d0843bd1b14764bc406bb244fe2af4 in term 0.
I20260811 17:08:25.353227 8777 raft_consensus.cc:2781] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:08:25.353302 8777 raft_consensus.cc:482] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:08:25.353363 8777 raft_consensus.cc:3037] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:25.354399 8777 raft_consensus.cc:504] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:25.354776 8777 leader_election.cc:288] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4 [CANDIDATE]: Term 1 election: Requested vote from peers 75a9e5d1ffbb4491b91fb0620097ebbc (127.4.146.193:41559), 86efb8381af54b1abd808662118f8b34 (127.4.146.195:35507)
I20260811 17:08:25.355195 8121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bcf790fd94d43d28d3eea49b2f7a15c" candidate_uuid: "b5d0843bd1b14764bc406bb244fe2af4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc"
I20260811 17:08:25.355222 8612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bcf790fd94d43d28d3eea49b2f7a15c" candidate_uuid: "b5d0843bd1b14764bc406bb244fe2af4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86efb8381af54b1abd808662118f8b34"
I20260811 17:08:25.355347 8121 raft_consensus.cc:3037] T 1bcf790fd94d43d28d3eea49b2f7a15c P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:25.355358 8612 raft_consensus.cc:3037] T 1bcf790fd94d43d28d3eea49b2f7a15c P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:25.356474 8121 raft_consensus.cc:2454] T 1bcf790fd94d43d28d3eea49b2f7a15c P 75a9e5d1ffbb4491b91fb0620097ebbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5d0843bd1b14764bc406bb244fe2af4 in term 1.
I20260811 17:08:25.356565 8612 raft_consensus.cc:2454] T 1bcf790fd94d43d28d3eea49b2f7a15c P 86efb8381af54b1abd808662118f8b34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5d0843bd1b14764bc406bb244fe2af4 in term 1.
I20260811 17:08:25.356789 8256 leader_election.cc:302] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75a9e5d1ffbb4491b91fb0620097ebbc, b5d0843bd1b14764bc406bb244fe2af4; no voters:
I20260811 17:08:25.356959 8777 raft_consensus.cc:2781] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:25.357283 8777 raft_consensus.cc:686] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4 [term 1 LEADER]: Becoming Leader. State: Replica: b5d0843bd1b14764bc406bb244fe2af4, State: Running, Role: LEADER
I20260811 17:08:25.357685 8777 consensus_queue.cc:237] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:25.360414 8801 tablet_replica.cc:439] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4: TxnStatusTablet state changed. Reason: New leader b5d0843bd1b14764bc406bb244fe2af4. Latest consensus state: current_term: 1 leader_uuid: "b5d0843bd1b14764bc406bb244fe2af4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } } }
I20260811 17:08:25.360546 8801 tablet_replica.cc:442] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4: This TxnStatusTablet replica's current role is: LEADER
I20260811 17:08:25.360904 8804 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 17:08:25.361131 8804 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 17:08:25.361830 7845 catalog_manager.cc:5495] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5d0843bd1b14764bc406bb244fe2af4 (127.4.146.194). New cstate: current_term: 1 leader_uuid: "b5d0843bd1b14764bc406bb244fe2af4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } health_report { overall_health: UNKNOWN } } }
I20260811 17:08:25.388430 8792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:25.383233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:35749 (local address 127.0.0.1:46814)
0811 17:08:25.383501 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:25.383517 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:25.383636 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:25.384071 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:25.384074 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:25.384083 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 17:08:25.384224 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:25.384231 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.385393 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.385397 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:25.386405 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:25.386417 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.387016 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.387020 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:25.387119 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:25.387182 (+ 63us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 17:08:25.388036 (+ 854us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 17:08:25.388057 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 17:08:25.388162 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 17:08:25.388270 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160}
I20260811 17:08:25.388942 8756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:25.383362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46814 (local address 127.4.146.194:35749)
0811 17:08:25.383498 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:25.383502 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:25.383566 (+ 64us) server_negotiation.cc:407] Connection header received
0811 17:08:25.383821 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:25.383825 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:25.383896 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:25.384005 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:08:25.384459 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.385258 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.386553 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.386882 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.386997 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:25.387357 (+ 360us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:08:25.387923 (+ 566us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:08:25.388044 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:25.388750 (+ 706us) server_negotiation.cc:299] Negotiation successful
0811 17:08:25.388816 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 17:08:25.394951 8612 raft_consensus.cc:1261] T 1bcf790fd94d43d28d3eea49b2f7a15c P 86efb8381af54b1abd808662118f8b34 [term 1 FOLLOWER]: Refusing update from remote peer b5d0843bd1b14764bc406bb244fe2af4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:08:25.394953 8121 raft_consensus.cc:1261] T 1bcf790fd94d43d28d3eea49b2f7a15c P 75a9e5d1ffbb4491b91fb0620097ebbc [term 1 FOLLOWER]: Refusing update from remote peer b5d0843bd1b14764bc406bb244fe2af4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:08:25.395674 8777 consensus_queue.cc:1035] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:08:25.395848 8801 consensus_queue.cc:1035] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:08:25.399371 8774 tablet_replica.cc:439] T 1bcf790fd94d43d28d3eea49b2f7a15c P 86efb8381af54b1abd808662118f8b34: TxnStatusTablet state changed. Reason: New leader b5d0843bd1b14764bc406bb244fe2af4. Latest consensus state: current_term: 1 leader_uuid: "b5d0843bd1b14764bc406bb244fe2af4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } } }
I20260811 17:08:25.399516 8774 tablet_replica.cc:442] T 1bcf790fd94d43d28d3eea49b2f7a15c P 86efb8381af54b1abd808662118f8b34: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 17:08:25.400007 8775 tablet_replica.cc:439] T 1bcf790fd94d43d28d3eea49b2f7a15c P 75a9e5d1ffbb4491b91fb0620097ebbc: TxnStatusTablet state changed. Reason: New leader b5d0843bd1b14764bc406bb244fe2af4. Latest consensus state: current_term: 1 leader_uuid: "b5d0843bd1b14764bc406bb244fe2af4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } } }
I20260811 17:08:25.401944 8775 tablet_replica.cc:442] T 1bcf790fd94d43d28d3eea49b2f7a15c P 75a9e5d1ffbb4491b91fb0620097ebbc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 17:08:25.405407 8777 tablet_replica.cc:439] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b5d0843bd1b14764bc406bb244fe2af4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } } }
I20260811 17:08:25.405540 8777 tablet_replica.cc:442] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4: This TxnStatusTablet replica's current role is: LEADER
I20260811 17:08:25.405827 8809 mvcc.cc:205] Tried to move back new op lower bound from 7317373359689797632 to 7317373359548076032. Current Snapshot: MvccSnapshot[applied={T|T < 7317373359689797632}]
I20260811 17:08:25.406621 8810 mvcc.cc:205] Tried to move back new op lower bound from 7317373359689797632 to 7317373359548076032. Current Snapshot: MvccSnapshot[applied={T|T < 7317373359689797632}]
I20260811 17:08:25.407101 8774 tablet_replica.cc:439] T 1bcf790fd94d43d28d3eea49b2f7a15c P 86efb8381af54b1abd808662118f8b34: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b5d0843bd1b14764bc406bb244fe2af4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } } }
I20260811 17:08:25.407238 8774 tablet_replica.cc:442] T 1bcf790fd94d43d28d3eea49b2f7a15c P 86efb8381af54b1abd808662118f8b34: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 17:08:25.409080 8777 tablet_replica.cc:439] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b5d0843bd1b14764bc406bb244fe2af4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } } }
I20260811 17:08:25.409224 8777 tablet_replica.cc:442] T 1bcf790fd94d43d28d3eea49b2f7a15c P b5d0843bd1b14764bc406bb244fe2af4: This TxnStatusTablet replica's current role is: LEADER
I20260811 17:08:25.410624 8775 tablet_replica.cc:439] T 1bcf790fd94d43d28d3eea49b2f7a15c P 75a9e5d1ffbb4491b91fb0620097ebbc: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b5d0843bd1b14764bc406bb244fe2af4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } } }
I20260811 17:08:25.410758 8775 tablet_replica.cc:442] T 1bcf790fd94d43d28d3eea49b2f7a15c P 75a9e5d1ffbb4491b91fb0620097ebbc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 17:08:25.419796 8751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:25.415393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36868 (local address 127.4.146.195:35507)
0811 17:08:25.415522 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:25.415527 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:25.415542 (+ 15us) server_negotiation.cc:407] Connection header received
0811 17:08:25.415667 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:25.415670 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:25.415735 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:25.415851 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:08:25.416198 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.416705 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.418118 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.418435 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.418552 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:25.418815 (+ 263us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:08:25.419390 (+ 575us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:08:25.419512 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:25.419560 (+ 48us) server_negotiation.cc:299] Negotiation successful
0811 17:08:25.419621 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 17:08:25.432206 8756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:25.428250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:51833 (local address 127.4.146.194:35749)
0811 17:08:25.428382 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:25.428387 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:25.428528 (+ 141us) server_negotiation.cc:407] Connection header received
0811 17:08:25.428647 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:25.428650 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:25.428706 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:25.428793 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:08:25.429117 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.429903 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.430861 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.431221 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.431329 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:25.431639 (+ 310us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:08:25.431734 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:08:25.431826 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:25.431964 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 17:08:25.432025 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 17:08:25.432237 8830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:25.428077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:35749 (local address 127.4.146.195:51833)
0811 17:08:25.428438 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:25.428452 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:25.428548 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:25.428839 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:25.428843 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:25.428851 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 17:08:25.429001 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:25.429006 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.430087 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.430091 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:25.430735 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:25.430744 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.431354 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.431357 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:25.431424 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:25.431475 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 17:08:25.431851 (+ 376us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 17:08:25.431860 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 17:08:25.431928 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 17:08:25.432006 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":141,"threads_started":1}
I20260811 17:08:25.440424 8121 raft_consensus.cc:1261] T 091e7fbd21a74da6b9091382bb1fbaf2 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 1 FOLLOWER]: Refusing update from remote peer 86efb8381af54b1abd808662118f8b34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:08:25.440668 8377 raft_consensus.cc:1261] T 091e7fbd21a74da6b9091382bb1fbaf2 P b5d0843bd1b14764bc406bb244fe2af4 [term 1 FOLLOWER]: Refusing update from remote peer 86efb8381af54b1abd808662118f8b34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:08:25.441329 8782 consensus_queue.cc:1035] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:08:25.441725 8774 consensus_queue.cc:1035] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:08:25.449517 8811 mvcc.cc:205] Tried to move back new op lower bound from 7317373359879442432 to 7317373358828638208. Current Snapshot: MvccSnapshot[applied={T|T < 7317373359879442432}]
I20260811 17:08:25.466570 8751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:25.462666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:36189 (local address 127.4.146.195:35507)
0811 17:08:25.462786 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:25.462790 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:25.463010 (+ 220us) server_negotiation.cc:407] Connection header received
0811 17:08:25.463104 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:25.463108 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:25.463164 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:25.463248 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:08:25.463542 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.464312 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.465387 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.465624 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.465737 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:25.466058 (+ 321us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:08:25.466175 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:08:25.466263 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:25.466356 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 17:08:25.466412 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 17:08:25.466571 8841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:25.462571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:35507 (local address 127.4.146.194:36189)
0811 17:08:25.462919 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:25.462933 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:25.463027 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:25.463279 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:25.463282 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:25.463290 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 17:08:25.463416 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:25.463424 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.464424 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.464430 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:25.465256 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:25.465267 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:25.465740 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:25.465744 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:25.465837 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:25.465887 (+ 50us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 17:08:25.466267 (+ 380us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 17:08:25.466276 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 17:08:25.466346 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 17:08:25.466431 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":124,"threads_started":1}
I20260811 17:08:25.500725 7846 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:08:25.500952 7846 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:08:25.504192 7846 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c: Sending DeleteTablet for 3 replicas of tablet 091e7fbd21a74da6b9091382bb1fbaf2
I20260811 17:08:25.505599 8088 tablet_service.cc:1514] Processing DeleteTablet for tablet 091e7fbd21a74da6b9091382bb1fbaf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:25 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:37494
I20260811 17:08:25.505777 7846 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35360:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 17:08:25.506124 8563 tablet_service.cc:1514] Processing DeleteTablet for tablet 091e7fbd21a74da6b9091382bb1fbaf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:25 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:36852
W20260811 17:08:25.506210 7846 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:08:25.506897 8346 tablet_service.cc:1514] Processing DeleteTablet for tablet 091e7fbd21a74da6b9091382bb1fbaf2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:25 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:46800
I20260811 17:08:25.507504 8852 tablet_replica.cc:330] T 091e7fbd21a74da6b9091382bb1fbaf2 P 75a9e5d1ffbb4491b91fb0620097ebbc: stopping tablet replica
I20260811 17:08:25.507797 8853 tablet_replica.cc:330] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34: stopping tablet replica
I20260811 17:08:25.508041 8854 tablet_replica.cc:330] T 091e7fbd21a74da6b9091382bb1fbaf2 P b5d0843bd1b14764bc406bb244fe2af4: stopping tablet replica
I20260811 17:08:25.508493 8854 raft_consensus.cc:2229] T 091e7fbd21a74da6b9091382bb1fbaf2 P b5d0843bd1b14764bc406bb244fe2af4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:08:25.508906 8852 raft_consensus.cc:2229] T 091e7fbd21a74da6b9091382bb1fbaf2 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:08:25.509281 8853 raft_consensus.cc:2229] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34 [term 1 LEADER]: Raft consensus shutting down.
I20260811 17:08:25.509792 8853 raft_consensus.cc:2258] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:25.510097 8852 raft_consensus.cc:2258] T 091e7fbd21a74da6b9091382bb1fbaf2 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:25.510335 8854 raft_consensus.cc:2258] T 091e7fbd21a74da6b9091382bb1fbaf2 P b5d0843bd1b14764bc406bb244fe2af4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:25.511616 8088 tablet_service.cc:1467] Processing CreateTablet for tablet 35006b352784451bbf119a3bc11cb2e6 (DEFAULT_TABLE table=test-table [id=607989dcd6af4a1582e1cdf644e5b671]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:25.511950 8088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35006b352784451bbf119a3bc11cb2e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:25.512369 8346 tablet_service.cc:1467] Processing CreateTablet for tablet 35006b352784451bbf119a3bc11cb2e6 (DEFAULT_TABLE table=test-table [id=607989dcd6af4a1582e1cdf644e5b671]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:25.512656 8346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35006b352784451bbf119a3bc11cb2e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:25.514923 8563 tablet_service.cc:1467] Processing CreateTablet for tablet 35006b352784451bbf119a3bc11cb2e6 (DEFAULT_TABLE table=test-table [id=607989dcd6af4a1582e1cdf644e5b671]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:25.515224 8563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35006b352784451bbf119a3bc11cb2e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:25.515627 8767 tablet_bootstrap.cc:492] T 35006b352784451bbf119a3bc11cb2e6 P b5d0843bd1b14764bc406bb244fe2af4: Bootstrap starting.
I20260811 17:08:25.516801 8767 tablet_bootstrap.cc:654] T 35006b352784451bbf119a3bc11cb2e6 P b5d0843bd1b14764bc406bb244fe2af4: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:25.517772 8761 tablet_bootstrap.cc:492] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34: Bootstrap starting.
I20260811 17:08:25.518818 8761 tablet_bootstrap.cc:654] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:25.519476 8767 tablet_bootstrap.cc:492] T 35006b352784451bbf119a3bc11cb2e6 P b5d0843bd1b14764bc406bb244fe2af4: No bootstrap required, opened a new log
I20260811 17:08:25.519572 8767 ts_tablet_manager.cc:1397] T 35006b352784451bbf119a3bc11cb2e6 P b5d0843bd1b14764bc406bb244fe2af4: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260811 17:08:25.520063 8767 raft_consensus.cc:348] T 35006b352784451bbf119a3bc11cb2e6 P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:25.520226 8767 raft_consensus.cc:374] T 35006b352784451bbf119a3bc11cb2e6 P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:25.520267 8767 raft_consensus.cc:729] T 35006b352784451bbf119a3bc11cb2e6 P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5d0843bd1b14764bc406bb244fe2af4, State: Initialized, Role: FOLLOWER
I20260811 17:08:25.520399 8767 consensus_queue.cc:260] T 35006b352784451bbf119a3bc11cb2e6 P b5d0843bd1b14764bc406bb244fe2af4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:25.520689 8767 ts_tablet_manager.cc:1428] T 35006b352784451bbf119a3bc11cb2e6 P b5d0843bd1b14764bc406bb244fe2af4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 17:08:25.520766 8762 tablet_bootstrap.cc:492] T 35006b352784451bbf119a3bc11cb2e6 P 75a9e5d1ffbb4491b91fb0620097ebbc: Bootstrap starting.
I20260811 17:08:25.521713 8762 tablet_bootstrap.cc:654] T 35006b352784451bbf119a3bc11cb2e6 P 75a9e5d1ffbb4491b91fb0620097ebbc: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:25.524370 8854 ts_tablet_manager.cc:1905] T 091e7fbd21a74da6b9091382bb1fbaf2 P b5d0843bd1b14764bc406bb244fe2af4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:25.525985 8761 tablet_bootstrap.cc:492] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34: No bootstrap required, opened a new log
I20260811 17:08:25.526146 8761 ts_tablet_manager.cc:1397] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20260811 17:08:25.526682 8761 raft_consensus.cc:348] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:25.526841 8761 raft_consensus.cc:374] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:25.526885 8761 raft_consensus.cc:729] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86efb8381af54b1abd808662118f8b34, State: Initialized, Role: FOLLOWER
I20260811 17:08:25.527019 8761 consensus_queue.cc:260] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:25.527256 8853 ts_tablet_manager.cc:1905] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:25.527325 8761 ts_tablet_manager.cc:1428] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 17:08:25.527261 8852 ts_tablet_manager.cc:1905] T 091e7fbd21a74da6b9091382bb1fbaf2 P 75a9e5d1ffbb4491b91fb0620097ebbc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:25.528955 8762 tablet_bootstrap.cc:492] T 35006b352784451bbf119a3bc11cb2e6 P 75a9e5d1ffbb4491b91fb0620097ebbc: No bootstrap required, opened a new log
I20260811 17:08:25.529070 8762 ts_tablet_manager.cc:1397] T 35006b352784451bbf119a3bc11cb2e6 P 75a9e5d1ffbb4491b91fb0620097ebbc: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20260811 17:08:25.529659 8762 raft_consensus.cc:348] T 35006b352784451bbf119a3bc11cb2e6 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:25.529793 8762 raft_consensus.cc:374] T 35006b352784451bbf119a3bc11cb2e6 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:25.529839 8762 raft_consensus.cc:729] T 35006b352784451bbf119a3bc11cb2e6 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75a9e5d1ffbb4491b91fb0620097ebbc, State: Initialized, Role: FOLLOWER
I20260811 17:08:25.530081 8762 consensus_queue.cc:260] T 35006b352784451bbf119a3bc11cb2e6 P 75a9e5d1ffbb4491b91fb0620097ebbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:25.531484 8762 ts_tablet_manager.cc:1428] T 35006b352784451bbf119a3bc11cb2e6 P 75a9e5d1ffbb4491b91fb0620097ebbc: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260811 17:08:25.532205 8853 ts_tablet_manager.cc:1918] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 17:08:25.532344 8853 log.cc:1196] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/091e7fbd21a74da6b9091382bb1fbaf2
I20260811 17:08:25.532753 8853 ts_tablet_manager.cc:1939] T 091e7fbd21a74da6b9091382bb1fbaf2 P 86efb8381af54b1abd808662118f8b34: Deleting consensus metadata
I20260811 17:08:25.534266 7816 catalog_manager.cc:4841] TS 86efb8381af54b1abd808662118f8b34 (127.4.146.195:35507): tablet 091e7fbd21a74da6b9091382bb1fbaf2 (table test-table [id=b7b1d17f81a446aaafe8efe549015e70]) successfully deleted
I20260811 17:08:25.537513 8854 ts_tablet_manager.cc:1918] T 091e7fbd21a74da6b9091382bb1fbaf2 P b5d0843bd1b14764bc406bb244fe2af4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 17:08:25.539690 8852 ts_tablet_manager.cc:1918] T 091e7fbd21a74da6b9091382bb1fbaf2 P 75a9e5d1ffbb4491b91fb0620097ebbc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 17:08:25.539930 8854 log.cc:1196] T 091e7fbd21a74da6b9091382bb1fbaf2 P b5d0843bd1b14764bc406bb244fe2af4: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-1/wal/wals/091e7fbd21a74da6b9091382bb1fbaf2
I20260811 17:08:25.540446 8854 ts_tablet_manager.cc:1939] T 091e7fbd21a74da6b9091382bb1fbaf2 P b5d0843bd1b14764bc406bb244fe2af4: Deleting consensus metadata
I20260811 17:08:25.540071 8852 log.cc:1196] T 091e7fbd21a74da6b9091382bb1fbaf2 P 75a9e5d1ffbb4491b91fb0620097ebbc: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-0/wal/wals/091e7fbd21a74da6b9091382bb1fbaf2
I20260811 17:08:25.540911 8852 ts_tablet_manager.cc:1939] T 091e7fbd21a74da6b9091382bb1fbaf2 P 75a9e5d1ffbb4491b91fb0620097ebbc: Deleting consensus metadata
I20260811 17:08:25.542392 7816 catalog_manager.cc:4841] TS b5d0843bd1b14764bc406bb244fe2af4 (127.4.146.194:35749): tablet 091e7fbd21a74da6b9091382bb1fbaf2 (table test-table [id=b7b1d17f81a446aaafe8efe549015e70]) successfully deleted
I20260811 17:08:25.543491 7816 catalog_manager.cc:4841] TS 75a9e5d1ffbb4491b91fb0620097ebbc (127.4.146.193:41559): tablet 091e7fbd21a74da6b9091382bb1fbaf2 (table test-table [id=b7b1d17f81a446aaafe8efe549015e70]) successfully deleted
I20260811 17:08:25.602046 8774 raft_consensus.cc:482] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:08:25.602222 8774 raft_consensus.cc:504] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:25.602695 8774 leader_election.cc:288] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75a9e5d1ffbb4491b91fb0620097ebbc (127.4.146.193:41559), b5d0843bd1b14764bc406bb244fe2af4 (127.4.146.194:35749)
I20260811 17:08:25.603268 8121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35006b352784451bbf119a3bc11cb2e6" candidate_uuid: "86efb8381af54b1abd808662118f8b34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" is_pre_election: true
I20260811 17:08:25.603284 8376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35006b352784451bbf119a3bc11cb2e6" candidate_uuid: "86efb8381af54b1abd808662118f8b34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5d0843bd1b14764bc406bb244fe2af4" is_pre_election: true
I20260811 17:08:25.603446 8121 raft_consensus.cc:2454] T 35006b352784451bbf119a3bc11cb2e6 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86efb8381af54b1abd808662118f8b34 in term 0.
I20260811 17:08:25.603464 8376 raft_consensus.cc:2454] T 35006b352784451bbf119a3bc11cb2e6 P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86efb8381af54b1abd808662118f8b34 in term 0.
I20260811 17:08:25.603866 8504 leader_election.cc:302] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75a9e5d1ffbb4491b91fb0620097ebbc, 86efb8381af54b1abd808662118f8b34; no voters:
I20260811 17:08:25.604103 8774 raft_consensus.cc:2781] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:08:25.604171 8774 raft_consensus.cc:482] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:08:25.604223 8774 raft_consensus.cc:3037] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:25.605319 8774 raft_consensus.cc:504] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:25.605670 8774 leader_election.cc:288] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34 [CANDIDATE]: Term 1 election: Requested vote from peers 75a9e5d1ffbb4491b91fb0620097ebbc (127.4.146.193:41559), b5d0843bd1b14764bc406bb244fe2af4 (127.4.146.194:35749)
I20260811 17:08:25.606133 8376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35006b352784451bbf119a3bc11cb2e6" candidate_uuid: "86efb8381af54b1abd808662118f8b34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5d0843bd1b14764bc406bb244fe2af4"
I20260811 17:08:25.606153 8121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35006b352784451bbf119a3bc11cb2e6" candidate_uuid: "86efb8381af54b1abd808662118f8b34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc"
I20260811 17:08:25.606278 8121 raft_consensus.cc:3037] T 35006b352784451bbf119a3bc11cb2e6 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:25.606277 8376 raft_consensus.cc:3037] T 35006b352784451bbf119a3bc11cb2e6 P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:25.607259 8376 raft_consensus.cc:2454] T 35006b352784451bbf119a3bc11cb2e6 P b5d0843bd1b14764bc406bb244fe2af4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86efb8381af54b1abd808662118f8b34 in term 1.
I20260811 17:08:25.607486 8121 raft_consensus.cc:2454] T 35006b352784451bbf119a3bc11cb2e6 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86efb8381af54b1abd808662118f8b34 in term 1.
I20260811 17:08:25.607594 8504 leader_election.cc:302] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 86efb8381af54b1abd808662118f8b34, b5d0843bd1b14764bc406bb244fe2af4; no voters:
I20260811 17:08:25.607869 8774 raft_consensus.cc:2781] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:25.607981 8774 raft_consensus.cc:686] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34 [term 1 LEADER]: Becoming Leader. State: Replica: 86efb8381af54b1abd808662118f8b34, State: Running, Role: LEADER
I20260811 17:08:25.608153 8774 consensus_queue.cc:237] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:25.609988 7846 catalog_manager.cc:5495] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86efb8381af54b1abd808662118f8b34 (127.4.146.195). New cstate: current_term: 1 leader_uuid: "86efb8381af54b1abd808662118f8b34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } health_report { overall_health: HEALTHY } } }
I20260811 17:08:25.639067 8121 raft_consensus.cc:1261] T 35006b352784451bbf119a3bc11cb2e6 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 1 FOLLOWER]: Refusing update from remote peer 86efb8381af54b1abd808662118f8b34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:08:25.639636 8376 raft_consensus.cc:1261] T 35006b352784451bbf119a3bc11cb2e6 P b5d0843bd1b14764bc406bb244fe2af4 [term 1 FOLLOWER]: Refusing update from remote peer 86efb8381af54b1abd808662118f8b34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:08:25.639900 8782 consensus_queue.cc:1035] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:08:25.640162 8845 consensus_queue.cc:1035] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 17:08:25.656284 8810 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 17:08:27.218465 7844 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:08:27.218644 7844 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:08:27.221686 7844 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c: Sending DeleteTablet for 3 replicas of tablet 35006b352784451bbf119a3bc11cb2e6
I20260811 17:08:27.222538 8088 tablet_service.cc:1514] Processing DeleteTablet for tablet 35006b352784451bbf119a3bc11cb2e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:27 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:37494
I20260811 17:08:27.222610 8346 tablet_service.cc:1514] Processing DeleteTablet for tablet 35006b352784451bbf119a3bc11cb2e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:27 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:46800
I20260811 17:08:27.222728 8563 tablet_service.cc:1514] Processing DeleteTablet for tablet 35006b352784451bbf119a3bc11cb2e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:27 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:36852
I20260811 17:08:27.222992 8920 tablet_replica.cc:330] T 35006b352784451bbf119a3bc11cb2e6 P 75a9e5d1ffbb4491b91fb0620097ebbc: stopping tablet replica
I20260811 17:08:27.223150 8921 tablet_replica.cc:330] T 35006b352784451bbf119a3bc11cb2e6 P b5d0843bd1b14764bc406bb244fe2af4: stopping tablet replica
I20260811 17:08:27.223229 8920 raft_consensus.cc:2229] T 35006b352784451bbf119a3bc11cb2e6 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:08:27.223340 8921 raft_consensus.cc:2229] T 35006b352784451bbf119a3bc11cb2e6 P b5d0843bd1b14764bc406bb244fe2af4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:08:27.223436 8920 raft_consensus.cc:2258] T 35006b352784451bbf119a3bc11cb2e6 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:27.223549 8921 raft_consensus.cc:2258] T 35006b352784451bbf119a3bc11cb2e6 P b5d0843bd1b14764bc406bb244fe2af4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:27.223867 8923 tablet_replica.cc:330] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34: stopping tablet replica
I20260811 17:08:27.224085 8923 raft_consensus.cc:2229] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34 [term 1 LEADER]: Raft consensus shutting down.
I20260811 17:08:27.224337 8920 ts_tablet_manager.cc:1905] T 35006b352784451bbf119a3bc11cb2e6 P 75a9e5d1ffbb4491b91fb0620097ebbc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:27.224422 8923 raft_consensus.cc:2258] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:27.225211 8921 ts_tablet_manager.cc:1905] T 35006b352784451bbf119a3bc11cb2e6 P b5d0843bd1b14764bc406bb244fe2af4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:27.227236 8923 ts_tablet_manager.cc:1905] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:27.227689 8920 ts_tablet_manager.cc:1918] T 35006b352784451bbf119a3bc11cb2e6 P 75a9e5d1ffbb4491b91fb0620097ebbc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 17:08:27.227840 8920 log.cc:1196] T 35006b352784451bbf119a3bc11cb2e6 P 75a9e5d1ffbb4491b91fb0620097ebbc: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-0/wal/wals/35006b352784451bbf119a3bc11cb2e6
I20260811 17:08:27.228268 8920 ts_tablet_manager.cc:1939] T 35006b352784451bbf119a3bc11cb2e6 P 75a9e5d1ffbb4491b91fb0620097ebbc: Deleting consensus metadata
I20260811 17:08:27.228577 8921 ts_tablet_manager.cc:1918] T 35006b352784451bbf119a3bc11cb2e6 P b5d0843bd1b14764bc406bb244fe2af4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 17:08:27.228718 8921 log.cc:1196] T 35006b352784451bbf119a3bc11cb2e6 P b5d0843bd1b14764bc406bb244fe2af4: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-1/wal/wals/35006b352784451bbf119a3bc11cb2e6
I20260811 17:08:27.229084 8921 ts_tablet_manager.cc:1939] T 35006b352784451bbf119a3bc11cb2e6 P b5d0843bd1b14764bc406bb244fe2af4: Deleting consensus metadata
I20260811 17:08:27.229276 7816 catalog_manager.cc:4841] TS 75a9e5d1ffbb4491b91fb0620097ebbc (127.4.146.193:41559): tablet 35006b352784451bbf119a3bc11cb2e6 (table test-table [id=607989dcd6af4a1582e1cdf644e5b671]) successfully deleted
I20260811 17:08:27.229970 7816 catalog_manager.cc:4841] TS b5d0843bd1b14764bc406bb244fe2af4 (127.4.146.194:35749): tablet 35006b352784451bbf119a3bc11cb2e6 (table test-table [id=607989dcd6af4a1582e1cdf644e5b671]) successfully deleted
I20260811 17:08:27.230907 8923 ts_tablet_manager.cc:1918] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 17:08:27.231467 8923 log.cc:1196] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/35006b352784451bbf119a3bc11cb2e6
I20260811 17:08:27.231809 8923 ts_tablet_manager.cc:1939] T 35006b352784451bbf119a3bc11cb2e6 P 86efb8381af54b1abd808662118f8b34: Deleting consensus metadata
I20260811 17:08:27.232627 7816 catalog_manager.cc:4841] TS 86efb8381af54b1abd808662118f8b34 (127.4.146.195:35507): tablet 35006b352784451bbf119a3bc11cb2e6 (table test-table [id=607989dcd6af4a1582e1cdf644e5b671]) successfully deleted
Aug 11 17:08:27 dist-test-slave-7vjv krb5kdc[7754](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468107, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 17:08:27 dist-test-slave-7vjv krb5kdc[7754](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468107, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:27.257133 8944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:27.247133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35370 (local address 127.4.146.254:33671)
0811 17:08:27.247479 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:27.247486 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:27.247506 (+ 20us) server_negotiation.cc:407] Connection header received
0811 17:08:27.247583 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:27.247586 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:27.247629 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:27.247721 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:27.248673 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:27.249277 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:27.250306 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:27.250574 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:27.250674 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:27.253350 (+ 2676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:27.253353 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:27.253355 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:27.253385 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:27.255080 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:27.255557 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:27.255563 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:27.255564 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:27.255681 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:27.256127 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:27.256131 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:27.256133 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:27.256388 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:27.256553 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:27.256799 (+ 246us) server_negotiation.cc:299] Negotiation successful
0811 17:08:27.256943 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":149,"threads_started":1}
I20260811 17:08:27.259861 7844 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35370:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 17:08:27.260370 7844 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:08:27.265622 8088 tablet_service.cc:1467] Processing CreateTablet for tablet 125c223f941944729b58f57353a6c2fa (DEFAULT_TABLE table=test-table [id=2c164e862a2a44efaa8e4a0c20b32bfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:27.265651 8346 tablet_service.cc:1467] Processing CreateTablet for tablet 125c223f941944729b58f57353a6c2fa (DEFAULT_TABLE table=test-table [id=2c164e862a2a44efaa8e4a0c20b32bfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:27.265724 8563 tablet_service.cc:1467] Processing CreateTablet for tablet 125c223f941944729b58f57353a6c2fa (DEFAULT_TABLE table=test-table [id=2c164e862a2a44efaa8e4a0c20b32bfa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:27.265977 8088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 125c223f941944729b58f57353a6c2fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:27.265992 8563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 125c223f941944729b58f57353a6c2fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:27.265977 8346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 125c223f941944729b58f57353a6c2fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:27.268816 8945 tablet_bootstrap.cc:492] T 125c223f941944729b58f57353a6c2fa P 86efb8381af54b1abd808662118f8b34: Bootstrap starting.
I20260811 17:08:27.268841 8947 tablet_bootstrap.cc:492] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc: Bootstrap starting.
I20260811 17:08:27.268841 8948 tablet_bootstrap.cc:492] T 125c223f941944729b58f57353a6c2fa P b5d0843bd1b14764bc406bb244fe2af4: Bootstrap starting.
I20260811 17:08:27.269666 8945 tablet_bootstrap.cc:654] T 125c223f941944729b58f57353a6c2fa P 86efb8381af54b1abd808662118f8b34: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:27.269893 8948 tablet_bootstrap.cc:654] T 125c223f941944729b58f57353a6c2fa P b5d0843bd1b14764bc406bb244fe2af4: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:27.269886 8947 tablet_bootstrap.cc:654] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:27.270942 8945 tablet_bootstrap.cc:492] T 125c223f941944729b58f57353a6c2fa P 86efb8381af54b1abd808662118f8b34: No bootstrap required, opened a new log
I20260811 17:08:27.271049 8945 ts_tablet_manager.cc:1397] T 125c223f941944729b58f57353a6c2fa P 86efb8381af54b1abd808662118f8b34: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 17:08:27.271543 8945 raft_consensus.cc:348] T 125c223f941944729b58f57353a6c2fa P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:27.271631 8947 tablet_bootstrap.cc:492] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc: No bootstrap required, opened a new log
I20260811 17:08:27.271678 8945 raft_consensus.cc:374] T 125c223f941944729b58f57353a6c2fa P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:27.271718 8947 ts_tablet_manager.cc:1397] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 17:08:27.271724 8945 raft_consensus.cc:729] T 125c223f941944729b58f57353a6c2fa P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86efb8381af54b1abd808662118f8b34, State: Initialized, Role: FOLLOWER
I20260811 17:08:27.271864 8945 consensus_queue.cc:260] T 125c223f941944729b58f57353a6c2fa P 86efb8381af54b1abd808662118f8b34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:27.272063 8948 tablet_bootstrap.cc:492] T 125c223f941944729b58f57353a6c2fa P b5d0843bd1b14764bc406bb244fe2af4: No bootstrap required, opened a new log
I20260811 17:08:27.272185 8948 ts_tablet_manager.cc:1397] T 125c223f941944729b58f57353a6c2fa P b5d0843bd1b14764bc406bb244fe2af4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 17:08:27.272193 8945 ts_tablet_manager.cc:1428] T 125c223f941944729b58f57353a6c2fa P 86efb8381af54b1abd808662118f8b34: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 17:08:27.272241 8947 raft_consensus.cc:348] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:27.272357 8947 raft_consensus.cc:374] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:27.272396 8947 raft_consensus.cc:729] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75a9e5d1ffbb4491b91fb0620097ebbc, State: Initialized, Role: FOLLOWER
I20260811 17:08:27.272514 8947 consensus_queue.cc:260] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:27.272619 8948 raft_consensus.cc:348] T 125c223f941944729b58f57353a6c2fa P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:27.272745 8948 raft_consensus.cc:374] T 125c223f941944729b58f57353a6c2fa P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:27.272779 8948 raft_consensus.cc:729] T 125c223f941944729b58f57353a6c2fa P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5d0843bd1b14764bc406bb244fe2af4, State: Initialized, Role: FOLLOWER
I20260811 17:08:27.272904 8948 consensus_queue.cc:260] T 125c223f941944729b58f57353a6c2fa P b5d0843bd1b14764bc406bb244fe2af4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:27.273149 8947 ts_tablet_manager.cc:1428] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 17:08:27.273197 8948 ts_tablet_manager.cc:1428] T 125c223f941944729b58f57353a6c2fa P b5d0843bd1b14764bc406bb244fe2af4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 17:08:27.579216 8956 raft_consensus.cc:482] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:08:27.579489 8956 raft_consensus.cc:504] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:27.581044 8956 leader_election.cc:288] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5d0843bd1b14764bc406bb244fe2af4 (127.4.146.194:35749), 86efb8381af54b1abd808662118f8b34 (127.4.146.195:35507)
I20260811 17:08:27.587215 8965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:27.582184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:41879 (local address 127.4.146.195:35507)
0811 17:08:27.582545 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:27.582553 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:27.582567 (+ 14us) server_negotiation.cc:407] Connection header received
0811 17:08:27.582646 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:27.582652 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:27.582709 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:27.582838 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:27.583134 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:27.583934 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:27.585579 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:27.586234 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:27.586371 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:27.586430 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:27.586966 (+ 536us) server_negotiation.cc:299] Negotiation successful
0811 17:08:27.587063 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":133,"threads_started":1}
I20260811 17:08:27.587215 8959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:27.581596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:38189 (local address 127.4.146.194:35749)
0811 17:08:27.581984 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:27.581998 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:27.582026 (+ 28us) server_negotiation.cc:407] Connection header received
0811 17:08:27.582110 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:27.582114 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:27.582177 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:27.582310 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:27.582699 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:27.583623 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:27.585579 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:27.586227 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:27.586371 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:27.586430 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:27.587003 (+ 573us) server_negotiation.cc:299] Negotiation successful
0811 17:08:27.587087 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":159,"threads_started":1}
I20260811 17:08:27.587253 8963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:27.582046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:35507 (local address 127.4.146.193:41879)
0811 17:08:27.582380 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:27.582395 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:27.582497 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:27.582848 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:27.582850 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:27.582870 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:27.582994 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:27.583000 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:27.584062 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:27.584066 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:27.585394 (+ 1328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:27.585407 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:27.586407 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:27.586413 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:27.586693 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:27.586816 (+ 123us) client_negotiation.cc:769] Sending connection context
0811 17:08:27.586916 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 17:08:27.587013 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"mutex_wait_us":160,"thread_start_us":135,"threads_started":1}
I20260811 17:08:27.587258 8958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:27.581493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:35749 (local address 127.4.146.193:38189)
0811 17:08:27.581859 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:27.581880 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:27.582005 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:27.582365 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:27.582369 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:27.582394 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:27.582558 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:27.582567 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:27.583771 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:27.583774 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:27.585410 (+ 1636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:27.585417 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:27.586407 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:27.586413 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:27.586667 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:27.586805 (+ 138us) client_negotiation.cc:769] Sending connection context
0811 17:08:27.586916 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 17:08:27.587021 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"mutex_wait_us":139,"thread_start_us":158,"threads_started":1}
I20260811 17:08:27.587889 8376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "125c223f941944729b58f57353a6c2fa" candidate_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5d0843bd1b14764bc406bb244fe2af4" is_pre_election: true
I20260811 17:08:27.587908 8612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "125c223f941944729b58f57353a6c2fa" candidate_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86efb8381af54b1abd808662118f8b34" is_pre_election: true
I20260811 17:08:27.588038 8376 raft_consensus.cc:2454] T 125c223f941944729b58f57353a6c2fa P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75a9e5d1ffbb4491b91fb0620097ebbc in term 0.
I20260811 17:08:27.588160 8612 raft_consensus.cc:2454] T 125c223f941944729b58f57353a6c2fa P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75a9e5d1ffbb4491b91fb0620097ebbc in term 0.
I20260811 17:08:27.588521 7999 leader_election.cc:302] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75a9e5d1ffbb4491b91fb0620097ebbc, b5d0843bd1b14764bc406bb244fe2af4; no voters:
I20260811 17:08:27.588824 8956 raft_consensus.cc:2781] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:08:27.588898 8956 raft_consensus.cc:482] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:08:27.588929 8956 raft_consensus.cc:3037] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:27.590341 8956 raft_consensus.cc:504] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:27.590792 8956 leader_election.cc:288] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc [CANDIDATE]: Term 1 election: Requested vote from peers b5d0843bd1b14764bc406bb244fe2af4 (127.4.146.194:35749), 86efb8381af54b1abd808662118f8b34 (127.4.146.195:35507)
I20260811 17:08:27.591401 8376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "125c223f941944729b58f57353a6c2fa" candidate_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5d0843bd1b14764bc406bb244fe2af4"
I20260811 17:08:27.591490 8612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "125c223f941944729b58f57353a6c2fa" candidate_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86efb8381af54b1abd808662118f8b34"
I20260811 17:08:27.591595 8376 raft_consensus.cc:3037] T 125c223f941944729b58f57353a6c2fa P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:27.591657 8612 raft_consensus.cc:3037] T 125c223f941944729b58f57353a6c2fa P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:27.592963 8612 raft_consensus.cc:2454] T 125c223f941944729b58f57353a6c2fa P 86efb8381af54b1abd808662118f8b34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75a9e5d1ffbb4491b91fb0620097ebbc in term 1.
I20260811 17:08:27.592989 8376 raft_consensus.cc:2454] T 125c223f941944729b58f57353a6c2fa P b5d0843bd1b14764bc406bb244fe2af4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75a9e5d1ffbb4491b91fb0620097ebbc in term 1.
I20260811 17:08:27.593335 7999 leader_election.cc:302] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75a9e5d1ffbb4491b91fb0620097ebbc, 86efb8381af54b1abd808662118f8b34; no voters:
I20260811 17:08:27.593537 8956 raft_consensus.cc:2781] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:27.593863 8956 raft_consensus.cc:686] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc [term 1 LEADER]: Becoming Leader. State: Replica: 75a9e5d1ffbb4491b91fb0620097ebbc, State: Running, Role: LEADER
I20260811 17:08:27.594234 8956 consensus_queue.cc:237] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:27.597178 7845 catalog_manager.cc:5495] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc reported cstate change: term changed from 0 to 1, leader changed from <none> to 75a9e5d1ffbb4491b91fb0620097ebbc (127.4.146.193). New cstate: current_term: 1 leader_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } health_report { overall_health: UNKNOWN } } }
I20260811 17:08:27.647071 8974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:27.642742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37496 (local address 127.4.146.193:41559)
0811 17:08:27.643066 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:27.643074 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:27.643086 (+ 12us) server_negotiation.cc:407] Connection header received
0811 17:08:27.643194 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:27.643196 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:27.643253 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:27.643398 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:08:27.643679 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:27.644274 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:27.645335 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:27.645586 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:27.645702 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:27.646031 (+ 329us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:08:27.646621 (+ 590us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:08:27.646764 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:27.646826 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 17:08:27.646889 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":104,"threads_started":1}
I20260811 17:08:27.659487 8959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:27.655809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:38535 (local address 127.4.146.194:35749)
0811 17:08:27.655955 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:27.655962 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:27.656171 (+ 209us) server_negotiation.cc:407] Connection header received
0811 17:08:27.656382 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:27.656386 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:27.656444 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:27.656538 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:08:27.656839 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:27.657376 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:27.658308 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:27.658535 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:27.658668 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:27.658998 (+ 330us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:08:27.659087 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:08:27.659170 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:27.659272 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 17:08:27.659329 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 17:08:27.659516 8980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:27.655654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:35749 (local address 127.4.146.193:38535)
0811 17:08:27.656053 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:27.656070 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:27.656261 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:27.656555 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:27.656558 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:27.656568 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 17:08:27.656716 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:27.656722 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:27.657499 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:27.657504 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:27.658175 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:27.658185 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:27.658688 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:27.658692 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:27.658794 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:27.658845 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 17:08:27.659181 (+ 336us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 17:08:27.659190 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 17:08:27.659259 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 17:08:27.659349 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":132,"threads_started":1}
I20260811 17:08:27.666592 8612 raft_consensus.cc:1261] T 125c223f941944729b58f57353a6c2fa P 86efb8381af54b1abd808662118f8b34 [term 1 FOLLOWER]: Refusing update from remote peer 75a9e5d1ffbb4491b91fb0620097ebbc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:08:27.666611 8376 raft_consensus.cc:1261] T 125c223f941944729b58f57353a6c2fa P b5d0843bd1b14764bc406bb244fe2af4 [term 1 FOLLOWER]: Refusing update from remote peer 75a9e5d1ffbb4491b91fb0620097ebbc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:08:27.667177 8968 consensus_queue.cc:1035] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:08:27.667428 8956 consensus_queue.cc:1035] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:08:27.686141 8974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:27.682576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:35169 (local address 127.4.146.193:41559)
0811 17:08:27.682717 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:27.682722 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:27.682906 (+ 184us) server_negotiation.cc:407] Connection header received
0811 17:08:27.683054 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:27.683056 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:27.683099 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:27.683161 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:08:27.683478 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:27.683994 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:27.684900 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:27.685228 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:27.685315 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:27.685635 (+ 320us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:08:27.685709 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:08:27.685791 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:27.685921 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 17:08:27.685977 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 17:08:27.686141 8986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:27.682493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:41559 (local address 127.4.146.194:35169)
0811 17:08:27.682808 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:27.682826 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:27.682948 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:27.683175 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:27.683177 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:27.683183 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 17:08:27.683277 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:27.683281 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:27.684138 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:27.684141 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:27.684777 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:27.684786 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:27.685346 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:27.685350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:27.685446 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:27.685481 (+ 35us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 17:08:27.685801 (+ 320us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 17:08:27.685811 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 17:08:27.685894 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 17:08:27.685986 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":108,"threads_started":1}
I20260811 17:08:27.711410 7846 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:08:27.711663 7846 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:08:27.714280 7846 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c: Sending DeleteTablet for 3 replicas of tablet 125c223f941944729b58f57353a6c2fa
I20260811 17:08:27.715035 8088 tablet_service.cc:1514] Processing DeleteTablet for tablet 125c223f941944729b58f57353a6c2fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:27 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:37494
I20260811 17:08:27.715194 8346 tablet_service.cc:1514] Processing DeleteTablet for tablet 125c223f941944729b58f57353a6c2fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:27 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:46800
I20260811 17:08:27.715265 8920 tablet_replica.cc:330] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc: stopping tablet replica
I20260811 17:08:27.715395 8920 raft_consensus.cc:2229] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc [term 1 LEADER]: Raft consensus shutting down.
I20260811 17:08:27.715401 8921 tablet_replica.cc:330] T 125c223f941944729b58f57353a6c2fa P b5d0843bd1b14764bc406bb244fe2af4: stopping tablet replica
I20260811 17:08:27.715379 8563 tablet_service.cc:1514] Processing DeleteTablet for tablet 125c223f941944729b58f57353a6c2fa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:27 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:36852
I20260811 17:08:27.715539 8921 raft_consensus.cc:2229] T 125c223f941944729b58f57353a6c2fa P b5d0843bd1b14764bc406bb244fe2af4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:08:27.715559 8923 tablet_replica.cc:330] T 125c223f941944729b58f57353a6c2fa P 86efb8381af54b1abd808662118f8b34: stopping tablet replica
I20260811 17:08:27.715667 8921 raft_consensus.cc:2258] T 125c223f941944729b58f57353a6c2fa P b5d0843bd1b14764bc406bb244fe2af4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:27.715663 8923 raft_consensus.cc:2229] T 125c223f941944729b58f57353a6c2fa P 86efb8381af54b1abd808662118f8b34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:08:27.715781 8923 raft_consensus.cc:2258] T 125c223f941944729b58f57353a6c2fa P 86efb8381af54b1abd808662118f8b34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:27.715772 8920 raft_consensus.cc:2258] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:27.716367 7846 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35370:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 17:08:27.716643 8921 ts_tablet_manager.cc:1905] T 125c223f941944729b58f57353a6c2fa P b5d0843bd1b14764bc406bb244fe2af4: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 17:08:27.716830 7846 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:08:27.716966 8923 ts_tablet_manager.cc:1905] T 125c223f941944729b58f57353a6c2fa P 86efb8381af54b1abd808662118f8b34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:27.719028 8920 ts_tablet_manager.cc:1905] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:27.719569 8923 ts_tablet_manager.cc:1918] T 125c223f941944729b58f57353a6c2fa P 86efb8381af54b1abd808662118f8b34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 17:08:27.719569 8921 ts_tablet_manager.cc:1918] T 125c223f941944729b58f57353a6c2fa P b5d0843bd1b14764bc406bb244fe2af4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 17:08:27.719650 8923 log.cc:1196] T 125c223f941944729b58f57353a6c2fa P 86efb8381af54b1abd808662118f8b34: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/125c223f941944729b58f57353a6c2fa
I20260811 17:08:27.719655 8921 log.cc:1196] T 125c223f941944729b58f57353a6c2fa P b5d0843bd1b14764bc406bb244fe2af4: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-1/wal/wals/125c223f941944729b58f57353a6c2fa
I20260811 17:08:27.719952 8923 ts_tablet_manager.cc:1939] T 125c223f941944729b58f57353a6c2fa P 86efb8381af54b1abd808662118f8b34: Deleting consensus metadata
I20260811 17:08:27.719952 8921 ts_tablet_manager.cc:1939] T 125c223f941944729b58f57353a6c2fa P b5d0843bd1b14764bc406bb244fe2af4: Deleting consensus metadata
I20260811 17:08:27.721097 7816 catalog_manager.cc:4841] TS 86efb8381af54b1abd808662118f8b34 (127.4.146.195:35507): tablet 125c223f941944729b58f57353a6c2fa (table test-table [id=2c164e862a2a44efaa8e4a0c20b32bfa]) successfully deleted
I20260811 17:08:27.721657 7816 catalog_manager.cc:4841] TS b5d0843bd1b14764bc406bb244fe2af4 (127.4.146.194:35749): tablet 125c223f941944729b58f57353a6c2fa (table test-table [id=2c164e862a2a44efaa8e4a0c20b32bfa]) successfully deleted
I20260811 17:08:27.721699 8920 ts_tablet_manager.cc:1918] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 17:08:27.721771 8920 log.cc:1196] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-0/wal/wals/125c223f941944729b58f57353a6c2fa
I20260811 17:08:27.722038 8920 ts_tablet_manager.cc:1939] T 125c223f941944729b58f57353a6c2fa P 75a9e5d1ffbb4491b91fb0620097ebbc: Deleting consensus metadata
I20260811 17:08:27.725764 7816 catalog_manager.cc:4841] TS 75a9e5d1ffbb4491b91fb0620097ebbc (127.4.146.193:41559): tablet 125c223f941944729b58f57353a6c2fa (table test-table [id=2c164e862a2a44efaa8e4a0c20b32bfa]) successfully deleted
I20260811 17:08:27.726054 8088 tablet_service.cc:1467] Processing CreateTablet for tablet 7b01746174684f589b3c03a579d7a476 (DEFAULT_TABLE table=test-table [id=929aa4afc1c3498e9f7f82428258ce51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:27.726184 8346 tablet_service.cc:1467] Processing CreateTablet for tablet 7b01746174684f589b3c03a579d7a476 (DEFAULT_TABLE table=test-table [id=929aa4afc1c3498e9f7f82428258ce51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:27.726399 8088 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b01746174684f589b3c03a579d7a476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:27.726480 8346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b01746174684f589b3c03a579d7a476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:27.729059 8947 tablet_bootstrap.cc:492] T 7b01746174684f589b3c03a579d7a476 P 75a9e5d1ffbb4491b91fb0620097ebbc: Bootstrap starting.
I20260811 17:08:27.729882 8563 tablet_service.cc:1467] Processing CreateTablet for tablet 7b01746174684f589b3c03a579d7a476 (DEFAULT_TABLE table=test-table [id=929aa4afc1c3498e9f7f82428258ce51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:27.730077 8948 tablet_bootstrap.cc:492] T 7b01746174684f589b3c03a579d7a476 P b5d0843bd1b14764bc406bb244fe2af4: Bootstrap starting.
I20260811 17:08:27.730161 8947 tablet_bootstrap.cc:654] T 7b01746174684f589b3c03a579d7a476 P 75a9e5d1ffbb4491b91fb0620097ebbc: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:27.730294 8563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b01746174684f589b3c03a579d7a476. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:27.731009 8948 tablet_bootstrap.cc:654] T 7b01746174684f589b3c03a579d7a476 P b5d0843bd1b14764bc406bb244fe2af4: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:27.731510 8947 tablet_bootstrap.cc:492] T 7b01746174684f589b3c03a579d7a476 P 75a9e5d1ffbb4491b91fb0620097ebbc: No bootstrap required, opened a new log
I20260811 17:08:27.731601 8947 ts_tablet_manager.cc:1397] T 7b01746174684f589b3c03a579d7a476 P 75a9e5d1ffbb4491b91fb0620097ebbc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 17:08:27.732173 8947 raft_consensus.cc:348] T 7b01746174684f589b3c03a579d7a476 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:27.732295 8947 raft_consensus.cc:374] T 7b01746174684f589b3c03a579d7a476 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:27.732326 8947 raft_consensus.cc:729] T 7b01746174684f589b3c03a579d7a476 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75a9e5d1ffbb4491b91fb0620097ebbc, State: Initialized, Role: FOLLOWER
I20260811 17:08:27.732451 8947 consensus_queue.cc:260] T 7b01746174684f589b3c03a579d7a476 P 75a9e5d1ffbb4491b91fb0620097ebbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:27.732714 8947 ts_tablet_manager.cc:1428] T 7b01746174684f589b3c03a579d7a476 P 75a9e5d1ffbb4491b91fb0620097ebbc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 17:08:27.733085 8945 tablet_bootstrap.cc:492] T 7b01746174684f589b3c03a579d7a476 P 86efb8381af54b1abd808662118f8b34: Bootstrap starting.
I20260811 17:08:27.734012 8945 tablet_bootstrap.cc:654] T 7b01746174684f589b3c03a579d7a476 P 86efb8381af54b1abd808662118f8b34: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:27.734112 8948 tablet_bootstrap.cc:492] T 7b01746174684f589b3c03a579d7a476 P b5d0843bd1b14764bc406bb244fe2af4: No bootstrap required, opened a new log
I20260811 17:08:27.734206 8948 ts_tablet_manager.cc:1397] T 7b01746174684f589b3c03a579d7a476 P b5d0843bd1b14764bc406bb244fe2af4: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 17:08:27.734700 8948 raft_consensus.cc:348] T 7b01746174684f589b3c03a579d7a476 P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:27.734841 8948 raft_consensus.cc:374] T 7b01746174684f589b3c03a579d7a476 P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:27.734877 8948 raft_consensus.cc:729] T 7b01746174684f589b3c03a579d7a476 P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5d0843bd1b14764bc406bb244fe2af4, State: Initialized, Role: FOLLOWER
I20260811 17:08:27.735020 8948 consensus_queue.cc:260] T 7b01746174684f589b3c03a579d7a476 P b5d0843bd1b14764bc406bb244fe2af4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:27.735198 8945 tablet_bootstrap.cc:492] T 7b01746174684f589b3c03a579d7a476 P 86efb8381af54b1abd808662118f8b34: No bootstrap required, opened a new log
I20260811 17:08:27.735275 8945 ts_tablet_manager.cc:1397] T 7b01746174684f589b3c03a579d7a476 P 86efb8381af54b1abd808662118f8b34: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 17:08:27.735325 8948 ts_tablet_manager.cc:1428] T 7b01746174684f589b3c03a579d7a476 P b5d0843bd1b14764bc406bb244fe2af4: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 17:08:27.735688 8945 raft_consensus.cc:348] T 7b01746174684f589b3c03a579d7a476 P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:27.735807 8945 raft_consensus.cc:374] T 7b01746174684f589b3c03a579d7a476 P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:27.735846 8945 raft_consensus.cc:729] T 7b01746174684f589b3c03a579d7a476 P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86efb8381af54b1abd808662118f8b34, State: Initialized, Role: FOLLOWER
I20260811 17:08:27.735980 8945 consensus_queue.cc:260] T 7b01746174684f589b3c03a579d7a476 P 86efb8381af54b1abd808662118f8b34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:27.736304 8945 ts_tablet_manager.cc:1428] T 7b01746174684f589b3c03a579d7a476 P 86efb8381af54b1abd808662118f8b34: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 17:08:27.955786 8968 raft_consensus.cc:482] T 7b01746174684f589b3c03a579d7a476 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:08:27.955957 8968 raft_consensus.cc:504] T 7b01746174684f589b3c03a579d7a476 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:27.956636 8968 leader_election.cc:288] T 7b01746174684f589b3c03a579d7a476 P 75a9e5d1ffbb4491b91fb0620097ebbc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b5d0843bd1b14764bc406bb244fe2af4 (127.4.146.194:35749), 86efb8381af54b1abd808662118f8b34 (127.4.146.195:35507)
I20260811 17:08:27.957290 8376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b01746174684f589b3c03a579d7a476" candidate_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5d0843bd1b14764bc406bb244fe2af4" is_pre_election: true
I20260811 17:08:27.957267 8612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b01746174684f589b3c03a579d7a476" candidate_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86efb8381af54b1abd808662118f8b34" is_pre_election: true
I20260811 17:08:27.957446 8612 raft_consensus.cc:2454] T 7b01746174684f589b3c03a579d7a476 P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75a9e5d1ffbb4491b91fb0620097ebbc in term 0.
I20260811 17:08:27.957446 8376 raft_consensus.cc:2454] T 7b01746174684f589b3c03a579d7a476 P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75a9e5d1ffbb4491b91fb0620097ebbc in term 0.
I20260811 17:08:27.957823 7999 leader_election.cc:302] T 7b01746174684f589b3c03a579d7a476 P 75a9e5d1ffbb4491b91fb0620097ebbc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75a9e5d1ffbb4491b91fb0620097ebbc, 86efb8381af54b1abd808662118f8b34; no voters:
I20260811 17:08:27.958014 8968 raft_consensus.cc:2781] T 7b01746174684f589b3c03a579d7a476 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:08:27.958078 8968 raft_consensus.cc:482] T 7b01746174684f589b3c03a579d7a476 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:08:27.958120 8968 raft_consensus.cc:3037] T 7b01746174684f589b3c03a579d7a476 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:27.959223 8968 raft_consensus.cc:504] T 7b01746174684f589b3c03a579d7a476 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:27.959574 8968 leader_election.cc:288] T 7b01746174684f589b3c03a579d7a476 P 75a9e5d1ffbb4491b91fb0620097ebbc [CANDIDATE]: Term 1 election: Requested vote from peers b5d0843bd1b14764bc406bb244fe2af4 (127.4.146.194:35749), 86efb8381af54b1abd808662118f8b34 (127.4.146.195:35507)
I20260811 17:08:27.960197 8612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b01746174684f589b3c03a579d7a476" candidate_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "86efb8381af54b1abd808662118f8b34"
I20260811 17:08:27.960180 8376 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b01746174684f589b3c03a579d7a476" candidate_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5d0843bd1b14764bc406bb244fe2af4"
I20260811 17:08:27.960345 8376 raft_consensus.cc:3037] T 7b01746174684f589b3c03a579d7a476 P b5d0843bd1b14764bc406bb244fe2af4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:27.960345 8612 raft_consensus.cc:3037] T 7b01746174684f589b3c03a579d7a476 P 86efb8381af54b1abd808662118f8b34 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:27.961704 8612 raft_consensus.cc:2454] T 7b01746174684f589b3c03a579d7a476 P 86efb8381af54b1abd808662118f8b34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75a9e5d1ffbb4491b91fb0620097ebbc in term 1.
I20260811 17:08:27.961704 8376 raft_consensus.cc:2454] T 7b01746174684f589b3c03a579d7a476 P b5d0843bd1b14764bc406bb244fe2af4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75a9e5d1ffbb4491b91fb0620097ebbc in term 1.
I20260811 17:08:27.962039 7999 leader_election.cc:302] T 7b01746174684f589b3c03a579d7a476 P 75a9e5d1ffbb4491b91fb0620097ebbc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75a9e5d1ffbb4491b91fb0620097ebbc, 86efb8381af54b1abd808662118f8b34; no voters:
I20260811 17:08:27.962260 8968 raft_consensus.cc:2781] T 7b01746174684f589b3c03a579d7a476 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:27.962369 8968 raft_consensus.cc:686] T 7b01746174684f589b3c03a579d7a476 P 75a9e5d1ffbb4491b91fb0620097ebbc [term 1 LEADER]: Becoming Leader. State: Replica: 75a9e5d1ffbb4491b91fb0620097ebbc, State: Running, Role: LEADER
I20260811 17:08:27.962527 8968 consensus_queue.cc:237] T 7b01746174684f589b3c03a579d7a476 P 75a9e5d1ffbb4491b91fb0620097ebbc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } }
I20260811 17:08:27.964499 7846 catalog_manager.cc:5495] T 7b01746174684f589b3c03a579d7a476 P 75a9e5d1ffbb4491b91fb0620097ebbc reported cstate change: term changed from 0 to 1, leader changed from <none> to 75a9e5d1ffbb4491b91fb0620097ebbc (127.4.146.193). New cstate: current_term: 1 leader_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a9e5d1ffbb4491b91fb0620097ebbc" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 41559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 } health_report { overall_health: UNKNOWN } } }
I20260811 17:08:27.983268 8612 raft_consensus.cc:1261] T 7b01746174684f589b3c03a579d7a476 P 86efb8381af54b1abd808662118f8b34 [term 1 FOLLOWER]: Refusing update from remote peer 75a9e5d1ffbb4491b91fb0620097ebbc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:08:27.983423 8376 raft_consensus.cc:1261] T 7b01746174684f589b3c03a579d7a476 P b5d0843bd1b14764bc406bb244fe2af4 [term 1 FOLLOWER]: Refusing update from remote peer 75a9e5d1ffbb4491b91fb0620097ebbc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:08:27.983703 8968 consensus_queue.cc:1035] T 7b01746174684f589b3c03a579d7a476 P 75a9e5d1ffbb4491b91fb0620097ebbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "86efb8381af54b1abd808662118f8b34" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:08:27.983855 8989 consensus_queue.cc:1035] T 7b01746174684f589b3c03a579d7a476 P 75a9e5d1ffbb4491b91fb0620097ebbc [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5d0843bd1b14764bc406bb244fe2af4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 35749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 17:08:27.998394 8879 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 17:08:29.556677 7846 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:08:29.556852 7846 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:08:29.559508 7846 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5bc64f4d4b8249b8ae14213409f2635c: Sending DeleteTablet for 3 replicas of tablet 7b01746174684f589b3c03a579d7a476
I20260811 17:08:29.560194 8088 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b01746174684f589b3c03a579d7a476 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:29 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:37494
I20260811 17:08:29.560210 8346 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b01746174684f589b3c03a579d7a476 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:29 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:46800
I20260811 17:08:29.560295 8563 tablet_service.cc:1514] Processing DeleteTablet for tablet 7b01746174684f589b3c03a579d7a476 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:29 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:36852
I20260811 17:08:29.560678 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 7967
I20260811 17:08:29.570825 9055 tablet_replica.cc:330] T 7b01746174684f589b3c03a579d7a476 P b5d0843bd1b14764bc406bb244fe2af4: stopping tablet replica
I20260811 17:08:29.570974 9055 raft_consensus.cc:2229] T 7b01746174684f589b3c03a579d7a476 P b5d0843bd1b14764bc406bb244fe2af4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:08:29.571092 9055 raft_consensus.cc:2258] T 7b01746174684f589b3c03a579d7a476 P b5d0843bd1b14764bc406bb244fe2af4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:29.572432 9056 tablet_replica.cc:330] T 7b01746174684f589b3c03a579d7a476 P 86efb8381af54b1abd808662118f8b34: stopping tablet replica
I20260811 17:08:29.572582 9056 raft_consensus.cc:2229] T 7b01746174684f589b3c03a579d7a476 P 86efb8381af54b1abd808662118f8b34 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:08:29.572721 9056 raft_consensus.cc:2258] T 7b01746174684f589b3c03a579d7a476 P 86efb8381af54b1abd808662118f8b34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:29.572824 9055 ts_tablet_manager.cc:1905] T 7b01746174684f589b3c03a579d7a476 P b5d0843bd1b14764bc406bb244fe2af4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:29.573431 9056 ts_tablet_manager.cc:1905] T 7b01746174684f589b3c03a579d7a476 P 86efb8381af54b1abd808662118f8b34: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:29.575896 9055 ts_tablet_manager.cc:1918] T 7b01746174684f589b3c03a579d7a476 P b5d0843bd1b14764bc406bb244fe2af4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 17:08:29.575989 9055 log.cc:1196] T 7b01746174684f589b3c03a579d7a476 P b5d0843bd1b14764bc406bb244fe2af4: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-1/wal/wals/7b01746174684f589b3c03a579d7a476
I20260811 17:08:29.576371 9055 ts_tablet_manager.cc:1939] T 7b01746174684f589b3c03a579d7a476 P b5d0843bd1b14764bc406bb244fe2af4: Deleting consensus metadata
I20260811 17:08:29.576576 9056 ts_tablet_manager.cc:1918] T 7b01746174684f589b3c03a579d7a476 P 86efb8381af54b1abd808662118f8b34: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 17:08:29.576700 9056 log.cc:1196] T 7b01746174684f589b3c03a579d7a476 P 86efb8381af54b1abd808662118f8b34: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/7b01746174684f589b3c03a579d7a476
I20260811 17:08:29.576996 9056 ts_tablet_manager.cc:1939] T 7b01746174684f589b3c03a579d7a476 P 86efb8381af54b1abd808662118f8b34: Deleting consensus metadata
I20260811 17:08:29.577399 7816 catalog_manager.cc:4841] TS b5d0843bd1b14764bc406bb244fe2af4 (127.4.146.194:35749): tablet 7b01746174684f589b3c03a579d7a476 (table test-table [id=929aa4afc1c3498e9f7f82428258ce51]) successfully deleted
I20260811 17:08:29.577863 7816 catalog_manager.cc:4841] TS 86efb8381af54b1abd808662118f8b34 (127.4.146.195:35507): tablet 7b01746174684f589b3c03a579d7a476 (table test-table [id=929aa4afc1c3498e9f7f82428258ce51]) successfully deleted
W20260811 17:08:29.582185 7816 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.146.193:41559 (error 108)
I20260811 17:08:29.582463 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 8226
I20260811 17:08:29.598531 9058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:29.595915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:41559 (local address 127.0.0.1:48320)
0811 17:08:29.598214 (+ 2299us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:29.598350 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.193:41559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2165,"thread_start_us":1853,"threads_started":1}
W20260811 17:08:29.598773 7816 catalog_manager.cc:4584] TS 75a9e5d1ffbb4491b91fb0620097ebbc (127.4.146.193:41559): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7b01746174684f589b3c03a579d7a476: Network error: Client connection negotiation failed: client connection to 127.4.146.193:41559: connect: Connection refused (error 111)
I20260811 17:08:29.606745 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 8479
I20260811 17:08:29.625329 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 7784
2026-08-11T17:08:29Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (7260 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:08:29 dist-test-slave-7vjv krb5kdc[9065](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:08:29 dist-test-slave-7vjv krb5kdc[9065](info): set up 2 sockets
Aug 11 17:08:29 dist-test-slave-7vjv krb5kdc[9065](info): commencing operation
krb5kdc: starting...
W20260811 17:08:30.996315 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.331s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260811 17:08:31.314404 4683 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.318s user 0.001s sys 0.001s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260811 17:08:31.580798 4683 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.266s user 0.000s sys 0.002s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260811 17:08:31.726015 4683 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.145s user 0.000s sys 0.002s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/test-user.keytab.
W20260811 17:08:32.268668 4683 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.543s user 0.000s sys 0.003s
Aug 11 17:08:32 dist-test-slave-7vjv krb5kdc[9065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468112, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:08:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:08:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:08:32.324641 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:33787
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:36855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:33787
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:32.451556 9093 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:32.451977 9093 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:32.452031 9093 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:32.456350 9093 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:08:32.456424 9093 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:32.456444 9093 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:32.456467 9093 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:08:32.456512 9093 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:08:32.462524 9093 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:36855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:33787
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:33787
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9093
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:32.463776 9093 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:32.464948 9093 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:32.475234 9100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:32.475286 9093 server_base.cc:1034] running on GCE node
W20260811 17:08:32.475219 9104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:32.475219 9101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:32.476272 9093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:32.477540 9093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:32.478756 9093 hybrid_clock.cc:648] HybridClock initialized: now 1786468112478739 us; error 33 us; skew 500 ppm
Aug 11 17:08:32 dist-test-slave-7vjv krb5kdc[9065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468112, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:32.481992 9093 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:08:32.483069 9093 webserver.cc:460] Webserver started at http://127.4.146.254:35073/ using document root <none> and password file <none>
I20260811 17:08:32.483711 9093 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:32.483812 9093 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:32.484337 9093 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:32.486559 9093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "4713b3bc6ab04f8ba7569b3280b980ef"
format_stamp: "Formatted at 2026-08-11 17:08:32 on dist-test-slave-7vjv"
server_key: "1e43b93aeca33ffe3bdb94f7fbaf6f3a"
server_key_iv: "4a8f965844840ea2430792f92b34dfeb"
server_key_version: "encryptionkey@0"
I20260811 17:08:32.487185 9093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "4713b3bc6ab04f8ba7569b3280b980ef"
format_stamp: "Formatted at 2026-08-11 17:08:32 on dist-test-slave-7vjv"
server_key: "1e43b93aeca33ffe3bdb94f7fbaf6f3a"
server_key_iv: "4a8f965844840ea2430792f92b34dfeb"
server_key_version: "encryptionkey@0"
I20260811 17:08:32.491386 9093 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260811 17:08:32.494259 9122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:32.495697 9093 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 17:08:32.495877 9093 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "4713b3bc6ab04f8ba7569b3280b980ef"
format_stamp: "Formatted at 2026-08-11 17:08:32 on dist-test-slave-7vjv"
server_key: "1e43b93aeca33ffe3bdb94f7fbaf6f3a"
server_key_iv: "4a8f965844840ea2430792f92b34dfeb"
server_key_version: "encryptionkey@0"
I20260811 17:08:32.496024 9093 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:32.541002 9093 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:32.544689 9093 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:32.544916 9093 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:32.553196 9093 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:33787
I20260811 17:08:32.553261 9217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:33787 every 8 connection(s)
I20260811 17:08:32.554317 9093 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:08:32.557232 9220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:32.562968 9220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4713b3bc6ab04f8ba7569b3280b980ef: Bootstrap starting.
I20260811 17:08:32.564158 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 9093
I20260811 17:08:32.564322 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:08:32.564647 4683 external_mini_cluster.cc:1428] Setting key 34699310c68915d411f1beddd1854510
I20260811 17:08:32.566021 9220 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4713b3bc6ab04f8ba7569b3280b980ef: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:32.567028 9220 log.cc:824] T 00000000000000000000000000000000 P 4713b3bc6ab04f8ba7569b3280b980ef: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:32.569438 9220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4713b3bc6ab04f8ba7569b3280b980ef: No bootstrap required, opened a new log
I20260811 17:08:32.574424 9220 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4713b3bc6ab04f8ba7569b3280b980ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4713b3bc6ab04f8ba7569b3280b980ef" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33787 } }
I20260811 17:08:32.574689 9220 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4713b3bc6ab04f8ba7569b3280b980ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:32.574786 9220 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4713b3bc6ab04f8ba7569b3280b980ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4713b3bc6ab04f8ba7569b3280b980ef, State: Initialized, Role: FOLLOWER
Aug 11 17:08:32 dist-test-slave-7vjv krb5kdc[9065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468112, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:32.575398 9220 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4713b3bc6ab04f8ba7569b3280b980ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4713b3bc6ab04f8ba7569b3280b980ef" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33787 } }
I20260811 17:08:32.575599 9220 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4713b3bc6ab04f8ba7569b3280b980ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:08:32.575697 9220 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4713b3bc6ab04f8ba7569b3280b980ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:08:32.575846 9220 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4713b3bc6ab04f8ba7569b3280b980ef [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:32.577527 9220 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4713b3bc6ab04f8ba7569b3280b980ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4713b3bc6ab04f8ba7569b3280b980ef" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33787 } }
I20260811 17:08:32.578015 9220 leader_election.cc:302] T 00000000000000000000000000000000 P 4713b3bc6ab04f8ba7569b3280b980ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4713b3bc6ab04f8ba7569b3280b980ef; no voters:
I20260811 17:08:32.578444 9220 leader_election.cc:288] T 00000000000000000000000000000000 P 4713b3bc6ab04f8ba7569b3280b980ef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:08:32.578578 9229 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4713b3bc6ab04f8ba7569b3280b980ef [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:32.578850 9229 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4713b3bc6ab04f8ba7569b3280b980ef [term 1 LEADER]: Becoming Leader. State: Replica: 4713b3bc6ab04f8ba7569b3280b980ef, State: Running, Role: LEADER
I20260811 17:08:32.579285 9229 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4713b3bc6ab04f8ba7569b3280b980ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4713b3bc6ab04f8ba7569b3280b980ef" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33787 } }
I20260811 17:08:32.580073 9220 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4713b3bc6ab04f8ba7569b3280b980ef [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:08:32.581857 9225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:32.565999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58076 (local address 127.4.146.254:33787)
0811 17:08:32.566529 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:32.566549 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:32.566591 (+ 42us) server_negotiation.cc:407] Connection header received
0811 17:08:32.567476 (+ 885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:32.567500 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:32.567873 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:32.568307 (+ 434us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:32.569042 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:32.570744 (+ 1702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:32.571671 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:32.572554 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:32.572797 (+ 243us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:32.575476 (+ 2679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:32.575484 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:32.575504 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:32.575548 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:32.578042 (+ 2494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:32.578610 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:32.578617 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:32.578625 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:32.578790 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:32.579165 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:32.579168 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:32.579170 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:32.579734 (+ 564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:32.579949 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:32.580469 (+ 520us) server_negotiation.cc:299] Negotiation successful
0811 17:08:32.580812 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":162,"threads_started":1}
I20260811 17:08:32.582373 9230 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4713b3bc6ab04f8ba7569b3280b980ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4713b3bc6ab04f8ba7569b3280b980ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4713b3bc6ab04f8ba7569b3280b980ef" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33787 } } }
I20260811 17:08:32.582569 9230 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4713b3bc6ab04f8ba7569b3280b980ef [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:32.583108 9240 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:08:32.583035 9231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4713b3bc6ab04f8ba7569b3280b980ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4713b3bc6ab04f8ba7569b3280b980ef. Latest consensus state: current_term: 1 leader_uuid: "4713b3bc6ab04f8ba7569b3280b980ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4713b3bc6ab04f8ba7569b3280b980ef" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33787 } } }
I20260811 17:08:32.583237 9231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4713b3bc6ab04f8ba7569b3280b980ef [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:32.586448 9240 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:08:32.592777 9240 catalog_manager.cc:1347] Generated new cluster ID: b69c8423fb84484c91503632ab5aac35
I20260811 17:08:32.592891 9240 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:08:32.599707 9240 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:08:32.600926 9240 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:08:32.611603 9240 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4713b3bc6ab04f8ba7569b3280b980ef: Generated new TSK 0
I20260811 17:08:32.612637 9240 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
I20260811 17:08:32.649747 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:33787
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:36855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:32.772128 9259 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:32.772486 9259 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:32.772570 9259 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:32.776878 9259 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:32.776995 9259 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:32.777093 9259 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:08:32.783021 9259 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:36855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:33787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9259
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:32.784262 9259 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:32.785547 9259 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:32.795845 9271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:32.795830 9269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:32.795830 9267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:32.796183 9259 server_base.cc:1034] running on GCE node
I20260811 17:08:32.797473 9259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:32.798183 9259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:32.799369 9259 hybrid_clock.cc:648] HybridClock initialized: now 1786468112799329 us; error 57 us; skew 500 ppm
Aug 11 17:08:32 dist-test-slave-7vjv krb5kdc[9065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468112, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:32.802839 9259 init.cc:377] Logged in from keytab as kudu/127.4.146.193@KRBTEST.COM (short username kudu)
I20260811 17:08:32.804159 9259 webserver.cc:460] Webserver started at http://127.4.146.193:38695/ using document root <none> and password file <none>
I20260811 17:08:32.805018 9259 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:32.805140 9259 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:32.805438 9259 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:32.807802 9259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "40e73622f7e34dbab1948f42f2151640"
format_stamp: "Formatted at 2026-08-11 17:08:32 on dist-test-slave-7vjv"
server_key: "4d0bb6d29bb86f054de06ae37cdafa09"
server_key_iv: "ab80343ab88fa7bef0d5923d57d90ccd"
server_key_version: "encryptionkey@0"
I20260811 17:08:32.808451 9259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "40e73622f7e34dbab1948f42f2151640"
format_stamp: "Formatted at 2026-08-11 17:08:32 on dist-test-slave-7vjv"
server_key: "4d0bb6d29bb86f054de06ae37cdafa09"
server_key_iv: "ab80343ab88fa7bef0d5923d57d90ccd"
server_key_version: "encryptionkey@0"
I20260811 17:08:32.812594 9259 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 17:08:32.815124 9284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:32.816566 9259 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:08:32.816708 9259 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "40e73622f7e34dbab1948f42f2151640"
format_stamp: "Formatted at 2026-08-11 17:08:32 on dist-test-slave-7vjv"
server_key: "4d0bb6d29bb86f054de06ae37cdafa09"
server_key_iv: "ab80343ab88fa7bef0d5923d57d90ccd"
server_key_version: "encryptionkey@0"
I20260811 17:08:32.816828 9259 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:32.853027 9259 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:32.856432 9259 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:32.856670 9259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:32.857352 9259 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:32.858342 9259 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:32.858393 9259 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:32.858434 9259 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:32.858489 9259 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:32.868507 9259 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:35863
I20260811 17:08:32.868556 9500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:35863 every 8 connection(s)
I20260811 17:08:32.869503 9259 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:08:32.878666 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 9259
I20260811 17:08:32.878970 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
I20260811 17:08:32.879303 4683 external_mini_cluster.cc:1428] Setting key 67219cf8b192452f67ca40c956f0d023
Aug 11 17:08:32 dist-test-slave-7vjv krb5kdc[9065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468112, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:32.885891 9225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:32.871562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:49057 (local address 127.4.146.254:33787)
0811 17:08:32.871727 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:32.871731 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:32.872715 (+ 984us) server_negotiation.cc:407] Connection header received
0811 17:08:32.874167 (+ 1452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:32.874170 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:32.874232 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:32.874320 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:32.875583 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:32.876210 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:32.877387 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:32.877641 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:32.877757 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:32.880888 (+ 3131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:32.880898 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:32.880901 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:32.880927 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:32.883142 (+ 2215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:32.883935 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:32.883938 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:32.883939 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:32.884066 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:32.884574 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:32.884577 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:32.884578 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:32.884783 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:32.884866 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:32.885623 (+ 757us) server_negotiation.cc:299] Negotiation successful
0811 17:08:32.885744 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 17:08:32.887267 9504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:32.871994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33787 (local address 127.4.146.193:49057)
0811 17:08:32.872548 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:32.872594 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:32.873928 (+ 1334us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:32.874506 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:32.874514 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:32.874906 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:32.875418 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:32.875431 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:32.876346 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:32.876354 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:32.877253 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:32.877263 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:32.877817 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:32.877821 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:32.877996 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:32.878707 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:32.878725 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:32.880704 (+ 1979us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:32.883318 (+ 2614us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:32.883329 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:32.883351 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:32.883803 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:32.884225 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:32.884230 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:32.884233 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:32.884457 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:32.884899 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:32.884907 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:32.885328 (+ 421us) client_negotiation.cc:769] Sending connection context
0811 17:08:32.885566 (+ 238us) client_negotiation.cc:240] Negotiation successful
0811 17:08:32.885999 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":134,"threads_started":1}
I20260811 17:08:32.888774 9502 heartbeater.cc:347] Connected to a master server at 127.4.146.254:33787
I20260811 17:08:32.889091 9502 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:32.889786 9502 heartbeater.cc:511] Master 127.4.146.254:33787 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.4.146.194@KRBTEST.COM; defaulting to no policy
I20260811 17:08:32.891999 9154 ts_manager.cc:194] Registered new tserver with Master: 40e73622f7e34dbab1948f42f2151640 (127.4.146.193:35863)
I20260811 17:08:32.893375 9154 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.193@KRBTEST.COM'} at 127.4.146.193:49057
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
I20260811 17:08:32.913923 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:33787
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:36855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:33.037559 9511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:33.037946 9511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:33.037997 9511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:33.042819 9511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:33.042918 9511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:33.042985 9511 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:08:33.049727 9511 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:36855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:33787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:33.051118 9511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:33.052438 9511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:33.064369 9523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:33.064769 9511 server_base.cc:1034] running on GCE node
W20260811 17:08:33.064708 9525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:33.064918 9520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:33.065461 9511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:33.066236 9511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:33.067459 9511 hybrid_clock.cc:648] HybridClock initialized: now 1786468113067441 us; error 34 us; skew 500 ppm
Aug 11 17:08:33 dist-test-slave-7vjv krb5kdc[9065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468113, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:33.070866 9511 init.cc:377] Logged in from keytab as kudu/127.4.146.194@KRBTEST.COM (short username kudu)
I20260811 17:08:33.072006 9511 webserver.cc:460] Webserver started at http://127.4.146.194:36325/ using document root <none> and password file <none>
I20260811 17:08:33.072683 9511 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:33.072754 9511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:33.073001 9511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:33.075299 9511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "c6f443098f594ff3a452cc816b9539aa"
format_stamp: "Formatted at 2026-08-11 17:08:33 on dist-test-slave-7vjv"
server_key: "c36bc6644f06efc12c4450fec4d1e69a"
server_key_iv: "5572230dd892e9fe672e8514ea1feef9"
server_key_version: "encryptionkey@0"
I20260811 17:08:33.075963 9511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "c6f443098f594ff3a452cc816b9539aa"
format_stamp: "Formatted at 2026-08-11 17:08:33 on dist-test-slave-7vjv"
server_key: "c36bc6644f06efc12c4450fec4d1e69a"
server_key_iv: "5572230dd892e9fe672e8514ea1feef9"
server_key_version: "encryptionkey@0"
I20260811 17:08:33.080750 9511 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 17:08:33.084227 9537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:33.085718 9511 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 17:08:33.085892 9511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "c6f443098f594ff3a452cc816b9539aa"
format_stamp: "Formatted at 2026-08-11 17:08:33 on dist-test-slave-7vjv"
server_key: "c36bc6644f06efc12c4450fec4d1e69a"
server_key_iv: "5572230dd892e9fe672e8514ea1feef9"
server_key_version: "encryptionkey@0"
I20260811 17:08:33.086032 9511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:33.100679 9511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:33.104471 9511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:33.104758 9511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:33.105494 9511 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:33.106421 9511 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:33.106498 9511 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:33.106575 9511 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:33.106628 9511 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:33.117720 9511 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:42919
I20260811 17:08:33.117784 9745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:42919 every 8 connection(s)
I20260811 17:08:33.118822 9511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:08:33.123083 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 9511
I20260811 17:08:33.123188 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:08:33.123451 4683 external_mini_cluster.cc:1428] Setting key e941ec4e652cc5eb066e7ad4eefbccb0
Aug 11 17:08:33 dist-test-slave-7vjv krb5kdc[9065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468113, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.146.195@KRBTEST.COM; defaulting to no policy
I20260811 17:08:33.135686 9225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:33.121064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:35051 (local address 127.4.146.254:33787)
0811 17:08:33.121225 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:33.121229 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:33.122212 (+ 983us) server_negotiation.cc:407] Connection header received
0811 17:08:33.123659 (+ 1447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:33.123663 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:33.123722 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:33.123822 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:33.125382 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:33.126208 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:33.127583 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:33.127800 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:33.127890 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:33.131153 (+ 3263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:33.131157 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:33.131159 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:33.131189 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:33.132926 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:33.133742 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:33.133746 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:33.133747 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:33.133846 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:33.134323 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:33.134325 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:33.134326 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:33.134529 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:33.134610 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:33.135408 (+ 798us) server_negotiation.cc:299] Negotiation successful
0811 17:08:33.135547 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 17:08:33.136951 9750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:33.121487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33787 (local address 127.4.146.194:35051)
0811 17:08:33.122038 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:33.122086 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:33.123420 (+ 1334us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:33.124048 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:33.124059 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:33.124530 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:33.125210 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:33.125229 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:33.126355 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:33.126357 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:33.127429 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:33.127446 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:33.127984 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:33.127990 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:33.128279 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:33.129011 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:33.129036 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:33.130893 (+ 1857us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:33.133082 (+ 2189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:33.133090 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:33.133113 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:33.133602 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:33.133967 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:33.133970 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:33.133973 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:33.134205 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:33.134656 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:33.134668 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:33.135079 (+ 411us) client_negotiation.cc:769] Sending connection context
0811 17:08:33.135334 (+ 255us) client_negotiation.cc:240] Negotiation successful
0811 17:08:33.135755 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":128,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.195@KRBTEST.COM" created.
I20260811 17:08:33.138991 9748 heartbeater.cc:347] Connected to a master server at 127.4.146.254:33787
I20260811 17:08:33.139318 9748 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:33.139955 9748 heartbeater.cc:511] Master 127.4.146.254:33787 requested a full tablet report, sending...
I20260811 17:08:33.141331 9154 ts_manager.cc:194] Registered new tserver with Master: c6f443098f594ff3a452cc816b9539aa (127.4.146.194:42919)
I20260811 17:08:33.141964 9154 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.194@KRBTEST.COM'} at 127.4.146.194:35051
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
I20260811 17:08:33.160018 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:33787
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:36855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:33.289263 9757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:33.289623 9757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:33.289691 9757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:33.293908 9757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:33.293992 9757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:33.294060 9757 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:08:33.299604 9757 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:36855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:33787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:33.300866 9757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:33.301909 9757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:33.312594 9768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:33.312705 9757 server_base.cc:1034] running on GCE node
W20260811 17:08:33.312587 9764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:33.312587 9763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:33.313544 9757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:33.314388 9757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:33.315626 9757 hybrid_clock.cc:648] HybridClock initialized: now 1786468113315585 us; error 57 us; skew 500 ppm
Aug 11 17:08:33 dist-test-slave-7vjv krb5kdc[9065](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468113, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:33.319216 9757 init.cc:377] Logged in from keytab as kudu/127.4.146.195@KRBTEST.COM (short username kudu)
I20260811 17:08:33.320459 9757 webserver.cc:460] Webserver started at http://127.4.146.195:46249/ using document root <none> and password file <none>
I20260811 17:08:33.321396 9757 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:33.321516 9757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:33.321858 9757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:33.324995 9757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "9b27aadf59784d11863e81a9b0abcbc9"
format_stamp: "Formatted at 2026-08-11 17:08:33 on dist-test-slave-7vjv"
server_key: "4d2794d73eb18892d35d56c44d6ed174"
server_key_iv: "d133de85dba42d7517a3e8a8a43f3ee9"
server_key_version: "encryptionkey@0"
I20260811 17:08:33.325664 9757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "9b27aadf59784d11863e81a9b0abcbc9"
format_stamp: "Formatted at 2026-08-11 17:08:33 on dist-test-slave-7vjv"
server_key: "4d2794d73eb18892d35d56c44d6ed174"
server_key_iv: "d133de85dba42d7517a3e8a8a43f3ee9"
server_key_version: "encryptionkey@0"
I20260811 17:08:33.329999 9757 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 17:08:33.333164 9781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:33.334693 9757 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 17:08:33.334882 9757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "9b27aadf59784d11863e81a9b0abcbc9"
format_stamp: "Formatted at 2026-08-11 17:08:33 on dist-test-slave-7vjv"
server_key: "4d2794d73eb18892d35d56c44d6ed174"
server_key_iv: "d133de85dba42d7517a3e8a8a43f3ee9"
server_key_version: "encryptionkey@0"
I20260811 17:08:33.335062 9757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:33.347872 9757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:33.351805 9757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:33.352049 9757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:33.352810 9757 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:33.353806 9757 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:33.353859 9757 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:33.353904 9757 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:33.353967 9757 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:33.364125 9757 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:33437
I20260811 17:08:33.364192 9982 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:33437 every 8 connection(s)
I20260811 17:08:33.365244 9757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:08:33.369709 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 9757
I20260811 17:08:33.369843 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:08:33.370218 4683 external_mini_cluster.cc:1428] Setting key 670dbefd149ba2b8f9777cee6744fb5e
Aug 11 17:08:33 dist-test-slave-7vjv krb5kdc[9065](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468113, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:33.380503 9225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:33.367300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:55465 (local address 127.4.146.254:33787)
0811 17:08:33.367457 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:33.367461 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:33.368394 (+ 933us) server_negotiation.cc:407] Connection header received
0811 17:08:33.370029 (+ 1635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:33.370032 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:33.370090 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:33.370173 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:33.371830 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:33.372651 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:33.373910 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:33.374125 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:33.374208 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:33.376953 (+ 2745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:33.376956 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:33.376958 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:33.376985 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:33.378310 (+ 1325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:33.378811 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:33.378813 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:33.378815 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:33.378896 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:33.379252 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:33.379255 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:33.379256 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:33.379496 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:33.379590 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:33.380254 (+ 664us) server_negotiation.cc:299] Negotiation successful
0811 17:08:33.380370 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 17:08:33.381507 9989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:33.367626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33787 (local address 127.4.146.195:55465)
0811 17:08:33.368214 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:33.368264 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:33.369700 (+ 1436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:33.370365 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:33.370375 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:33.370878 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:33.371642 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:33.371668 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:33.372820 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:33.372826 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:33.373786 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:33.373796 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:33.374266 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:33.374269 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:33.374430 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:33.375130 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:33.375148 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:33.376782 (+ 1634us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:33.378424 (+ 1642us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:33.378429 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:33.378443 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:33.378719 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:33.378977 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:33.378980 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:33.378981 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:33.379120 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:33.379597 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:33.379602 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:33.379956 (+ 354us) client_negotiation.cc:769] Sending connection context
0811 17:08:33.380216 (+ 260us) client_negotiation.cc:240] Negotiation successful
0811 17:08:33.380504 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":129,"threads_started":1}
I20260811 17:08:33.382893 9984 heartbeater.cc:347] Connected to a master server at 127.4.146.254:33787
I20260811 17:08:33.383231 9984 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:33.383922 9984 heartbeater.cc:511] Master 127.4.146.254:33787 requested a full tablet report, sending...
I20260811 17:08:33.385185 9154 ts_manager.cc:194] Registered new tserver with Master: 9b27aadf59784d11863e81a9b0abcbc9 (127.4.146.195:33437)
I20260811 17:08:33.385809 9154 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.195@KRBTEST.COM'} at 127.4.146.195:55465
I20260811 17:08:33.397159 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 17:08:33.413084 9225 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:08:33.411325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58088 (local address 127.4.146.254:33787)
0811 17:08:33.411533 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:33.411539 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:33.411687 (+ 148us) server_negotiation.cc:407] Connection header received
0811 17:08:33.411880 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:33.411883 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:33.411932 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:33.412012 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:33.412918 (+ 906us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58088: BlockingRecv error: recv got EOF from 127.0.0.1:58088 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 17:08:33.414049 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 9259
I20260811 17:08:33.457329 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 9511
I20260811 17:08:33.473381 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 9757
I20260811 17:08:33.486135 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 9093
2026-08-11T17:08:33Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3857 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:08:33 dist-test-slave-7vjv krb5kdc[10001](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:08:33 dist-test-slave-7vjv krb5kdc[10001](info): set up 2 sockets
Aug 11 17:08:33 dist-test-slave-7vjv krb5kdc[10001](info): commencing operation
krb5kdc: starting...
W20260811 17:08:34.894819 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.372s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:08:34 dist-test-slave-7vjv krb5kdc[10001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468114, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:08:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:08:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:08:35.040513 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:45021
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:36515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:45021
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:35.161235 10025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:35.161554 10025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:35.161597 10025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:35.165661 10025 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:08:35.165732 10025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:35.165752 10025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:35.165769 10025 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:08:35.165786 10025 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:08:35.171303 10025 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:36515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:45021
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:45021
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10025
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:35.172433 10025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:35.173432 10025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:35.182770 10033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:35.182765 10031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:35.182763 10030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:35.182786 10025 server_base.cc:1034] running on GCE node
I20260811 17:08:35.183713 10025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:35.184969 10025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:35.186138 10025 hybrid_clock.cc:648] HybridClock initialized: now 1786468115186115 us; error 33 us; skew 500 ppm
Aug 11 17:08:35 dist-test-slave-7vjv krb5kdc[10001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468115, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:35.193497 10025 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:08:35.194566 10025 webserver.cc:460] Webserver started at http://127.4.146.254:40083/ using document root <none> and password file <none>
I20260811 17:08:35.195179 10025 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:35.195279 10025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:35.195528 10025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:35.197759 10025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "f2b8c1b480aa448da8f58f9b2b3d4fd6"
format_stamp: "Formatted at 2026-08-11 17:08:35 on dist-test-slave-7vjv"
server_key: "3d39661a1d63684213cacf31c18b230c"
server_key_iv: "e52c5fbd9dff2aef5e5bf7739332e16f"
server_key_version: "encryptionkey@0"
I20260811 17:08:35.198386 10025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "f2b8c1b480aa448da8f58f9b2b3d4fd6"
format_stamp: "Formatted at 2026-08-11 17:08:35 on dist-test-slave-7vjv"
server_key: "3d39661a1d63684213cacf31c18b230c"
server_key_iv: "e52c5fbd9dff2aef5e5bf7739332e16f"
server_key_version: "encryptionkey@0"
I20260811 17:08:35.202311 10025 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260811 17:08:35.205049 10044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:35.206307 10025 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 17:08:35.206462 10025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "f2b8c1b480aa448da8f58f9b2b3d4fd6"
format_stamp: "Formatted at 2026-08-11 17:08:35 on dist-test-slave-7vjv"
server_key: "3d39661a1d63684213cacf31c18b230c"
server_key_iv: "e52c5fbd9dff2aef5e5bf7739332e16f"
server_key_version: "encryptionkey@0"
I20260811 17:08:35.206588 10025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:35.222571 10025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:35.226351 10025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:35.226639 10025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:35.234773 10025 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:45021
I20260811 17:08:35.235085 10138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:45021 every 8 connection(s)
I20260811 17:08:35.235860 10025 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:08:35.238876 10139 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:35.239122 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 10025
I20260811 17:08:35.239267 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:08:35.239589 4683 external_mini_cluster.cc:1428] Setting key 17134c303749426839e0e51beba10926
I20260811 17:08:35.247107 10139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2b8c1b480aa448da8f58f9b2b3d4fd6: Bootstrap starting.
Aug 11 17:08:35 dist-test-slave-7vjv krb5kdc[10001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468114, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:35.250075 10139 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f2b8c1b480aa448da8f58f9b2b3d4fd6: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:35.251118 10139 log.cc:824] T 00000000000000000000000000000000 P f2b8c1b480aa448da8f58f9b2b3d4fd6: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:35.253629 10139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2b8c1b480aa448da8f58f9b2b3d4fd6: No bootstrap required, opened a new log
I20260811 17:08:35.255810 10144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:35.240991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45604 (local address 127.4.146.254:45021)
0811 17:08:35.241428 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:35.241445 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:35.241483 (+ 38us) server_negotiation.cc:407] Connection header received
0811 17:08:35.242216 (+ 733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:35.242234 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:35.242595 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:35.242899 (+ 304us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:35.244253 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:35.245301 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:35.246508 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:35.246991 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:35.247115 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:35.250037 (+ 2922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:35.250044 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:35.250061 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:35.250100 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:35.251963 (+ 1863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:35.252580 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:35.252586 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:35.252593 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:35.252749 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:35.253161 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:35.253165 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:35.253166 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:35.253707 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:35.253946 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:35.254273 (+ 327us) server_negotiation.cc:299] Negotiation successful
0811 17:08:35.254598 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":135,"threads_started":1}
I20260811 17:08:35.257682 10139 raft_consensus.cc:348] T 00000000000000000000000000000000 P f2b8c1b480aa448da8f58f9b2b3d4fd6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2b8c1b480aa448da8f58f9b2b3d4fd6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 45021 } }
I20260811 17:08:35.257998 10139 raft_consensus.cc:374] T 00000000000000000000000000000000 P f2b8c1b480aa448da8f58f9b2b3d4fd6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:35.258103 10139 raft_consensus.cc:729] T 00000000000000000000000000000000 P f2b8c1b480aa448da8f58f9b2b3d4fd6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2b8c1b480aa448da8f58f9b2b3d4fd6, State: Initialized, Role: FOLLOWER
I20260811 17:08:35.258672 10139 consensus_queue.cc:260] T 00000000000000000000000000000000 P f2b8c1b480aa448da8f58f9b2b3d4fd6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2b8c1b480aa448da8f58f9b2b3d4fd6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 45021 } }
I20260811 17:08:35.258859 10139 raft_consensus.cc:388] T 00000000000000000000000000000000 P f2b8c1b480aa448da8f58f9b2b3d4fd6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:08:35.258929 10139 raft_consensus.cc:482] T 00000000000000000000000000000000 P f2b8c1b480aa448da8f58f9b2b3d4fd6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:08:35.259119 10139 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f2b8c1b480aa448da8f58f9b2b3d4fd6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:35.259341 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:08:35.260326 10139 raft_consensus.cc:504] T 00000000000000000000000000000000 P f2b8c1b480aa448da8f58f9b2b3d4fd6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2b8c1b480aa448da8f58f9b2b3d4fd6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 45021 } }
I20260811 17:08:35.260684 10139 leader_election.cc:302] T 00000000000000000000000000000000 P f2b8c1b480aa448da8f58f9b2b3d4fd6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f2b8c1b480aa448da8f58f9b2b3d4fd6; no voters:
I20260811 17:08:35.261022 10139 leader_election.cc:288] T 00000000000000000000000000000000 P f2b8c1b480aa448da8f58f9b2b3d4fd6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:08:35.261234 10146 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f2b8c1b480aa448da8f58f9b2b3d4fd6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:35.261600 10146 raft_consensus.cc:686] T 00000000000000000000000000000000 P f2b8c1b480aa448da8f58f9b2b3d4fd6 [term 1 LEADER]: Becoming Leader. State: Replica: f2b8c1b480aa448da8f58f9b2b3d4fd6, State: Running, Role: LEADER
I20260811 17:08:35.262090 10146 consensus_queue.cc:237] T 00000000000000000000000000000000 P f2b8c1b480aa448da8f58f9b2b3d4fd6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2b8c1b480aa448da8f58f9b2b3d4fd6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 45021 } }
I20260811 17:08:35.262501 10139 sys_catalog.cc:564] T 00000000000000000000000000000000 P f2b8c1b480aa448da8f58f9b2b3d4fd6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:08:35.264001 10150 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2b8c1b480aa448da8f58f9b2b3d4fd6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f2b8c1b480aa448da8f58f9b2b3d4fd6. Latest consensus state: current_term: 1 leader_uuid: "f2b8c1b480aa448da8f58f9b2b3d4fd6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2b8c1b480aa448da8f58f9b2b3d4fd6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 45021 } } }
I20260811 17:08:35.264216 10150 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2b8c1b480aa448da8f58f9b2b3d4fd6 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:35.264647 10148 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2b8c1b480aa448da8f58f9b2b3d4fd6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f2b8c1b480aa448da8f58f9b2b3d4fd6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2b8c1b480aa448da8f58f9b2b3d4fd6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 45021 } } }
I20260811 17:08:35.264760 10148 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2b8c1b480aa448da8f58f9b2b3d4fd6 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:35.264762 10163 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:08:35.269012 10163 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:08:35.277741 10163 catalog_manager.cc:1347] Generated new cluster ID: affd103705b3435fb45a4038bd46c399
I20260811 17:08:35.277925 10163 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:08:35.286504 10144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:35.279856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45620 (local address 127.4.146.254:45021)
0811 17:08:35.280016 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:35.280022 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:35.280411 (+ 389us) server_negotiation.cc:407] Connection header received
0811 17:08:35.280600 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:35.280603 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:35.280658 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:35.280743 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:35.281537 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:35.282337 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:35.283677 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:35.284043 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:35.284189 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:35.285305 (+ 1116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:35.285309 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:35.285312 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:08:35.285947 (+ 635us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:35.285983 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:08:35.286006 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:35.286094 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:35.286270 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 17:08:35.286341 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 17:08:35.293095 10163 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:08:35.294297 10163 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:08:35.300710 10163 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f2b8c1b480aa448da8f58f9b2b3d4fd6: Generated new TSK 0
I20260811 17:08:35.301745 10163 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:08:35.316262 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 10025
2026-08-11T17:08:35Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1827 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:08:35 dist-test-slave-7vjv krb5kdc[10192](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:08:35 dist-test-slave-7vjv krb5kdc[10192](info): set up 2 sockets
Aug 11 17:08:35 dist-test-slave-7vjv krb5kdc[10192](info): commencing operation
krb5kdc: starting...
W20260811 17:08:36.659186 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.309s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:08:36 dist-test-slave-7vjv krb5kdc[10192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:08:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:08:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:08:36.803622 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:37999
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:46815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:37999
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:36.924124 10214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:36.924469 10214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:36.924552 10214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:36.928702 10214 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:08:36.928813 10214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:36.928849 10214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:36.928890 10214 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:08:36.928926 10214 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:08:36.934434 10214 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:46815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:37999
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:37999
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:36.935643 10214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:36.936785 10214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:36.945830 10225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:36.945828 10232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:36.945828 10226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:36.946321 10214 server_base.cc:1034] running on GCE node
I20260811 17:08:36.946964 10214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:36.948256 10214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:36.949488 10214 hybrid_clock.cc:648] HybridClock initialized: now 1786468116949465 us; error 46 us; skew 500 ppm
Aug 11 17:08:36 dist-test-slave-7vjv krb5kdc[10192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468116, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:36.952805 10214 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:08:36.953953 10214 webserver.cc:460] Webserver started at http://127.4.146.254:46233/ using document root <none> and password file <none>
I20260811 17:08:36.954553 10214 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:36.954660 10214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:36.954911 10214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:36.957187 10214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "cd7351e03fb04c79a0d9143a4edaff12"
format_stamp: "Formatted at 2026-08-11 17:08:36 on dist-test-slave-7vjv"
server_key: "22361bf159f5d2b0fea072de44ee02b0"
server_key_iv: "c3758655c1203192d653acd84e883c16"
server_key_version: "encryptionkey@0"
I20260811 17:08:36.957793 10214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "cd7351e03fb04c79a0d9143a4edaff12"
format_stamp: "Formatted at 2026-08-11 17:08:36 on dist-test-slave-7vjv"
server_key: "22361bf159f5d2b0fea072de44ee02b0"
server_key_iv: "c3758655c1203192d653acd84e883c16"
server_key_version: "encryptionkey@0"
I20260811 17:08:36.961992 10214 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 17:08:36.964968 10242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:36.966794 10214 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 17:08:36.966970 10214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "cd7351e03fb04c79a0d9143a4edaff12"
format_stamp: "Formatted at 2026-08-11 17:08:36 on dist-test-slave-7vjv"
server_key: "22361bf159f5d2b0fea072de44ee02b0"
server_key_iv: "c3758655c1203192d653acd84e883c16"
server_key_version: "encryptionkey@0"
I20260811 17:08:36.967106 10214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:36.988715 10214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:36.992349 10214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:36.992622 10214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:37.000881 10214 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:37999
I20260811 17:08:37.001233 10326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:37999 every 8 connection(s)
I20260811 17:08:37.002254 10214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:08:37.002507 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 10214
I20260811 17:08:37.002650 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:08:37.003072 4683 external_mini_cluster.cc:1428] Setting key 081c31db73dff89ad48a58f46ec4289a
I20260811 17:08:37.005877 10327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:37.012159 10327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd7351e03fb04c79a0d9143a4edaff12: Bootstrap starting.
Aug 11 17:08:37 dist-test-slave-7vjv krb5kdc[10192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:37.014999 10327 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd7351e03fb04c79a0d9143a4edaff12: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:37.015812 10327 log.cc:824] T 00000000000000000000000000000000 P cd7351e03fb04c79a0d9143a4edaff12: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:37.017935 10327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd7351e03fb04c79a0d9143a4edaff12: No bootstrap required, opened a new log
I20260811 17:08:37.018989 10335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:37.004732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47112 (local address 127.4.146.254:37999)
0811 17:08:37.005263 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:37.005279 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:37.005321 (+ 42us) server_negotiation.cc:407] Connection header received
0811 17:08:37.006196 (+ 875us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:37.006219 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:37.006584 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:37.006956 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:37.007935 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:37.009054 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:37.009987 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:37.010496 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:37.010685 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:37.013851 (+ 3166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:37.013857 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:37.013871 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:37.013902 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:37.015919 (+ 2017us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:37.016462 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:37.016469 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:37.016475 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:37.016606 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:37.016903 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:37.016906 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:37.016908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:37.017360 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:37.017563 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:37.017881 (+ 318us) server_negotiation.cc:299] Negotiation successful
0811 17:08:37.018221 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":158,"threads_started":1}
I20260811 17:08:37.022361 10327 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd7351e03fb04c79a0d9143a4edaff12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd7351e03fb04c79a0d9143a4edaff12" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37999 } }
I20260811 17:08:37.022675 10327 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd7351e03fb04c79a0d9143a4edaff12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:37.022795 10327 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd7351e03fb04c79a0d9143a4edaff12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd7351e03fb04c79a0d9143a4edaff12, State: Initialized, Role: FOLLOWER
I20260811 17:08:37.023317 10327 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd7351e03fb04c79a0d9143a4edaff12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd7351e03fb04c79a0d9143a4edaff12" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37999 } }
I20260811 17:08:37.023497 10327 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd7351e03fb04c79a0d9143a4edaff12 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:08:37.023591 10327 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd7351e03fb04c79a0d9143a4edaff12 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:08:37.023713 10327 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd7351e03fb04c79a0d9143a4edaff12 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:37.024917 10327 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd7351e03fb04c79a0d9143a4edaff12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd7351e03fb04c79a0d9143a4edaff12" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37999 } }
I20260811 17:08:37.025316 10327 leader_election.cc:302] T 00000000000000000000000000000000 P cd7351e03fb04c79a0d9143a4edaff12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd7351e03fb04c79a0d9143a4edaff12; no voters:
I20260811 17:08:37.025731 10327 leader_election.cc:288] T 00000000000000000000000000000000 P cd7351e03fb04c79a0d9143a4edaff12 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:08:37.025942 10337 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd7351e03fb04c79a0d9143a4edaff12 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:37.026280 10337 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd7351e03fb04c79a0d9143a4edaff12 [term 1 LEADER]: Becoming Leader. State: Replica: cd7351e03fb04c79a0d9143a4edaff12, State: Running, Role: LEADER
I20260811 17:08:37.026685 10337 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd7351e03fb04c79a0d9143a4edaff12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd7351e03fb04c79a0d9143a4edaff12" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37999 } }
I20260811 17:08:37.027256 10327 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd7351e03fb04c79a0d9143a4edaff12 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:08:37.028625 10339 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd7351e03fb04c79a0d9143a4edaff12 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd7351e03fb04c79a0d9143a4edaff12. Latest consensus state: current_term: 1 leader_uuid: "cd7351e03fb04c79a0d9143a4edaff12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd7351e03fb04c79a0d9143a4edaff12" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37999 } } }
I20260811 17:08:37.028777 10339 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd7351e03fb04c79a0d9143a4edaff12 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:37.029218 10356 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:08:37.029143 10338 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd7351e03fb04c79a0d9143a4edaff12 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd7351e03fb04c79a0d9143a4edaff12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd7351e03fb04c79a0d9143a4edaff12" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37999 } } }
I20260811 17:08:37.029281 10338 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd7351e03fb04c79a0d9143a4edaff12 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:37.032850 10356 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:08:37.039306 10356 catalog_manager.cc:1347] Generated new cluster ID: 78a3989a659547888a18a976602b23b0
I20260811 17:08:37.039402 10356 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:08:37.049307 10356 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:08:37.050645 10356 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:08:37.062259 10356 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cd7351e03fb04c79a0d9143a4edaff12: Generated new TSK 0
I20260811 17:08:37.063120 10356 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
I20260811 17:08:37.100191 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:37999
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:46815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:37.225279 10379 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:37.225646 10379 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:37.225733 10379 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:37.230209 10379 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:37.230324 10379 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:37.230429 10379 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:08:37.236685 10379 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:46815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:37999
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10379
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:37.237993 10379 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:37.239210 10379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:37.251928 10391 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:37.252065 10379 server_base.cc:1034] running on GCE node
W20260811 17:08:37.251962 10393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:37.251962 10396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:37.252789 10379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:37.253530 10379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:37.254770 10379 hybrid_clock.cc:648] HybridClock initialized: now 1786468117254729 us; error 60 us; skew 500 ppm
Aug 11 17:08:37 dist-test-slave-7vjv krb5kdc[10192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468117, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:37.258108 10379 init.cc:377] Logged in from keytab as kudu/127.4.146.193@KRBTEST.COM (short username kudu)
I20260811 17:08:37.259102 10379 webserver.cc:460] Webserver started at http://127.4.146.193:38105/ using document root <none> and password file <none>
I20260811 17:08:37.259729 10379 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:37.259804 10379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:37.259996 10379 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:37.262560 10379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "2f9784dd0200400d97eb9168953f3a64"
format_stamp: "Formatted at 2026-08-11 17:08:37 on dist-test-slave-7vjv"
server_key: "a3e02d22ff0d1d7b30837cdd232b7a2c"
server_key_iv: "75ed98b0d068693b25c784737ec65217"
server_key_version: "encryptionkey@0"
I20260811 17:08:37.263227 10379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "2f9784dd0200400d97eb9168953f3a64"
format_stamp: "Formatted at 2026-08-11 17:08:37 on dist-test-slave-7vjv"
server_key: "a3e02d22ff0d1d7b30837cdd232b7a2c"
server_key_iv: "75ed98b0d068693b25c784737ec65217"
server_key_version: "encryptionkey@0"
I20260811 17:08:37.267472 10379 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 17:08:37.270304 10413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:37.271791 10379 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 17:08:37.271911 10379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "2f9784dd0200400d97eb9168953f3a64"
format_stamp: "Formatted at 2026-08-11 17:08:37 on dist-test-slave-7vjv"
server_key: "a3e02d22ff0d1d7b30837cdd232b7a2c"
server_key_iv: "75ed98b0d068693b25c784737ec65217"
server_key_version: "encryptionkey@0"
I20260811 17:08:37.272085 10379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:37.287751 10379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:37.291603 10379 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:37.291836 10379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:37.292524 10379 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:37.293449 10379 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:37.293529 10379 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:37.293604 10379 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:37.293655 10379 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:37.303805 10379 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:35323
I20260811 17:08:37.303829 10608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:35323 every 8 connection(s)
I20260811 17:08:37.304867 10379 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:08:37.309151 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 10379
I20260811 17:08:37.309322 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
I20260811 17:08:37.309685 4683 external_mini_cluster.cc:1428] Setting key 89ca0708d52737511aa956f709015006
Aug 11 17:08:37 dist-test-slave-7vjv krb5kdc[10192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468117, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.146.194@KRBTEST.COM; defaulting to no policy
I20260811 17:08:37.322608 10335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:37.306963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:37039 (local address 127.4.146.254:37999)
0811 17:08:37.307115 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:37.307119 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:37.308282 (+ 1163us) server_negotiation.cc:407] Connection header received
0811 17:08:37.310085 (+ 1803us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:37.310090 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:37.310161 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:37.310292 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:37.311793 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:37.312549 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:37.314076 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:37.314341 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:37.314470 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:37.317795 (+ 3325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:37.317801 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:37.317807 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:37.317851 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:37.319854 (+ 2003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:37.320566 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:37.320571 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:37.320573 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:37.320692 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:37.321121 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:37.321128 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:37.321131 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:37.321444 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:37.321576 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:37.322190 (+ 614us) server_negotiation.cc:299] Negotiation successful
0811 17:08:37.322375 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 17:08:37.323542 10614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:37.307393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:37999 (local address 127.4.146.193:37039)
0811 17:08:37.308035 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:37.308089 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:37.309798 (+ 1709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:37.310533 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:37.310543 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:37.311007 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:37.311607 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:37.311624 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:37.312717 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:37.312721 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:37.313883 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:37.313896 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:37.314528 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:37.314533 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:37.314733 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:37.315523 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:37.315543 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:37.317540 (+ 1997us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:37.320016 (+ 2476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:37.320022 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:37.320039 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:37.320437 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:37.320815 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:37.320818 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:37.320819 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:37.320988 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:37.321580 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:37.321587 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:37.321885 (+ 298us) client_negotiation.cc:769] Sending connection context
0811 17:08:37.322054 (+ 169us) client_negotiation.cc:240] Negotiation successful
0811 17:08:37.322435 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":156,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.194@KRBTEST.COM" created.
I20260811 17:08:37.325188 10610 heartbeater.cc:347] Connected to a master server at 127.4.146.254:37999
I20260811 17:08:37.325484 10610 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:37.326185 10610 heartbeater.cc:511] Master 127.4.146.254:37999 requested a full tablet report, sending...
I20260811 17:08:37.328270 10274 ts_manager.cc:194] Registered new tserver with Master: 2f9784dd0200400d97eb9168953f3a64 (127.4.146.193:35323)
I20260811 17:08:37.329941 10274 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.193@KRBTEST.COM'} at 127.4.146.193:37039
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
I20260811 17:08:37.347703 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:37999
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:46815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:37.471293 10623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:37.471675 10623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:37.471733 10623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:37.476174 10623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:37.476253 10623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:37.476317 10623 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:08:37.482120 10623 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:46815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:37999
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10623
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:37.483285 10623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:37.484338 10623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:37.494607 10633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:37.494596 10639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:37.494612 10635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:37.495378 10623 server_base.cc:1034] running on GCE node
I20260811 17:08:37.495903 10623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:37.496658 10623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:37.497830 10623 hybrid_clock.cc:648] HybridClock initialized: now 1786468117497812 us; error 31 us; skew 500 ppm
Aug 11 17:08:37 dist-test-slave-7vjv krb5kdc[10192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468117, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:37.501353 10623 init.cc:377] Logged in from keytab as kudu/127.4.146.194@KRBTEST.COM (short username kudu)
I20260811 17:08:37.502463 10623 webserver.cc:460] Webserver started at http://127.4.146.194:44161/ using document root <none> and password file <none>
I20260811 17:08:37.503126 10623 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:37.503230 10623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:37.503459 10623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:37.505901 10623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "ca87b9f253fd42f6b9b61d279faf4ed7"
format_stamp: "Formatted at 2026-08-11 17:08:37 on dist-test-slave-7vjv"
server_key: "dbcd165e5d5249b2b6773a90b348b976"
server_key_iv: "8d324df1799b808ccf5cf9325790fdcd"
server_key_version: "encryptionkey@0"
I20260811 17:08:37.506560 10623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "ca87b9f253fd42f6b9b61d279faf4ed7"
format_stamp: "Formatted at 2026-08-11 17:08:37 on dist-test-slave-7vjv"
server_key: "dbcd165e5d5249b2b6773a90b348b976"
server_key_iv: "8d324df1799b808ccf5cf9325790fdcd"
server_key_version: "encryptionkey@0"
I20260811 17:08:37.510797 10623 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 17:08:37.513525 10655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:37.514858 10623 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 17:08:37.515017 10623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "ca87b9f253fd42f6b9b61d279faf4ed7"
format_stamp: "Formatted at 2026-08-11 17:08:37 on dist-test-slave-7vjv"
server_key: "dbcd165e5d5249b2b6773a90b348b976"
server_key_iv: "8d324df1799b808ccf5cf9325790fdcd"
server_key_version: "encryptionkey@0"
I20260811 17:08:37.515147 10623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:37.529073 10623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:37.532568 10623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:37.532804 10623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:37.533471 10623 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:37.534405 10623 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:37.534482 10623 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:37.534559 10623 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:37.534603 10623 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:37.545142 10623 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:44875
I20260811 17:08:37.545161 10865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:44875 every 8 connection(s)
I20260811 17:08:37.546181 10623 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:08:37.547070 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 10623
I20260811 17:08:37.547219 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:08:37.547547 4683 external_mini_cluster.cc:1428] Setting key f1e73c74777863989c5d10ba9962935c
Aug 11 17:08:37 dist-test-slave-7vjv krb5kdc[10192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468117, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.195@KRBTEST.COM" created.
I20260811 17:08:37.565474 10335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:37.548310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:53023 (local address 127.4.146.254:37999)
0811 17:08:37.548515 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:37.548521 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:37.549453 (+ 932us) server_negotiation.cc:407] Connection header received
0811 17:08:37.551651 (+ 2198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:37.551658 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:37.551737 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:37.551809 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:37.554124 (+ 2315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:37.554687 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:37.556835 (+ 2148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:37.557075 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:37.557175 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:37.560671 (+ 3496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:37.560675 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:37.560677 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:37.560707 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:37.562658 (+ 1951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:37.563324 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:37.563333 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:37.563334 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:37.563422 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:37.563913 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:37.563916 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:37.563917 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:37.564238 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:37.564352 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:37.565118 (+ 766us) server_negotiation.cc:299] Negotiation successful
0811 17:08:37.565285 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260811 17:08:37.566404 10874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:37.548731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:37999 (local address 127.4.146.194:53023)
0811 17:08:37.549259 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:37.549324 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:37.551322 (+ 1998us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:37.552375 (+ 1053us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:37.552387 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:37.553044 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:37.553897 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:37.553924 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:37.554895 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:37.554902 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:37.556669 (+ 1767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:37.556687 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:37.557286 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:37.557294 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:37.557592 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:37.558383 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:37.558411 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:37.560419 (+ 2008us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:37.562821 (+ 2402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:37.562829 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:37.562852 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:37.563190 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:37.563532 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:37.563535 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:37.563537 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:37.563764 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:37.564363 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:37.564372 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:37.564789 (+ 417us) client_negotiation.cc:769] Sending connection context
0811 17:08:37.565033 (+ 244us) client_negotiation.cc:240] Negotiation successful
0811 17:08:37.565424 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":113,"threads_started":1}
I20260811 17:08:37.567839 10866 heartbeater.cc:347] Connected to a master server at 127.4.146.254:37999
I20260811 17:08:37.568245 10866 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:37.568993 10866 heartbeater.cc:511] Master 127.4.146.254:37999 requested a full tablet report, sending...
I20260811 17:08:37.570240 10274 ts_manager.cc:194] Registered new tserver with Master: ca87b9f253fd42f6b9b61d279faf4ed7 (127.4.146.194:44875)
I20260811 17:08:37.570892 10274 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.194@KRBTEST.COM'} at 127.4.146.194:53023
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
I20260811 17:08:37.584025 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:37999
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:46815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:37.704233 10878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:37.704520 10878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:37.704603 10878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:37.708777 10878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:37.708865 10878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:37.708966 10878 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:08:37.714742 10878 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:46815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:37999
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10878
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:37.715966 10878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:37.717236 10878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:37.727790 10885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:37.727785 10886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:37.727883 10878 server_base.cc:1034] running on GCE node
W20260811 17:08:37.727788 10890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:37.728639 10878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:37.729377 10878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:37.730609 10878 hybrid_clock.cc:648] HybridClock initialized: now 1786468117730561 us; error 53 us; skew 500 ppm
Aug 11 17:08:37 dist-test-slave-7vjv krb5kdc[10192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468117, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:37.733776 10878 init.cc:377] Logged in from keytab as kudu/127.4.146.195@KRBTEST.COM (short username kudu)
I20260811 17:08:37.734866 10878 webserver.cc:460] Webserver started at http://127.4.146.195:45821/ using document root <none> and password file <none>
I20260811 17:08:37.735494 10878 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:37.735605 10878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:37.735864 10878 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:37.738183 10878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "8f8e0a74c97a4c45bc386be495afb8f7"
format_stamp: "Formatted at 2026-08-11 17:08:37 on dist-test-slave-7vjv"
server_key: "c52ff1231ce00bc223b73e229a9f6b13"
server_key_iv: "048db55ffb9b132ae59cd83a8e824303"
server_key_version: "encryptionkey@0"
I20260811 17:08:37.738823 10878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "8f8e0a74c97a4c45bc386be495afb8f7"
format_stamp: "Formatted at 2026-08-11 17:08:37 on dist-test-slave-7vjv"
server_key: "c52ff1231ce00bc223b73e229a9f6b13"
server_key_iv: "048db55ffb9b132ae59cd83a8e824303"
server_key_version: "encryptionkey@0"
I20260811 17:08:37.742978 10878 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 17:08:37.745630 10906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:37.746928 10878 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 17:08:37.747083 10878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "8f8e0a74c97a4c45bc386be495afb8f7"
format_stamp: "Formatted at 2026-08-11 17:08:37 on dist-test-slave-7vjv"
server_key: "c52ff1231ce00bc223b73e229a9f6b13"
server_key_iv: "048db55ffb9b132ae59cd83a8e824303"
server_key_version: "encryptionkey@0"
I20260811 17:08:37.747213 10878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:37.768994 10878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:37.772909 10878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:37.773140 10878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:37.773800 10878 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:37.774715 10878 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:37.774789 10878 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:37.774865 10878 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:37.774921 10878 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:37.784842 10878 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:36529
I20260811 17:08:37.784860 11108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:36529 every 8 connection(s)
I20260811 17:08:37.785854 10878 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:08:37.792470 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 10878
I20260811 17:08:37.792619 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:08:37.792904 4683 external_mini_cluster.cc:1428] Setting key ef05db0936ca21e8099d1408b0b54139
Aug 11 17:08:37 dist-test-slave-7vjv krb5kdc[10192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468117, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:37.800649 10335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:37.787756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:55483 (local address 127.4.146.254:37999)
0811 17:08:37.787893 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:37.787897 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:37.788775 (+ 878us) server_negotiation.cc:407] Connection header received
0811 17:08:37.790181 (+ 1406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:37.790184 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:37.790247 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:37.790352 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:37.791653 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:37.792264 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:37.793723 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:37.794032 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:37.794152 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:37.796860 (+ 2708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:37.796863 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:37.796867 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:37.796896 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:37.798398 (+ 1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:37.798943 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:37.798946 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:37.798948 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:37.799036 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:37.799400 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:37.799404 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:37.799406 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:37.799613 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:37.799735 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:37.800337 (+ 602us) server_negotiation.cc:299] Negotiation successful
0811 17:08:37.800469 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 17:08:37.801707 11114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:37.788136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:37999 (local address 127.4.146.195:55483)
0811 17:08:37.788618 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:37.788663 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:37.789945 (+ 1282us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:37.790544 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:37.790551 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:37.790932 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:37.791477 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:37.791492 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:37.792402 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:37.792405 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:37.793594 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:37.793605 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:37.794210 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:37.794214 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:37.794397 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:37.795047 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:37.795071 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:37.796687 (+ 1616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:37.798525 (+ 1838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:37.798531 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:37.798549 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:37.798831 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:37.799145 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:37.799149 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:37.799151 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:37.799301 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:37.799735 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:37.799743 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:37.800010 (+ 267us) client_negotiation.cc:769] Sending connection context
0811 17:08:37.800296 (+ 286us) client_negotiation.cc:240] Negotiation successful
0811 17:08:37.800648 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":130,"threads_started":1}
I20260811 17:08:37.802995 11110 heartbeater.cc:347] Connected to a master server at 127.4.146.254:37999
I20260811 17:08:37.803297 11110 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:37.803867 11110 heartbeater.cc:511] Master 127.4.146.254:37999 requested a full tablet report, sending...
I20260811 17:08:37.805011 10274 ts_manager.cc:194] Registered new tserver with Master: 8f8e0a74c97a4c45bc386be495afb8f7 (127.4.146.195:36529)
I20260811 17:08:37.805624 10274 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.195@KRBTEST.COM'} at 127.4.146.195:55483
I20260811 17:08:37.807253 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 17:08:37 dist-test-slave-7vjv krb5kdc[10192](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468117, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 17:08:37 dist-test-slave-7vjv krb5kdc[10192](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468117, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:37.837574 10335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:37.828513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47118 (local address 127.4.146.254:37999)
0811 17:08:37.828646 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:37.828658 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:37.828820 (+ 162us) server_negotiation.cc:407] Connection header received
0811 17:08:37.828933 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:37.828936 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:37.828981 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:37.829063 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:37.829968 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:37.830556 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:37.831471 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:37.831700 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:37.831790 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:37.834527 (+ 2737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:37.834531 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:37.834533 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:37.834564 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:37.835907 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:37.836393 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:37.836396 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:37.836397 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:37.836480 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:37.836727 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:37.836729 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:37.836730 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:37.836965 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:37.837070 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:37.837326 (+ 256us) server_negotiation.cc:299] Negotiation successful
0811 17:08:37.837443 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
W20260811 17:08:37.838033 10274 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:47118
I20260811 17:08:37.839146 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 10379
I20260811 17:08:37.857054 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 10623
I20260811 17:08:37.873637 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 10878
I20260811 17:08:37.904546 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 10214
2026-08-11T17:08:37Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2589 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:08:37 dist-test-slave-7vjv krb5kdc[11130](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:08:37 dist-test-slave-7vjv krb5kdc[11130](info): set up 2 sockets
Aug 11 17:08:37 dist-test-slave-7vjv krb5kdc[11130](info): commencing operation
krb5kdc: starting...
W20260811 17:08:39.253707 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.313s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:08:39 dist-test-slave-7vjv krb5kdc[11130](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:08:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:08:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:08:39.395752 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:36295
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:42017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:36295
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:39.515762 11152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:39.516192 11152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:39.516305 11152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:39.520608 11152 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:08:39.520723 11152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:39.520762 11152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:39.520804 11152 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:08:39.520840 11152 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:08:39.526554 11152 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:42017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:36295
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:36295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:39.527758 11152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:39.528873 11152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:39.538082 11163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:39.538256 11152 server_base.cc:1034] running on GCE node
W20260811 17:08:39.539800 11159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:39.539835 11160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:39.540758 11152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:39.541963 11152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:39.543181 11152 hybrid_clock.cc:648] HybridClock initialized: now 1786468119543166 us; error 26 us; skew 500 ppm
Aug 11 17:08:39 dist-test-slave-7vjv krb5kdc[11130](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468119, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:39.546418 11152 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:08:39.547569 11152 webserver.cc:460] Webserver started at http://127.4.146.254:32867/ using document root <none> and password file <none>
I20260811 17:08:39.548270 11152 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:39.548372 11152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:39.548627 11152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:39.550827 11152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "8166d9bb2bec4598b17e675f563e430e"
format_stamp: "Formatted at 2026-08-11 17:08:39 on dist-test-slave-7vjv"
server_key: "8b10ea6bb1ed5e6e565e4ff01760e852"
server_key_iv: "fbac2ea190f5ceb525a38297a2e12459"
server_key_version: "encryptionkey@0"
I20260811 17:08:39.551446 11152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "8166d9bb2bec4598b17e675f563e430e"
format_stamp: "Formatted at 2026-08-11 17:08:39 on dist-test-slave-7vjv"
server_key: "8b10ea6bb1ed5e6e565e4ff01760e852"
server_key_iv: "fbac2ea190f5ceb525a38297a2e12459"
server_key_version: "encryptionkey@0"
I20260811 17:08:39.555480 11152 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 17:08:39.558163 11174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:39.559478 11152 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 17:08:39.559654 11152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "8166d9bb2bec4598b17e675f563e430e"
format_stamp: "Formatted at 2026-08-11 17:08:39 on dist-test-slave-7vjv"
server_key: "8b10ea6bb1ed5e6e565e4ff01760e852"
server_key_iv: "fbac2ea190f5ceb525a38297a2e12459"
server_key_version: "encryptionkey@0"
I20260811 17:08:39.559818 11152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:39.576071 11152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:39.579993 11152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:39.580296 11152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:39.588472 11152 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:36295
I20260811 17:08:39.588500 11263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:36295 every 8 connection(s)
I20260811 17:08:39.589670 11152 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:08:39.592785 11265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:39.594605 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 11152
I20260811 17:08:39.594765 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:08:39.595098 4683 external_mini_cluster.cc:1428] Setting key a13ac0419bc774447c7465da3d4ac278
I20260811 17:08:39.599978 11265 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8166d9bb2bec4598b17e675f563e430e: Bootstrap starting.
I20260811 17:08:39.602753 11265 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8166d9bb2bec4598b17e675f563e430e: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:39.603754 11265 log.cc:824] T 00000000000000000000000000000000 P 8166d9bb2bec4598b17e675f563e430e: Log is configured to *not* fsync() on all Append() calls
Aug 11 17:08:39 dist-test-slave-7vjv krb5kdc[11130](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468119, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:39.606133 11265 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8166d9bb2bec4598b17e675f563e430e: No bootstrap required, opened a new log
I20260811 17:08:39.609910 11265 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8166d9bb2bec4598b17e675f563e430e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8166d9bb2bec4598b17e675f563e430e" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 36295 } }
I20260811 17:08:39.610196 11265 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8166d9bb2bec4598b17e675f563e430e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:39.610255 11265 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8166d9bb2bec4598b17e675f563e430e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8166d9bb2bec4598b17e675f563e430e, State: Initialized, Role: FOLLOWER
I20260811 17:08:39.610706 11265 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8166d9bb2bec4598b17e675f563e430e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8166d9bb2bec4598b17e675f563e430e" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 36295 } }
I20260811 17:08:39.610874 11265 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8166d9bb2bec4598b17e675f563e430e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:08:39.610961 11265 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8166d9bb2bec4598b17e675f563e430e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:08:39.611090 11265 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8166d9bb2bec4598b17e675f563e430e [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:39.611436 11269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:39.596817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56546 (local address 127.4.146.254:36295)
0811 17:08:39.597274 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:39.597299 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:39.597339 (+ 40us) server_negotiation.cc:407] Connection header received
0811 17:08:39.598019 (+ 680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:39.598037 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:39.598372 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:39.598664 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:39.599647 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:39.600802 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:39.602077 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:39.602581 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:39.602719 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:39.605952 (+ 3233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:39.605958 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:39.605973 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:39.606006 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:39.607952 (+ 1946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:39.608540 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:39.608546 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:39.608551 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:39.608675 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:39.609014 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:39.609025 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:39.609026 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:39.609457 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:39.609718 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:39.610047 (+ 329us) server_negotiation.cc:299] Negotiation successful
0811 17:08:39.610417 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":149,"threads_started":1}
I20260811 17:08:39.612363 11265 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8166d9bb2bec4598b17e675f563e430e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8166d9bb2bec4598b17e675f563e430e" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 36295 } }
I20260811 17:08:39.612752 11265 leader_election.cc:302] T 00000000000000000000000000000000 P 8166d9bb2bec4598b17e675f563e430e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8166d9bb2bec4598b17e675f563e430e; no voters:
I20260811 17:08:39.613122 11265 leader_election.cc:288] T 00000000000000000000000000000000 P 8166d9bb2bec4598b17e675f563e430e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:08:39.613214 11272 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8166d9bb2bec4598b17e675f563e430e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:39.613391 11272 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8166d9bb2bec4598b17e675f563e430e [term 1 LEADER]: Becoming Leader. State: Replica: 8166d9bb2bec4598b17e675f563e430e, State: Running, Role: LEADER
I20260811 17:08:39.613708 11272 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8166d9bb2bec4598b17e675f563e430e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8166d9bb2bec4598b17e675f563e430e" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 36295 } }
I20260811 17:08:39.614456 11265 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8166d9bb2bec4598b17e675f563e430e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:08:39.615630 11274 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8166d9bb2bec4598b17e675f563e430e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8166d9bb2bec4598b17e675f563e430e. Latest consensus state: current_term: 1 leader_uuid: "8166d9bb2bec4598b17e675f563e430e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8166d9bb2bec4598b17e675f563e430e" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 36295 } } }
I20260811 17:08:39.615667 11276 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8166d9bb2bec4598b17e675f563e430e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8166d9bb2bec4598b17e675f563e430e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8166d9bb2bec4598b17e675f563e430e" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 36295 } } }
I20260811 17:08:39.615764 11274 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8166d9bb2bec4598b17e675f563e430e [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:39.615772 11276 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8166d9bb2bec4598b17e675f563e430e [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:39.616935 11293 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:08:39.619763 11293 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:08:39.625824 11293 catalog_manager.cc:1347] Generated new cluster ID: 2405a2ba43f645ab89ddd0258e28c869
I20260811 17:08:39.625933 11293 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:08:39.637908 11293 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:08:39.638973 11293 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:08:39.651598 11293 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8166d9bb2bec4598b17e675f563e430e: Generated new TSK 0
I20260811 17:08:39.652772 11293 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
I20260811 17:08:39.696408 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:36295
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:42017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:39.818305 11319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:39.818584 11319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:39.818630 11319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:39.822911 11319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:39.822983 11319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:39.823046 11319 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:08:39.828608 11319 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:42017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:36295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:39.829758 11319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:39.830790 11319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:39.841078 11328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:39.841040 11325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:39.841046 11336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:39.841537 11319 server_base.cc:1034] running on GCE node
I20260811 17:08:39.842003 11319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:39.842717 11319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:39.843947 11319 hybrid_clock.cc:648] HybridClock initialized: now 1786468119843929 us; error 36 us; skew 500 ppm
Aug 11 17:08:39 dist-test-slave-7vjv krb5kdc[11130](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468119, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:39.846956 11319 init.cc:377] Logged in from keytab as kudu/127.4.146.193@KRBTEST.COM (short username kudu)
I20260811 17:08:39.848167 11319 webserver.cc:460] Webserver started at http://127.4.146.193:40689/ using document root <none> and password file <none>
I20260811 17:08:39.848794 11319 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:39.848897 11319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:39.849148 11319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:39.851374 11319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "fb54792396244913abd398a0d6cc8f00"
format_stamp: "Formatted at 2026-08-11 17:08:39 on dist-test-slave-7vjv"
server_key: "09613213acf20ca81764270e35a2963d"
server_key_iv: "2bfa28c13e2f3408e29330be08b1b317"
server_key_version: "encryptionkey@0"
I20260811 17:08:39.851989 11319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "fb54792396244913abd398a0d6cc8f00"
format_stamp: "Formatted at 2026-08-11 17:08:39 on dist-test-slave-7vjv"
server_key: "09613213acf20ca81764270e35a2963d"
server_key_iv: "2bfa28c13e2f3408e29330be08b1b317"
server_key_version: "encryptionkey@0"
I20260811 17:08:39.856236 11319 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 17:08:39.858822 11347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:39.860154 11319 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 17:08:39.860307 11319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "fb54792396244913abd398a0d6cc8f00"
format_stamp: "Formatted at 2026-08-11 17:08:39 on dist-test-slave-7vjv"
server_key: "09613213acf20ca81764270e35a2963d"
server_key_iv: "2bfa28c13e2f3408e29330be08b1b317"
server_key_version: "encryptionkey@0"
I20260811 17:08:39.860428 11319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:39.873732 11319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:39.877147 11319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:39.877377 11319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:39.878002 11319 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:39.878899 11319 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:39.878983 11319 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:39.879062 11319 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:39.879108 11319 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:39.888732 11319 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:36881
I20260811 17:08:39.888758 11555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:36881 every 8 connection(s)
I20260811 17:08:39.889834 11319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:08:39.895102 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 11319
I20260811 17:08:39.895273 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
I20260811 17:08:39.895596 4683 external_mini_cluster.cc:1428] Setting key 234b183986d826823d4e0d241f88bc17
Aug 11 17:08:39 dist-test-slave-7vjv krb5kdc[11130](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468119, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:39.906127 11269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:39.892180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:60031 (local address 127.4.146.254:36295)
0811 17:08:39.892354 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:39.892358 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:39.893288 (+ 930us) server_negotiation.cc:407] Connection header received
0811 17:08:39.894872 (+ 1584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:39.894876 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:39.894946 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:39.895099 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:39.896749 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:39.897355 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:39.898733 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:39.899009 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:39.899157 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:39.902120 (+ 2963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:39.902123 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:39.902125 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:39.902152 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:39.903702 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:39.904390 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:39.904394 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:39.904395 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:39.904478 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:39.904863 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:39.904866 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:39.904868 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:39.905072 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:39.905216 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:39.905785 (+ 569us) server_negotiation.cc:299] Negotiation successful
0811 17:08:39.905935 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
WARNING: no policy specified for kudu/127.4.146.194@KRBTEST.COM; defaulting to no policy
I20260811 17:08:39.907027 11558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:39.892590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:36295 (local address 127.4.146.193:60031)
0811 17:08:39.893098 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:39.893151 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:39.894608 (+ 1457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:39.895351 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:39.895365 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:39.895898 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:39.896562 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:39.896579 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:39.897517 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:39.897527 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:39.898567 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:39.898579 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:39.899218 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:39.899223 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:39.899422 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:39.900229 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:39.900247 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:39.901906 (+ 1659us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:39.903851 (+ 1945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:39.903858 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:39.903878 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:39.904267 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:39.904586 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:39.904590 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:39.904591 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:39.904753 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:39.905216 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:39.905225 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:39.905519 (+ 294us) client_negotiation.cc:769] Sending connection context
0811 17:08:39.905729 (+ 210us) client_negotiation.cc:240] Negotiation successful
0811 17:08:39.906118 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":125,"threads_started":1}
I20260811 17:08:39.908597 11556 heartbeater.cc:347] Connected to a master server at 127.4.146.254:36295
I20260811 17:08:39.908854 11556 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.194@KRBTEST.COM" created.
I20260811 17:08:39.909581 11556 heartbeater.cc:511] Master 127.4.146.254:36295 requested a full tablet report, sending...
I20260811 17:08:39.911512 11190 ts_manager.cc:194] Registered new tserver with Master: fb54792396244913abd398a0d6cc8f00 (127.4.146.193:36881)
I20260811 17:08:39.912889 11190 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.193@KRBTEST.COM'} at 127.4.146.193:60031
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
I20260811 17:08:39.931131 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:36295
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:42017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:40.051052 11563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:40.051370 11563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:40.051416 11563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:40.055625 11563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:40.055706 11563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:40.055768 11563 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:08:40.061429 11563 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:42017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:36295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11563
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:40.062501 11563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:40.063580 11563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:40.074996 11575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:40.074999 11578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:40.075222 11563 server_base.cc:1034] running on GCE node
W20260811 17:08:40.075021 11576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:40.075794 11563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:40.076622 11563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:40.077852 11563 hybrid_clock.cc:648] HybridClock initialized: now 1786468120077810 us; error 54 us; skew 500 ppm
Aug 11 17:08:40 dist-test-slave-7vjv krb5kdc[11130](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468120, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:40.081393 11563 init.cc:377] Logged in from keytab as kudu/127.4.146.194@KRBTEST.COM (short username kudu)
I20260811 17:08:40.082463 11563 webserver.cc:460] Webserver started at http://127.4.146.194:40075/ using document root <none> and password file <none>
I20260811 17:08:40.083117 11563 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:40.083374 11563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:40.083666 11563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:40.086196 11563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "73e1781d7ed2435fbaa13b9afa65562b"
format_stamp: "Formatted at 2026-08-11 17:08:40 on dist-test-slave-7vjv"
server_key: "18fc88b2d18a83b3a41dfea4ae827caf"
server_key_iv: "55acb5cb6d7b5a75fcb8c41e96c53e0c"
server_key_version: "encryptionkey@0"
I20260811 17:08:40.086905 11563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "73e1781d7ed2435fbaa13b9afa65562b"
format_stamp: "Formatted at 2026-08-11 17:08:40 on dist-test-slave-7vjv"
server_key: "18fc88b2d18a83b3a41dfea4ae827caf"
server_key_iv: "55acb5cb6d7b5a75fcb8c41e96c53e0c"
server_key_version: "encryptionkey@0"
I20260811 17:08:40.091444 11563 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260811 17:08:40.094797 11591 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:40.096400 11563 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:08:40.096550 11563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "73e1781d7ed2435fbaa13b9afa65562b"
format_stamp: "Formatted at 2026-08-11 17:08:40 on dist-test-slave-7vjv"
server_key: "18fc88b2d18a83b3a41dfea4ae827caf"
server_key_iv: "55acb5cb6d7b5a75fcb8c41e96c53e0c"
server_key_version: "encryptionkey@0"
I20260811 17:08:40.096688 11563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:40.113755 11563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:40.118127 11563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:40.118382 11563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:40.119124 11563 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:40.120211 11563 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:40.120282 11563 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:40.120353 11563 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:40.120404 11563 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:40.129943 11563 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:35837
I20260811 17:08:40.129966 11791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:35837 every 8 connection(s)
I20260811 17:08:40.130954 11563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:08:40.140146 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 11563
I20260811 17:08:40.140286 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:08:40.140620 4683 external_mini_cluster.cc:1428] Setting key 32d6a298fba0a9998e37d48e84a85685
Aug 11 17:08:40 dist-test-slave-7vjv krb5kdc[11130](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468120, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:40.147390 11269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:40.133048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:42149 (local address 127.4.146.254:36295)
0811 17:08:40.133196 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:40.133200 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:40.134133 (+ 933us) server_negotiation.cc:407] Connection header received
0811 17:08:40.135799 (+ 1666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:40.135803 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:40.135858 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:40.135943 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:40.137415 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:40.137964 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:40.139234 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:40.139457 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:40.139546 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:40.142553 (+ 3007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:40.142559 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:40.142562 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:40.142595 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:40.144651 (+ 2056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:40.145403 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:40.145406 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:40.145408 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:40.145516 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:40.146015 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:40.146018 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:40.146020 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:40.146250 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:40.146339 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:40.147133 (+ 794us) server_negotiation.cc:299] Negotiation successful
0811 17:08:40.147264 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 17:08:40.148736 11794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:40.133471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:36295 (local address 127.4.146.194:42149)
0811 17:08:40.133956 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:40.134003 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:40.135503 (+ 1500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:40.136227 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:40.136235 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:40.136703 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:40.137241 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:40.137256 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:40.138127 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:40.138130 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:40.139095 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:40.139106 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:40.139616 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:40.139619 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:40.139791 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:40.140551 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:40.140570 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:40.142361 (+ 1791us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:40.144812 (+ 2451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:40.144824 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:40.144846 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:40.145281 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:40.145622 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:40.145627 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:40.145630 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:40.145864 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:40.146370 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:40.146380 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:40.146774 (+ 394us) client_negotiation.cc:769] Sending connection context
0811 17:08:40.147017 (+ 243us) client_negotiation.cc:240] Negotiation successful
0811 17:08:40.147431 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":118,"threads_started":1}
I20260811 17:08:40.150182 11792 heartbeater.cc:347] Connected to a master server at 127.4.146.254:36295
I20260811 17:08:40.150461 11792 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:40.151000 11792 heartbeater.cc:511] Master 127.4.146.254:36295 requested a full tablet report, sending...
I20260811 17:08:40.152346 11190 ts_manager.cc:194] Registered new tserver with Master: 73e1781d7ed2435fbaa13b9afa65562b (127.4.146.194:35837)
I20260811 17:08:40.152974 11190 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.194@KRBTEST.COM'} at 127.4.146.194:42149
WARNING: no policy specified for kudu/127.4.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
I20260811 17:08:40.177347 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:36295
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:42017
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:40.297531 11798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:40.297870 11798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:40.297956 11798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:40.302317 11798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:40.302414 11798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:40.302510 11798 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:08:40.307911 11798 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:42017
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:36295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:40.309123 11798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:40.310180 11798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:40.320688 11813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:40.320801 11808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:40.320815 11807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:40.321074 11798 server_base.cc:1034] running on GCE node
I20260811 17:08:40.321550 11798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:40.322242 11798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:40.323447 11798 hybrid_clock.cc:648] HybridClock initialized: now 1786468120323387 us; error 108 us; skew 500 ppm
Aug 11 17:08:40 dist-test-slave-7vjv krb5kdc[11130](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468120, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:40.330257 11798 init.cc:377] Logged in from keytab as kudu/127.4.146.195@KRBTEST.COM (short username kudu)
I20260811 17:08:40.331453 11798 webserver.cc:460] Webserver started at http://127.4.146.195:45681/ using document root <none> and password file <none>
I20260811 17:08:40.332141 11798 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:40.332254 11798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:40.332588 11798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:40.334905 11798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "8b019c1898364da7944ed10e3a06e3f1"
format_stamp: "Formatted at 2026-08-11 17:08:40 on dist-test-slave-7vjv"
server_key: "8c407415eb71184c863a874576f3369e"
server_key_iv: "218dee97037a1e942641c398864d5a75"
server_key_version: "encryptionkey@0"
I20260811 17:08:40.335886 11798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "8b019c1898364da7944ed10e3a06e3f1"
format_stamp: "Formatted at 2026-08-11 17:08:40 on dist-test-slave-7vjv"
server_key: "8c407415eb71184c863a874576f3369e"
server_key_iv: "218dee97037a1e942641c398864d5a75"
server_key_version: "encryptionkey@0"
I20260811 17:08:40.342453 11798 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 17:08:40.345355 11825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:40.346815 11798 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 17:08:40.346993 11798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "8b019c1898364da7944ed10e3a06e3f1"
format_stamp: "Formatted at 2026-08-11 17:08:40 on dist-test-slave-7vjv"
server_key: "8c407415eb71184c863a874576f3369e"
server_key_iv: "218dee97037a1e942641c398864d5a75"
server_key_version: "encryptionkey@0"
I20260811 17:08:40.347137 11798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:40.378576 11798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:40.382157 11798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:40.382393 11798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:40.383064 11798 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:40.384028 11798 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:40.384104 11798 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:40.384230 11798 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:40.384284 11798 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:40.394734 11798 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:46309
I20260811 17:08:40.394760 12019 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:46309 every 8 connection(s)
I20260811 17:08:40.395834 11798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:08:40.396139 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 11798
I20260811 17:08:40.396286 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:08:40.396631 4683 external_mini_cluster.cc:1428] Setting key a66a5e3fc15b3266ac10ad6f5cd91cb4
Aug 11 17:08:40 dist-test-slave-7vjv krb5kdc[11130](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468120, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:40.412459 11269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:40.398237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:41083 (local address 127.4.146.254:36295)
0811 17:08:40.398383 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:40.398388 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:40.399766 (+ 1378us) server_negotiation.cc:407] Connection header received
0811 17:08:40.401734 (+ 1968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:40.401737 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:40.401791 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:40.401881 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:40.403289 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:40.403856 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:40.405095 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:40.405313 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:40.405398 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:40.408066 (+ 2668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:40.408069 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:40.408071 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:40.408169 (+ 98us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:40.409503 (+ 1334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:40.410273 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:40.410276 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:40.410277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:40.410392 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:40.410922 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:40.410925 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:40.410927 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:40.411306 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:40.411425 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:40.412216 (+ 791us) server_negotiation.cc:299] Negotiation successful
0811 17:08:40.412334 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 17:08:40.413434 12023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:40.398833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:36295 (local address 127.4.146.195:41083)
0811 17:08:40.399583 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:40.399643 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:40.401420 (+ 1777us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:40.402113 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:40.402121 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:40.402557 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:40.403093 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:40.403109 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:40.403979 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:40.403981 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:40.404978 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:40.404987 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:40.405455 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:40.405457 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:40.405609 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:40.406259 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:40.406277 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:40.407891 (+ 1614us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:40.409661 (+ 1770us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:40.409669 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:40.409686 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:40.410141 (+ 455us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:40.410561 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:40.410566 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:40.410568 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:40.410781 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:40.411431 (+ 650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:40.411437 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:40.411797 (+ 360us) client_negotiation.cc:769] Sending connection context
0811 17:08:40.412048 (+ 251us) client_negotiation.cc:240] Negotiation successful
0811 17:08:40.412416 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":182,"threads_started":1}
I20260811 17:08:40.414834 12021 heartbeater.cc:347] Connected to a master server at 127.4.146.254:36295
I20260811 17:08:40.415149 12021 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:40.415853 12021 heartbeater.cc:511] Master 127.4.146.254:36295 requested a full tablet report, sending...
I20260811 17:08:40.417168 11190 ts_manager.cc:194] Registered new tserver with Master: 8b019c1898364da7944ed10e3a06e3f1 (127.4.146.195:46309)
I20260811 17:08:40.417776 11190 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.195@KRBTEST.COM'} at 127.4.146.195:41083
I20260811 17:08:40.424009 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 17:08:40 dist-test-slave-7vjv krb5kdc[11130](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468120, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 17:08:40 dist-test-slave-7vjv krb5kdc[11130](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468120, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.193@KRBTEST.COM
I20260811 17:08:40.453550 12032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:40.443335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52268 (local address 127.4.146.193:36881)
0811 17:08:40.443654 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:40.443663 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:40.443695 (+ 32us) server_negotiation.cc:407] Connection header received
0811 17:08:40.443765 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:40.443772 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:40.443981 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:40.444194 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:40.444955 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:40.445758 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:40.446656 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:40.447055 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:40.447172 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:40.449812 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:40.449822 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:40.449836 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:40.449862 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:40.451466 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:40.451953 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:40.451958 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:40.451959 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:40.452044 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:40.452445 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:40.452452 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:40.452454 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:40.452808 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:40.452988 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:40.453227 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 17:08:40.453363 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":75,"threads_started":1}
Aug 11 17:08:40 dist-test-slave-7vjv krb5kdc[11130](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468120, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:40.466113 11269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:40.456806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56558 (local address 127.4.146.254:36295)
0811 17:08:40.456970 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:40.456975 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:40.457063 (+ 88us) server_negotiation.cc:407] Connection header received
0811 17:08:40.457255 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:40.457258 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:40.457304 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:40.457396 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:40.458076 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:40.458626 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:40.459443 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:40.459675 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:40.459802 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:40.462370 (+ 2568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:40.462373 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:40.462375 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:40.462405 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:40.464002 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:40.464550 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:40.464554 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:40.464556 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:40.464653 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:40.465021 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:40.465024 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:40.465026 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:40.465301 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:40.465418 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:40.465753 (+ 335us) server_negotiation.cc:299] Negotiation successful
0811 17:08:40.465879 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260811 17:08:40.466750 11190 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56558
I20260811 17:08:40.467500 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 11319
I20260811 17:08:40.489454 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 11563
I20260811 17:08:40.500995 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 11798
I20260811 17:08:40.520972 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 11152
2026-08-11T17:08:40Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2618 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:08:40 dist-test-slave-7vjv krb5kdc[12038](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:08:40 dist-test-slave-7vjv krb5kdc[12038](info): set up 2 sockets
Aug 11 17:08:40 dist-test-slave-7vjv krb5kdc[12038](info): commencing operation
krb5kdc: starting...
W20260811 17:08:41.935660 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.377s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:08:42 dist-test-slave-7vjv krb5kdc[12038](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468122, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:08:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:08:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:08:42.085340 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:41873
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:43157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:41873
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:42.204419 12058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:42.204792 12058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:42.204881 12058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:42.209084 12058 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:08:42.209210 12058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:42.209249 12058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:42.209291 12058 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:08:42.209328 12058 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:08:42.215121 12058 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:43157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:41873
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:41873
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12058
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:42.216480 12058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:42.217685 12058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:42.226802 12070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:42.226965 12058 server_base.cc:1034] running on GCE node
W20260811 17:08:42.226854 12066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:42.226858 12074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:42.227749 12058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:42.229146 12058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:42.230341 12058 hybrid_clock.cc:648] HybridClock initialized: now 1786468122230322 us; error 35 us; skew 500 ppm
Aug 11 17:08:42 dist-test-slave-7vjv krb5kdc[12038](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468122, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:42.233911 12058 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:08:42.234915 12058 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:42.235011 12058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:42.235284 12058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:42.237761 12058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "e0109ecdedf641c4a226425e78b332c7"
format_stamp: "Formatted at 2026-08-11 17:08:42 on dist-test-slave-7vjv"
server_key: "9f9e2c3bb37ae185ec9c575a303c1c7d"
server_key_iv: "c1bbf0e0f6b9736f908ad0f3ae345e7b"
server_key_version: "encryptionkey@0"
I20260811 17:08:42.238515 12058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "e0109ecdedf641c4a226425e78b332c7"
format_stamp: "Formatted at 2026-08-11 17:08:42 on dist-test-slave-7vjv"
server_key: "9f9e2c3bb37ae185ec9c575a303c1c7d"
server_key_iv: "c1bbf0e0f6b9736f908ad0f3ae345e7b"
server_key_version: "encryptionkey@0"
I20260811 17:08:42.242868 12058 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 17:08:42.245692 12091 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:42.247013 12058 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 17:08:42.247211 12058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "e0109ecdedf641c4a226425e78b332c7"
format_stamp: "Formatted at 2026-08-11 17:08:42 on dist-test-slave-7vjv"
server_key: "9f9e2c3bb37ae185ec9c575a303c1c7d"
server_key_iv: "c1bbf0e0f6b9736f908ad0f3ae345e7b"
server_key_version: "encryptionkey@0"
I20260811 17:08:42.247345 12058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:42.265175 12058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:42.268946 12058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:42.269196 12058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:42.277335 12058 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:41873
I20260811 17:08:42.277690 12180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:41873 every 8 connection(s)
I20260811 17:08:42.278188 12058 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:08:42.281338 12181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:42.283927 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 12058
I20260811 17:08:42.284077 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:08:42.284440 4683 external_mini_cluster.cc:1428] Setting key b5b406119950cbafc6b67d701a163657
I20260811 17:08:42.289506 12181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0109ecdedf641c4a226425e78b332c7: Bootstrap starting.
I20260811 17:08:42.292375 12181 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e0109ecdedf641c4a226425e78b332c7: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:42.293190 12181 log.cc:824] T 00000000000000000000000000000000 P e0109ecdedf641c4a226425e78b332c7: Log is configured to *not* fsync() on all Append() calls
Aug 11 17:08:42 dist-test-slave-7vjv krb5kdc[12038](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468122, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:42.295749 12181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0109ecdedf641c4a226425e78b332c7: No bootstrap required, opened a new log
I20260811 17:08:42.299542 12181 raft_consensus.cc:348] T 00000000000000000000000000000000 P e0109ecdedf641c4a226425e78b332c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0109ecdedf641c4a226425e78b332c7" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41873 } }
I20260811 17:08:42.299863 12181 raft_consensus.cc:374] T 00000000000000000000000000000000 P e0109ecdedf641c4a226425e78b332c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:42.299953 12181 raft_consensus.cc:729] T 00000000000000000000000000000000 P e0109ecdedf641c4a226425e78b332c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0109ecdedf641c4a226425e78b332c7, State: Initialized, Role: FOLLOWER
I20260811 17:08:42.300529 12181 consensus_queue.cc:260] T 00000000000000000000000000000000 P e0109ecdedf641c4a226425e78b332c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0109ecdedf641c4a226425e78b332c7" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41873 } }
I20260811 17:08:42.300707 12181 raft_consensus.cc:388] T 00000000000000000000000000000000 P e0109ecdedf641c4a226425e78b332c7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:08:42.300774 12181 raft_consensus.cc:482] T 00000000000000000000000000000000 P e0109ecdedf641c4a226425e78b332c7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:08:42.300884 12181 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e0109ecdedf641c4a226425e78b332c7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:42.301832 12189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:42.286245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53100 (local address 127.4.146.254:41873)
0811 17:08:42.286692 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:42.286720 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:42.286766 (+ 46us) server_negotiation.cc:407] Connection header received
0811 17:08:42.287457 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:42.287475 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:42.287828 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:42.288188 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:42.289196 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:42.290478 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:42.291724 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:42.292408 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:42.292727 (+ 319us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:42.295923 (+ 3196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:42.295937 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:42.295954 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:42.295990 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:42.298412 (+ 2422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:42.299036 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:42.299042 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:42.299047 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:42.299206 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:42.299533 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:42.299536 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:42.299540 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:42.300094 (+ 554us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:42.300380 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:42.300641 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 17:08:42.301006 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":158,"threads_started":1}
I20260811 17:08:42.301987 12181 raft_consensus.cc:504] T 00000000000000000000000000000000 P e0109ecdedf641c4a226425e78b332c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0109ecdedf641c4a226425e78b332c7" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41873 } }
I20260811 17:08:42.302369 12181 leader_election.cc:302] T 00000000000000000000000000000000 P e0109ecdedf641c4a226425e78b332c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e0109ecdedf641c4a226425e78b332c7; no voters:
I20260811 17:08:42.302795 12181 leader_election.cc:288] T 00000000000000000000000000000000 P e0109ecdedf641c4a226425e78b332c7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:08:42.302889 12196 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e0109ecdedf641c4a226425e78b332c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:42.303076 12196 raft_consensus.cc:686] T 00000000000000000000000000000000 P e0109ecdedf641c4a226425e78b332c7 [term 1 LEADER]: Becoming Leader. State: Replica: e0109ecdedf641c4a226425e78b332c7, State: Running, Role: LEADER
I20260811 17:08:42.303391 12196 consensus_queue.cc:237] T 00000000000000000000000000000000 P e0109ecdedf641c4a226425e78b332c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0109ecdedf641c4a226425e78b332c7" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41873 } }
I20260811 17:08:42.304196 12181 sys_catalog.cc:564] T 00000000000000000000000000000000 P e0109ecdedf641c4a226425e78b332c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:08:42.305287 12197 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0109ecdedf641c4a226425e78b332c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e0109ecdedf641c4a226425e78b332c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0109ecdedf641c4a226425e78b332c7" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41873 } } }
I20260811 17:08:42.305308 12198 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0109ecdedf641c4a226425e78b332c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e0109ecdedf641c4a226425e78b332c7. Latest consensus state: current_term: 1 leader_uuid: "e0109ecdedf641c4a226425e78b332c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0109ecdedf641c4a226425e78b332c7" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41873 } } }
I20260811 17:08:42.305590 12197 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0109ecdedf641c4a226425e78b332c7 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:42.305617 12198 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0109ecdedf641c4a226425e78b332c7 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:42.306176 12211 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:08:42.310268 12211 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:08:42.317533 12211 catalog_manager.cc:1347] Generated new cluster ID: fbbabcac0dff451c86c53209020c6bdd
I20260811 17:08:42.317641 12211 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:08:42.345299 12211 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:08:42.346716 12211 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:08:42.357268 12211 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e0109ecdedf641c4a226425e78b332c7: Generated new TSK 0
I20260811 17:08:42.358415 12211 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
I20260811 17:08:42.395345 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:41873
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:43157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:42.521281 12235 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:42.521577 12235 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:42.521626 12235 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:42.525794 12235 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:42.525866 12235 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:42.525930 12235 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:08:42.531677 12235 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:43157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:41873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12235
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:42.533111 12235 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:42.534282 12235 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:42.544435 12241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:42.544523 12244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:42.544461 12246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:42.544756 12235 server_base.cc:1034] running on GCE node
I20260811 17:08:42.545291 12235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:42.546020 12235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:42.547230 12235 hybrid_clock.cc:648] HybridClock initialized: now 1786468122547210 us; error 38 us; skew 500 ppm
Aug 11 17:08:42 dist-test-slave-7vjv krb5kdc[12038](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468122, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:42.550640 12235 init.cc:377] Logged in from keytab as kudu/127.4.146.193@KRBTEST.COM (short username kudu)
I20260811 17:08:42.551525 12235 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:42.551642 12235 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:42.551900 12235 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:42.554239 12235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "afad82bf852e42298e0a1ebb232e7c3e"
format_stamp: "Formatted at 2026-08-11 17:08:42 on dist-test-slave-7vjv"
server_key: "026dcb5f045dece1ac7aa1f42f06bd57"
server_key_iv: "5de03fc1f0fc9474131bb137484ac856"
server_key_version: "encryptionkey@0"
I20260811 17:08:42.554867 12235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "afad82bf852e42298e0a1ebb232e7c3e"
format_stamp: "Formatted at 2026-08-11 17:08:42 on dist-test-slave-7vjv"
server_key: "026dcb5f045dece1ac7aa1f42f06bd57"
server_key_iv: "5de03fc1f0fc9474131bb137484ac856"
server_key_version: "encryptionkey@0"
I20260811 17:08:42.559319 12235 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260811 17:08:42.562083 12259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:42.563645 12235 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 17:08:42.563807 12235 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "afad82bf852e42298e0a1ebb232e7c3e"
format_stamp: "Formatted at 2026-08-11 17:08:42 on dist-test-slave-7vjv"
server_key: "026dcb5f045dece1ac7aa1f42f06bd57"
server_key_iv: "5de03fc1f0fc9474131bb137484ac856"
server_key_version: "encryptionkey@0"
I20260811 17:08:42.563941 12235 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:42.600384 12235 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:42.604411 12235 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:42.604653 12235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:42.605436 12235 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:42.606501 12235 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:42.606577 12235 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:42.606653 12235 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:42.606704 12235 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:42.616554 12235 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:40321
I20260811 17:08:42.616590 12476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:40321 every 8 connection(s)
I20260811 17:08:42.617228 12235 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:08:42.624328 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 12235
I20260811 17:08:42.624439 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
I20260811 17:08:42.624716 4683 external_mini_cluster.cc:1428] Setting key 2847e1752e77c6cb86508bde052c977d
Aug 11 17:08:42 dist-test-slave-7vjv krb5kdc[12038](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468122, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:42.632869 12189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:42.619346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:46701 (local address 127.4.146.254:41873)
0811 17:08:42.619528 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:42.619534 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:42.620545 (+ 1011us) server_negotiation.cc:407] Connection header received
0811 17:08:42.621872 (+ 1327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:42.621875 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:42.621926 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:42.622008 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:42.623341 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:42.623900 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:42.625379 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:42.625669 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:42.625760 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:42.628624 (+ 2864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:42.628627 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:42.628630 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:42.628654 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:42.630203 (+ 1549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:42.630944 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:42.630948 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:42.630949 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:42.631048 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:42.631517 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:42.631519 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:42.631521 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:42.631730 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:42.631818 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:42.632610 (+ 792us) server_negotiation.cc:299] Negotiation successful
0811 17:08:42.632738 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":65}
I20260811 17:08:42.634229 12481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:42.619822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:41873 (local address 127.4.146.193:46701)
0811 17:08:42.620382 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:42.620429 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:42.621646 (+ 1217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:42.622219 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:42.622226 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:42.622644 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:42.623168 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:42.623183 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:42.624047 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:42.624050 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:42.625238 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:42.625251 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:42.625841 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:42.625846 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:42.626046 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:42.626817 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:42.626834 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:42.628436 (+ 1602us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:42.630341 (+ 1905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:42.630350 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:42.630370 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:42.630769 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:42.631156 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:42.631162 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:42.631167 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:42.631372 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:42.631851 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:42.631862 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:42.632284 (+ 422us) client_negotiation.cc:769] Sending connection context
0811 17:08:42.632530 (+ 246us) client_negotiation.cc:240] Negotiation successful
0811 17:08:42.632946 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":124,"threads_started":1}
I20260811 17:08:42.635705 12479 heartbeater.cc:347] Connected to a master server at 127.4.146.254:41873
I20260811 17:08:42.635986 12479 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:42.636543 12479 heartbeater.cc:511] Master 127.4.146.254:41873 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.4.146.194@KRBTEST.COM; defaulting to no policy
I20260811 17:08:42.638537 12121 ts_manager.cc:194] Registered new tserver with Master: afad82bf852e42298e0a1ebb232e7c3e (127.4.146.193:40321)
I20260811 17:08:42.639775 12121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.193@KRBTEST.COM'} at 127.4.146.193:46701
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
I20260811 17:08:42.660770 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:41873
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:43157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:42.789264 12489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:42.789603 12489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:42.789685 12489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:42.793787 12489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:42.793888 12489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:42.793994 12489 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:08:42.799546 12489 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:43157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:41873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:42.800894 12489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:42.802019 12489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:42.812875 12499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:42.812875 12503 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:42.812928 12500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:42.813271 12489 server_base.cc:1034] running on GCE node
I20260811 17:08:42.813747 12489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:42.814487 12489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:42.815696 12489 hybrid_clock.cc:648] HybridClock initialized: now 1786468122815677 us; error 33 us; skew 500 ppm
Aug 11 17:08:42 dist-test-slave-7vjv krb5kdc[12038](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468122, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:42.819065 12489 init.cc:377] Logged in from keytab as kudu/127.4.146.194@KRBTEST.COM (short username kudu)
I20260811 17:08:42.819972 12489 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:42.820073 12489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:42.820338 12489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:42.822511 12489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "146a799f83fe499683fadb201e882dfc"
format_stamp: "Formatted at 2026-08-11 17:08:42 on dist-test-slave-7vjv"
server_key: "f5001ceb8160c7ce04061b6d8d1a1b92"
server_key_iv: "e08a3f0adf3383e4ad70dfa55beadf06"
server_key_version: "encryptionkey@0"
I20260811 17:08:42.823129 12489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "146a799f83fe499683fadb201e882dfc"
format_stamp: "Formatted at 2026-08-11 17:08:42 on dist-test-slave-7vjv"
server_key: "f5001ceb8160c7ce04061b6d8d1a1b92"
server_key_iv: "e08a3f0adf3383e4ad70dfa55beadf06"
server_key_version: "encryptionkey@0"
I20260811 17:08:42.827098 12489 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260811 17:08:42.829921 12516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:42.831296 12489 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 17:08:42.831445 12489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "146a799f83fe499683fadb201e882dfc"
format_stamp: "Formatted at 2026-08-11 17:08:42 on dist-test-slave-7vjv"
server_key: "f5001ceb8160c7ce04061b6d8d1a1b92"
server_key_iv: "e08a3f0adf3383e4ad70dfa55beadf06"
server_key_version: "encryptionkey@0"
I20260811 17:08:42.831569 12489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:42.841704 12489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:42.844810 12489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:42.845024 12489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:42.845661 12489 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:42.846539 12489 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:42.846611 12489 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:42.846686 12489 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:42.846730 12489 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:42.857291 12489 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:41275
I20260811 17:08:42.857311 12719 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:41275 every 8 connection(s)
I20260811 17:08:42.857959 12489 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:08:42.859795 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 12489
I20260811 17:08:42.859951 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:08:42.860363 4683 external_mini_cluster.cc:1428] Setting key df2a36c1ab4aede42e2c3147a73031b8
Aug 11 17:08:42 dist-test-slave-7vjv krb5kdc[12038](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468122, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.146.195@KRBTEST.COM; defaulting to no policy
I20260811 17:08:42.874343 12189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:42.860242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:43695 (local address 127.4.146.254:41873)
0811 17:08:42.860893 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:42.860898 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:42.861481 (+ 583us) server_negotiation.cc:407] Connection header received
0811 17:08:42.862867 (+ 1386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:42.862871 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:42.862933 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:42.863024 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:42.864372 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:42.864926 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:42.866155 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:42.866400 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:42.866537 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:42.869975 (+ 3438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:42.869983 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:42.869988 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:42.870029 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:42.871892 (+ 1863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:42.872595 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:42.872599 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:42.872600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:42.872689 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:42.873061 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:42.873065 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:42.873067 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:42.873348 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:42.873452 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:42.873999 (+ 547us) server_negotiation.cc:299] Negotiation successful
0811 17:08:42.874131 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.195@KRBTEST.COM" created.
I20260811 17:08:42.875440 12724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:42.860694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:41873 (local address 127.4.146.194:43695)
0811 17:08:42.861301 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:42.861361 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:42.862628 (+ 1267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:42.863209 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:42.863217 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:42.863614 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:42.864215 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:42.864233 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:42.865074 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:42.865078 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:42.866007 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:42.866018 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:42.866581 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:42.866585 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:42.866779 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:42.867678 (+ 899us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:42.867696 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:42.869741 (+ 2045us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:42.872046 (+ 2305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:42.872052 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:42.872067 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:42.872445 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:42.872777 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:42.872780 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:42.872781 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:42.872928 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:42.873452 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:42.873458 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:42.873751 (+ 293us) client_negotiation.cc:769] Sending connection context
0811 17:08:42.873917 (+ 166us) client_negotiation.cc:240] Negotiation successful
0811 17:08:42.874244 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":198,"threads_started":1}
I20260811 17:08:42.876713 12720 heartbeater.cc:347] Connected to a master server at 127.4.146.254:41873
I20260811 17:08:42.876992 12720 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:42.877599 12720 heartbeater.cc:511] Master 127.4.146.254:41873 requested a full tablet report, sending...
I20260811 17:08:42.878923 12121 ts_manager.cc:194] Registered new tserver with Master: 146a799f83fe499683fadb201e882dfc (127.4.146.194:41275)
I20260811 17:08:42.879581 12121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.194@KRBTEST.COM'} at 127.4.146.194:43695
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
I20260811 17:08:42.895721 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:41873
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:43157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:43.022744 12728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:43.023126 12728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:43.023243 12728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:43.027592 12728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:43.027719 12728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:43.027824 12728 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:08:43.033782 12728 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:43157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:41873
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12728
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:43.035193 12728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:43.036482 12728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:43.046936 12737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:43.046936 12736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:43.047111 12742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:43.047606 12728 server_base.cc:1034] running on GCE node
I20260811 17:08:43.048252 12728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:43.048985 12728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:43.050202 12728 hybrid_clock.cc:648] HybridClock initialized: now 1786468123050170 us; error 45 us; skew 500 ppm
Aug 11 17:08:43 dist-test-slave-7vjv krb5kdc[12038](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468123, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:43.053634 12728 init.cc:377] Logged in from keytab as kudu/127.4.146.195@KRBTEST.COM (short username kudu)
I20260811 17:08:43.054523 12728 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:43.054630 12728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:43.054872 12728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:43.057190 12728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "951155d7971d4b0dab19e4928cdd6bea"
format_stamp: "Formatted at 2026-08-11 17:08:43 on dist-test-slave-7vjv"
server_key: "cfa066b8426d27baa061a4613fca9c8e"
server_key_iv: "2c79327e8789635392bc317c3e8a82ff"
server_key_version: "encryptionkey@0"
I20260811 17:08:43.057869 12728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "951155d7971d4b0dab19e4928cdd6bea"
format_stamp: "Formatted at 2026-08-11 17:08:43 on dist-test-slave-7vjv"
server_key: "cfa066b8426d27baa061a4613fca9c8e"
server_key_iv: "2c79327e8789635392bc317c3e8a82ff"
server_key_version: "encryptionkey@0"
I20260811 17:08:43.062811 12728 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 17:08:43.065757 12754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:43.067221 12728 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 17:08:43.067373 12728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "951155d7971d4b0dab19e4928cdd6bea"
format_stamp: "Formatted at 2026-08-11 17:08:43 on dist-test-slave-7vjv"
server_key: "cfa066b8426d27baa061a4613fca9c8e"
server_key_iv: "2c79327e8789635392bc317c3e8a82ff"
server_key_version: "encryptionkey@0"
I20260811 17:08:43.067508 12728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:43.086328 12728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:43.090781 12728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:43.091069 12728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:43.091785 12728 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:43.092851 12728 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:43.092906 12728 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:43.092984 12728 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:43.093024 12728 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:43.103071 12728 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:45523
I20260811 17:08:43.103119 12967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:45523 every 8 connection(s)
I20260811 17:08:43.103787 12728 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:08:43.104585 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 12728
I20260811 17:08:43.104717 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:08:43.105063 4683 external_mini_cluster.cc:1428] Setting key e58a4c9268470d908a4b8e4b15e0b6a4
Aug 11 17:08:43 dist-test-slave-7vjv krb5kdc[12038](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468123, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:43.120625 12189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:43.106102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:43273 (local address 127.4.146.254:41873)
0811 17:08:43.106254 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:43.106259 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:43.107543 (+ 1284us) server_negotiation.cc:407] Connection header received
0811 17:08:43.109123 (+ 1580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:43.109126 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:43.109175 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:43.109251 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:43.110599 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.111176 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.112635 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.112881 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.112977 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:43.115836 (+ 2859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:43.115840 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:43.115842 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:43.115871 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:43.117662 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:43.118497 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:43.118500 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:43.118501 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:43.118604 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:43.119139 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:43.119148 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:43.119149 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:43.119378 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:43.119515 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:43.120270 (+ 755us) server_negotiation.cc:299] Negotiation successful
0811 17:08:43.120421 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 17:08:43.121569 12970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:43.106755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:41873 (local address 127.4.146.195:43273)
0811 17:08:43.107343 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:43.107408 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:43.108902 (+ 1494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:43.109429 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:43.109437 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:43.109842 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:43.110436 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:43.110455 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.111323 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.111327 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:43.112496 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:43.112509 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.113092 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.113096 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:43.113261 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:43.113904 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:43.113932 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:43.115620 (+ 1688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:43.117807 (+ 2187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:43.117814 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:43.117830 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:43.118317 (+ 487us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:43.118724 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:43.118728 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:43.118730 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:43.119013 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:43.119514 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:43.119524 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:43.119912 (+ 388us) client_negotiation.cc:769] Sending connection context
0811 17:08:43.120211 (+ 299us) client_negotiation.cc:240] Negotiation successful
0811 17:08:43.120594 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":132,"threads_started":1}
I20260811 17:08:43.122979 12968 heartbeater.cc:347] Connected to a master server at 127.4.146.254:41873
I20260811 17:08:43.123311 12968 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:43.123817 12968 heartbeater.cc:511] Master 127.4.146.254:41873 requested a full tablet report, sending...
I20260811 17:08:43.124984 12121 ts_manager.cc:194] Registered new tserver with Master: 951155d7971d4b0dab19e4928cdd6bea (127.4.146.195:45523)
I20260811 17:08:43.125550 12121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.195@KRBTEST.COM'} at 127.4.146.195:43273
I20260811 17:08:43.132668 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 17:08:43.143831 12189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:43.135057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53104 (local address 127.4.146.254:41873)
0811 17:08:43.135204 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:43.135211 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:43.135365 (+ 154us) server_negotiation.cc:407] Connection header received
0811 17:08:43.135455 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:43.135458 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:43.135511 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:43.135578 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:43.136550 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.137100 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.138085 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.138348 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.138453 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:43.140214 (+ 1761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:43.140217 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:43.140220 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:43.140253 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:43.141982 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:43.142569 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:43.142572 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:43.142574 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:43.142669 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:43.142968 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:43.142972 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:43.142974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:43.143232 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:43.143349 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:43.143584 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 17:08:43.143700 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 17:08:43.147482 12121 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53104:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 17:08:43.150727 12121 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:08:43.167517 12987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:43.161052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48424 (local address 127.4.146.193:40321)
0811 17:08:43.161485 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:43.161493 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:43.161916 (+ 423us) server_negotiation.cc:407] Connection header received
0811 17:08:43.162191 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:43.162197 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:43.162424 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:43.162559 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:43.163088 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.164060 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.166120 (+ 2060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.166699 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.166833 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:43.167007 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:43.167194 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 17:08:43.167301 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":132,"threads_started":1}
I20260811 17:08:43.167508 12982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:43.160769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:40321 (local address 127.0.0.1:48424)
0811 17:08:43.161757 (+ 988us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:43.161819 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:43.162001 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:43.162771 (+ 770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:43.162773 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:43.162787 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:43.162955 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:43.162962 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.164239 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.164244 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:43.165998 (+ 1754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:43.166007 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.166835 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.166838 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:43.166960 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:43.167003 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 17:08:43.167150 (+ 147us) client_negotiation.cc:240] Negotiation successful
0811 17:08:43.167346 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":860,"mutex_wait_us":444,"thread_start_us":102,"threads_started":1}
I20260811 17:08:43.167915 12986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:43.160982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48080 (local address 127.4.146.195:45523)
0811 17:08:43.161708 (+ 726us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:43.161721 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:43.162145 (+ 424us) server_negotiation.cc:407] Connection header received
0811 17:08:43.162238 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:43.162243 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:43.162471 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:43.162684 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:43.163179 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.164366 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.165904 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.166849 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.166964 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:43.167116 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:43.167614 (+ 498us) server_negotiation.cc:299] Negotiation successful
0811 17:08:43.167755 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":605,"thread_start_us":159,"threads_started":1}
I20260811 17:08:43.168033 12984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:43.160769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:45523 (local address 127.0.0.1:48080)
0811 17:08:43.161757 (+ 988us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:43.161821 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:43.161969 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:43.162673 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:43.162679 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:43.162704 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:43.163033 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:43.163042 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.164530 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.164533 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:43.165759 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:43.165771 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.167194 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.167198 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:43.167304 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:43.167331 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 17:08:43.167415 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 17:08:43.167506 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":781,"mutex_wait_us":41,"thread_start_us":107,"threads_started":1}
I20260811 17:08:43.169015 12989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:43.161997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59844 (local address 127.4.146.194:41275)
0811 17:08:43.162447 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:43.162458 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:43.162711 (+ 253us) server_negotiation.cc:407] Connection header received
0811 17:08:43.162927 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:43.162932 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:43.163122 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:43.163248 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:43.163691 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.164853 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.166502 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.167430 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.167511 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:43.168311 (+ 800us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:43.168734 (+ 423us) server_negotiation.cc:299] Negotiation successful
0811 17:08:43.168841 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":166,"threads_started":1}
I20260811 17:08:43.169480 12988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:43.161693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:41275 (local address 127.0.0.1:59844)
0811 17:08:43.162598 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:43.162612 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:43.162781 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:43.163450 (+ 669us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:43.163453 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:43.163471 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:43.163548 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:43.163553 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.165000 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.165006 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:43.166336 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:43.166348 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.168426 (+ 2078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.168430 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:43.168550 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:43.168574 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 17:08:43.169257 (+ 683us) client_negotiation.cc:240] Negotiation successful
0811 17:08:43.169346 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":847,"mutex_wait_us":18,"thread_start_us":114,"threads_started":1}
I20260811 17:08:43.171036 12354 tablet_service.cc:1467] Processing CreateTablet for tablet 083fbf3a5e234a7c9794f5fa4d5099ff (DEFAULT_TABLE table=test-table [id=a11bf7ca76894cfeb1aed63c045d785d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:43.171319 12837 tablet_service.cc:1467] Processing CreateTablet for tablet 083fbf3a5e234a7c9794f5fa4d5099ff (DEFAULT_TABLE table=test-table [id=a11bf7ca76894cfeb1aed63c045d785d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:43.172318 12354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 083fbf3a5e234a7c9794f5fa4d5099ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:43.172492 12837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 083fbf3a5e234a7c9794f5fa4d5099ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:43.172529 12596 tablet_service.cc:1467] Processing CreateTablet for tablet 083fbf3a5e234a7c9794f5fa4d5099ff (DEFAULT_TABLE table=test-table [id=a11bf7ca76894cfeb1aed63c045d785d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:43.173626 12596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 083fbf3a5e234a7c9794f5fa4d5099ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:43.179039 12993 tablet_bootstrap.cc:492] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e: Bootstrap starting.
I20260811 17:08:43.181306 12997 tablet_bootstrap.cc:492] T 083fbf3a5e234a7c9794f5fa4d5099ff P 951155d7971d4b0dab19e4928cdd6bea: Bootstrap starting.
I20260811 17:08:43.181710 12993 tablet_bootstrap.cc:654] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:43.182101 12998 tablet_bootstrap.cc:492] T 083fbf3a5e234a7c9794f5fa4d5099ff P 146a799f83fe499683fadb201e882dfc: Bootstrap starting.
I20260811 17:08:43.182619 12993 log.cc:824] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:43.183791 12997 tablet_bootstrap.cc:654] T 083fbf3a5e234a7c9794f5fa4d5099ff P 951155d7971d4b0dab19e4928cdd6bea: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:43.184485 12998 tablet_bootstrap.cc:654] T 083fbf3a5e234a7c9794f5fa4d5099ff P 146a799f83fe499683fadb201e882dfc: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:43.185478 12993 tablet_bootstrap.cc:492] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e: No bootstrap required, opened a new log
I20260811 17:08:43.185649 12997 log.cc:824] T 083fbf3a5e234a7c9794f5fa4d5099ff P 951155d7971d4b0dab19e4928cdd6bea: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:43.185715 12993 ts_tablet_manager.cc:1397] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 17:08:43.186308 12998 log.cc:824] T 083fbf3a5e234a7c9794f5fa4d5099ff P 146a799f83fe499683fadb201e882dfc: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:43.187885 12997 tablet_bootstrap.cc:492] T 083fbf3a5e234a7c9794f5fa4d5099ff P 951155d7971d4b0dab19e4928cdd6bea: No bootstrap required, opened a new log
I20260811 17:08:43.188184 12997 ts_tablet_manager.cc:1397] T 083fbf3a5e234a7c9794f5fa4d5099ff P 951155d7971d4b0dab19e4928cdd6bea: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.004s
I20260811 17:08:43.188452 12998 tablet_bootstrap.cc:492] T 083fbf3a5e234a7c9794f5fa4d5099ff P 146a799f83fe499683fadb201e882dfc: No bootstrap required, opened a new log
I20260811 17:08:43.188647 12998 ts_tablet_manager.cc:1397] T 083fbf3a5e234a7c9794f5fa4d5099ff P 146a799f83fe499683fadb201e882dfc: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260811 17:08:43.189746 12993 raft_consensus.cc:348] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951155d7971d4b0dab19e4928cdd6bea" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45523 } } peers { permanent_uuid: "afad82bf852e42298e0a1ebb232e7c3e" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40321 } } peers { permanent_uuid: "146a799f83fe499683fadb201e882dfc" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41275 } }
I20260811 17:08:43.190009 12993 raft_consensus.cc:374] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:43.190065 12993 raft_consensus.cc:729] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afad82bf852e42298e0a1ebb232e7c3e, State: Initialized, Role: FOLLOWER
I20260811 17:08:43.190650 12993 consensus_queue.cc:260] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951155d7971d4b0dab19e4928cdd6bea" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45523 } } peers { permanent_uuid: "afad82bf852e42298e0a1ebb232e7c3e" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40321 } } peers { permanent_uuid: "146a799f83fe499683fadb201e882dfc" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41275 } }
I20260811 17:08:43.191872 12479 heartbeater.cc:503] Master 127.4.146.254:41873 was elected leader, sending a full tablet report...
I20260811 17:08:43.192305 12997 raft_consensus.cc:348] T 083fbf3a5e234a7c9794f5fa4d5099ff P 951155d7971d4b0dab19e4928cdd6bea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951155d7971d4b0dab19e4928cdd6bea" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45523 } } peers { permanent_uuid: "afad82bf852e42298e0a1ebb232e7c3e" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40321 } } peers { permanent_uuid: "146a799f83fe499683fadb201e882dfc" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41275 } }
I20260811 17:08:43.192628 12997 raft_consensus.cc:374] T 083fbf3a5e234a7c9794f5fa4d5099ff P 951155d7971d4b0dab19e4928cdd6bea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:43.192476 12998 raft_consensus.cc:348] T 083fbf3a5e234a7c9794f5fa4d5099ff P 146a799f83fe499683fadb201e882dfc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951155d7971d4b0dab19e4928cdd6bea" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45523 } } peers { permanent_uuid: "afad82bf852e42298e0a1ebb232e7c3e" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40321 } } peers { permanent_uuid: "146a799f83fe499683fadb201e882dfc" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41275 } }
I20260811 17:08:43.192690 12997 raft_consensus.cc:729] T 083fbf3a5e234a7c9794f5fa4d5099ff P 951155d7971d4b0dab19e4928cdd6bea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 951155d7971d4b0dab19e4928cdd6bea, State: Initialized, Role: FOLLOWER
I20260811 17:08:43.192744 12998 raft_consensus.cc:374] T 083fbf3a5e234a7c9794f5fa4d5099ff P 146a799f83fe499683fadb201e882dfc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:43.192799 12998 raft_consensus.cc:729] T 083fbf3a5e234a7c9794f5fa4d5099ff P 146a799f83fe499683fadb201e882dfc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 146a799f83fe499683fadb201e882dfc, State: Initialized, Role: FOLLOWER
I20260811 17:08:43.192939 12993 ts_tablet_manager.cc:1428] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20260811 17:08:43.193226 12998 consensus_queue.cc:260] T 083fbf3a5e234a7c9794f5fa4d5099ff P 146a799f83fe499683fadb201e882dfc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951155d7971d4b0dab19e4928cdd6bea" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45523 } } peers { permanent_uuid: "afad82bf852e42298e0a1ebb232e7c3e" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40321 } } peers { permanent_uuid: "146a799f83fe499683fadb201e882dfc" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41275 } }
I20260811 17:08:43.193226 12997 consensus_queue.cc:260] T 083fbf3a5e234a7c9794f5fa4d5099ff P 951155d7971d4b0dab19e4928cdd6bea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951155d7971d4b0dab19e4928cdd6bea" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45523 } } peers { permanent_uuid: "afad82bf852e42298e0a1ebb232e7c3e" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40321 } } peers { permanent_uuid: "146a799f83fe499683fadb201e882dfc" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41275 } }
I20260811 17:08:43.194173 12720 heartbeater.cc:503] Master 127.4.146.254:41873 was elected leader, sending a full tablet report...
I20260811 17:08:43.194200 12968 heartbeater.cc:503] Master 127.4.146.254:41873 was elected leader, sending a full tablet report...
I20260811 17:08:43.194298 12998 ts_tablet_manager.cc:1428] T 083fbf3a5e234a7c9794f5fa4d5099ff P 146a799f83fe499683fadb201e882dfc: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 17:08:43.195297 12997 ts_tablet_manager.cc:1428] T 083fbf3a5e234a7c9794f5fa4d5099ff P 951155d7971d4b0dab19e4928cdd6bea: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260811 17:08:43.221005 13006 raft_consensus.cc:482] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:08:43.221272 13006 raft_consensus.cc:504] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951155d7971d4b0dab19e4928cdd6bea" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45523 } } peers { permanent_uuid: "afad82bf852e42298e0a1ebb232e7c3e" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40321 } } peers { permanent_uuid: "146a799f83fe499683fadb201e882dfc" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41275 } }
I20260811 17:08:43.222591 13006 leader_election.cc:288] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 951155d7971d4b0dab19e4928cdd6bea (127.4.146.195:45523), 146a799f83fe499683fadb201e882dfc (127.4.146.194:41275)
I20260811 17:08:43.227586 12989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:43.223257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:36565 (local address 127.4.146.194:41275)
0811 17:08:43.223415 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:43.223421 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:43.223509 (+ 88us) server_negotiation.cc:407] Connection header received
0811 17:08:43.223782 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:43.223789 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:43.223860 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:43.223922 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:43.224465 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.225075 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.226458 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.226917 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.227065 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:43.227127 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:43.227336 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 17:08:43.227426 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 17:08:43.227604 13013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:43.222915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:41275 (local address 127.4.146.193:36565)
0811 17:08:43.223397 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:43.223413 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:43.223610 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:43.224140 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:43.224144 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:43.224168 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:43.224329 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:43.224336 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.225218 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.225225 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:43.226308 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:43.226319 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.227064 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.227068 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:43.227179 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:43.227223 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 17:08:43.227289 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 17:08:43.227377 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":405,"mutex_wait_us":90,"thread_start_us":159,"threads_started":1}
I20260811 17:08:43.227643 12986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:43.222997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:46037 (local address 127.4.146.195:45523)
0811 17:08:43.223152 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:43.223157 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:43.223766 (+ 609us) server_negotiation.cc:407] Connection header received
0811 17:08:43.224027 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:43.224034 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:43.224123 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:43.224210 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:43.224536 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.225091 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.226469 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.226928 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.227079 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:43.227141 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:43.227415 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 17:08:43.227515 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 17:08:43.227618 13014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:43.222915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:45523 (local address 127.4.146.193:46037)
0811 17:08:43.223653 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:43.223670 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:43.223867 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:43.224243 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:43.224246 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:43.224265 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:43.224408 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:43.224418 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.225254 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.225257 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:43.226315 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:43.226325 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.227101 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.227106 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:43.227248 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:43.227293 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 17:08:43.227382 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 17:08:43.227455 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"mutex_wait_us":398,"thread_start_us":111,"threads_started":1}
I20260811 17:08:43.228689 12638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "083fbf3a5e234a7c9794f5fa4d5099ff" candidate_uuid: "afad82bf852e42298e0a1ebb232e7c3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146a799f83fe499683fadb201e882dfc" is_pre_election: true
I20260811 17:08:43.228688 12872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "083fbf3a5e234a7c9794f5fa4d5099ff" candidate_uuid: "afad82bf852e42298e0a1ebb232e7c3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951155d7971d4b0dab19e4928cdd6bea" is_pre_election: true
I20260811 17:08:43.229077 12638 raft_consensus.cc:2454] T 083fbf3a5e234a7c9794f5fa4d5099ff P 146a799f83fe499683fadb201e882dfc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afad82bf852e42298e0a1ebb232e7c3e in term 0.
I20260811 17:08:43.229076 12872 raft_consensus.cc:2454] T 083fbf3a5e234a7c9794f5fa4d5099ff P 951155d7971d4b0dab19e4928cdd6bea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afad82bf852e42298e0a1ebb232e7c3e in term 0.
I20260811 17:08:43.229679 12260 leader_election.cc:302] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 146a799f83fe499683fadb201e882dfc, afad82bf852e42298e0a1ebb232e7c3e; no voters:
I20260811 17:08:43.229997 13006 raft_consensus.cc:2781] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:08:43.230122 13006 raft_consensus.cc:482] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:08:43.230176 13006 raft_consensus.cc:3037] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:43.231557 13006 raft_consensus.cc:504] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951155d7971d4b0dab19e4928cdd6bea" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45523 } } peers { permanent_uuid: "afad82bf852e42298e0a1ebb232e7c3e" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40321 } } peers { permanent_uuid: "146a799f83fe499683fadb201e882dfc" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41275 } }
I20260811 17:08:43.231984 13006 leader_election.cc:288] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e [CANDIDATE]: Term 1 election: Requested vote from peers 951155d7971d4b0dab19e4928cdd6bea (127.4.146.195:45523), 146a799f83fe499683fadb201e882dfc (127.4.146.194:41275)
I20260811 17:08:43.232524 12872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "083fbf3a5e234a7c9794f5fa4d5099ff" candidate_uuid: "afad82bf852e42298e0a1ebb232e7c3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "951155d7971d4b0dab19e4928cdd6bea"
I20260811 17:08:43.232542 12638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "083fbf3a5e234a7c9794f5fa4d5099ff" candidate_uuid: "afad82bf852e42298e0a1ebb232e7c3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "146a799f83fe499683fadb201e882dfc"
I20260811 17:08:43.232704 12872 raft_consensus.cc:3037] T 083fbf3a5e234a7c9794f5fa4d5099ff P 951155d7971d4b0dab19e4928cdd6bea [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:43.232704 12638 raft_consensus.cc:3037] T 083fbf3a5e234a7c9794f5fa4d5099ff P 146a799f83fe499683fadb201e882dfc [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:43.234261 12872 raft_consensus.cc:2454] T 083fbf3a5e234a7c9794f5fa4d5099ff P 951155d7971d4b0dab19e4928cdd6bea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afad82bf852e42298e0a1ebb232e7c3e in term 1.
I20260811 17:08:43.234261 12638 raft_consensus.cc:2454] T 083fbf3a5e234a7c9794f5fa4d5099ff P 146a799f83fe499683fadb201e882dfc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afad82bf852e42298e0a1ebb232e7c3e in term 1.
I20260811 17:08:43.234717 12264 leader_election.cc:302] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 951155d7971d4b0dab19e4928cdd6bea, afad82bf852e42298e0a1ebb232e7c3e; no voters:
I20260811 17:08:43.234953 13006 raft_consensus.cc:2781] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:43.235241 13006 raft_consensus.cc:686] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e [term 1 LEADER]: Becoming Leader. State: Replica: afad82bf852e42298e0a1ebb232e7c3e, State: Running, Role: LEADER
I20260811 17:08:43.235706 13006 consensus_queue.cc:237] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951155d7971d4b0dab19e4928cdd6bea" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45523 } } peers { permanent_uuid: "afad82bf852e42298e0a1ebb232e7c3e" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40321 } } peers { permanent_uuid: "146a799f83fe499683fadb201e882dfc" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41275 } }
I20260811 17:08:43.239405 12119 catalog_manager.cc:5495] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e reported cstate change: term changed from 0 to 1, leader changed from <none> to afad82bf852e42298e0a1ebb232e7c3e (127.4.146.193). New cstate: current_term: 1 leader_uuid: "afad82bf852e42298e0a1ebb232e7c3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "951155d7971d4b0dab19e4928cdd6bea" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45523 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afad82bf852e42298e0a1ebb232e7c3e" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "146a799f83fe499683fadb201e882dfc" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41275 } health_report { overall_health: UNKNOWN } } }
I20260811 17:08:43.269091 12987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:43.264850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48426 (local address 127.4.146.193:40321)
0811 17:08:43.265008 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:43.265013 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:43.265032 (+ 19us) server_negotiation.cc:407] Connection header received
0811 17:08:43.265142 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:43.265145 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:43.265225 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:43.265360 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:08:43.265667 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.266251 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.267241 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:43.267500 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:43.267641 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:43.268018 (+ 377us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:08:43.268573 (+ 555us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:08:43.268750 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:43.268838 (+ 88us) server_negotiation.cc:299] Negotiation successful
0811 17:08:43.268897 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 17:08:43.275584 12638 raft_consensus.cc:1261] T 083fbf3a5e234a7c9794f5fa4d5099ff P 146a799f83fe499683fadb201e882dfc [term 1 FOLLOWER]: Refusing update from remote peer afad82bf852e42298e0a1ebb232e7c3e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:08:43.275583 12872 raft_consensus.cc:1261] T 083fbf3a5e234a7c9794f5fa4d5099ff P 951155d7971d4b0dab19e4928cdd6bea [term 1 FOLLOWER]: Refusing update from remote peer afad82bf852e42298e0a1ebb232e7c3e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:08:43.276444 13017 consensus_queue.cc:1035] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "146a799f83fe499683fadb201e882dfc" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:08:43.276631 13006 consensus_queue.cc:1035] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "951155d7971d4b0dab19e4928cdd6bea" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45523 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:08:43.284947 13020 mvcc.cc:205] Tried to move back new op lower bound from 7317373432929308672 to 7317373432777052160. Current Snapshot: MvccSnapshot[applied={T|T < 7317373432929308672}]
I20260811 17:08:43.294543 12121 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:08:43.294795 12121 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:08:43.295765 13035 mvcc.cc:205] Tried to move back new op lower bound from 7317373432929308672 to 7317373432777052160. Current Snapshot: MvccSnapshot[applied={T|T < 7317373432929308672}]
I20260811 17:08:43.298435 12121 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e0109ecdedf641c4a226425e78b332c7: Sending DeleteTablet for 3 replicas of tablet 083fbf3a5e234a7c9794f5fa4d5099ff
I20260811 17:08:43.299474 12837 tablet_service.cc:1514] Processing DeleteTablet for tablet 083fbf3a5e234a7c9794f5fa4d5099ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:43 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:48080
I20260811 17:08:43.299537 12596 tablet_service.cc:1514] Processing DeleteTablet for tablet 083fbf3a5e234a7c9794f5fa4d5099ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:43 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:59844
I20260811 17:08:43.299752 12354 tablet_service.cc:1514] Processing DeleteTablet for tablet 083fbf3a5e234a7c9794f5fa4d5099ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:43 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:48424
I20260811 17:08:43.300267 12593 tablet_service.cc:1514] Processing DeleteTablet for tablet 083fbf3a5e234a7c9794f5fa4d5099ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:43 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:59844
I20260811 17:08:43.300305 13045 tablet_replica.cc:330] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e: stopping tablet replica
I20260811 17:08:43.300662 13045 raft_consensus.cc:2229] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e [term 1 LEADER]: Raft consensus shutting down.
I20260811 17:08:43.301240 13045 raft_consensus.cc:2258] T 083fbf3a5e234a7c9794f5fa4d5099ff P afad82bf852e42298e0a1ebb232e7c3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:43.301321 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 12235
I20260811 17:08:43.318655 13041 tablet_replica.cc:330] T 083fbf3a5e234a7c9794f5fa4d5099ff P 951155d7971d4b0dab19e4928cdd6bea: stopping tablet replica
I20260811 17:08:43.319162 13041 raft_consensus.cc:2229] T 083fbf3a5e234a7c9794f5fa4d5099ff P 951155d7971d4b0dab19e4928cdd6bea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:08:43.319571 13041 raft_consensus.cc:2258] T 083fbf3a5e234a7c9794f5fa4d5099ff P 951155d7971d4b0dab19e4928cdd6bea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:43.320029 13044 tablet_replica.cc:330] T 083fbf3a5e234a7c9794f5fa4d5099ff P 146a799f83fe499683fadb201e882dfc: stopping tablet replica
I20260811 17:08:43.320380 13044 raft_consensus.cc:2229] T 083fbf3a5e234a7c9794f5fa4d5099ff P 146a799f83fe499683fadb201e882dfc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:08:43.320694 13044 raft_consensus.cc:2258] T 083fbf3a5e234a7c9794f5fa4d5099ff P 146a799f83fe499683fadb201e882dfc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:43.321841 13041 ts_tablet_manager.cc:1905] T 083fbf3a5e234a7c9794f5fa4d5099ff P 951155d7971d4b0dab19e4928cdd6bea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:43.322057 13044 ts_tablet_manager.cc:1905] T 083fbf3a5e234a7c9794f5fa4d5099ff P 146a799f83fe499683fadb201e882dfc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:43.324331 13044 ts_tablet_manager.cc:1918] T 083fbf3a5e234a7c9794f5fa4d5099ff P 146a799f83fe499683fadb201e882dfc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:08:43.324458 13044 log.cc:1196] T 083fbf3a5e234a7c9794f5fa4d5099ff P 146a799f83fe499683fadb201e882dfc: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-1/wal/wals/083fbf3a5e234a7c9794f5fa4d5099ff
I20260811 17:08:43.324800 13044 ts_tablet_manager.cc:1939] T 083fbf3a5e234a7c9794f5fa4d5099ff P 146a799f83fe499683fadb201e882dfc: Deleting consensus metadata
I20260811 17:08:43.325853 13041 ts_tablet_manager.cc:1918] T 083fbf3a5e234a7c9794f5fa4d5099ff P 951155d7971d4b0dab19e4928cdd6bea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:08:43.325984 13041 log.cc:1196] T 083fbf3a5e234a7c9794f5fa4d5099ff P 951155d7971d4b0dab19e4928cdd6bea: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/083fbf3a5e234a7c9794f5fa4d5099ff
I20260811 17:08:43.326370 13041 ts_tablet_manager.cc:1939] T 083fbf3a5e234a7c9794f5fa4d5099ff P 951155d7971d4b0dab19e4928cdd6bea: Deleting consensus metadata
I20260811 17:08:43.326282 12093 catalog_manager.cc:4841] TS 146a799f83fe499683fadb201e882dfc (127.4.146.194:41275): tablet 083fbf3a5e234a7c9794f5fa4d5099ff (table test-table [id=a11bf7ca76894cfeb1aed63c045d785d]) successfully deleted
W20260811 17:08:43.326670 12093 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.146.193:40321 (error 108)
I20260811 17:08:43.326932 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 12489
W20260811 17:08:43.327320 12093 catalog_manager.cc:4808] TS 146a799f83fe499683fadb201e882dfc (127.4.146.194:41275): delete failed for tablet 083fbf3a5e234a7c9794f5fa4d5099ff because the tablet was not found. No further retry: Not found: Tablet not found: 083fbf3a5e234a7c9794f5fa4d5099ff
I20260811 17:08:43.328172 12095 catalog_manager.cc:4841] TS 951155d7971d4b0dab19e4928cdd6bea (127.4.146.195:45523): tablet 083fbf3a5e234a7c9794f5fa4d5099ff (table test-table [id=a11bf7ca76894cfeb1aed63c045d785d]) successfully deleted
I20260811 17:08:43.328305 12988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:43.327856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:40321 (local address 127.0.0.1:48436)
0811 17:08:43.328154 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:43.328221 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.193:40321: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201}
W20260811 17:08:43.328450 12093 catalog_manager.cc:4584] TS afad82bf852e42298e0a1ebb232e7c3e (127.4.146.193:40321): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 083fbf3a5e234a7c9794f5fa4d5099ff: Network error: Client connection negotiation failed: client connection to 127.4.146.193:40321: connect: Connection refused (error 111)
I20260811 17:08:43.338399 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 12728
I20260811 17:08:43.356374 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 12058
2026-08-11T17:08:43Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2831 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T17:08:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:08:43Z Disabled control of system clock
I20260811 17:08:43.400579 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:45029
--webserver_interface=127.4.146.254
--webserver_port=0
--builtin_ntp_servers=127.4.146.212:44283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:45029
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 17:08:43.522466 13054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:43.522773 13054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:43.522811 13054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:43.526945 13054 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:08:43.527010 13054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:43.527026 13054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:43.527043 13054 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:08:43.527065 13054 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:08:43.532182 13054 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:44283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:45029
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:45029
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13054
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:43.533325 13054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:43.534840 13054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 17:08:43.544806 13054 server_base.cc:1034] running on GCE node
W20260811 17:08:43.544732 13063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:43.544727 13060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:43.544734 13065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:43.545709 13054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:43.546970 13054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:43.548185 13054 hybrid_clock.cc:648] HybridClock initialized: now 1786468123548141 us; error 54 us; skew 500 ppm
I20260811 17:08:43.550259 13054 webserver.cc:460] Webserver started at http://127.4.146.254:41897/ using document root <none> and password file <none>
I20260811 17:08:43.550877 13054 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:43.550978 13054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:43.551227 13054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:43.553426 13054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "ced145099f894ad88862dba530f38560"
format_stamp: "Formatted at 2026-08-11 17:08:43 on dist-test-slave-7vjv"
server_key: "fd68e580e4170b494f887a5b1ce410df"
server_key_iv: "e96bc140a6c2fa06d3aa6e8b4bbe7dad"
server_key_version: "encryptionkey@0"
I20260811 17:08:43.554049 13054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "ced145099f894ad88862dba530f38560"
format_stamp: "Formatted at 2026-08-11 17:08:43 on dist-test-slave-7vjv"
server_key: "fd68e580e4170b494f887a5b1ce410df"
server_key_iv: "e96bc140a6c2fa06d3aa6e8b4bbe7dad"
server_key_version: "encryptionkey@0"
I20260811 17:08:43.558563 13054 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 17:08:43.561751 13082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:43.563436 13054 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 17:08:43.563644 13054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "ced145099f894ad88862dba530f38560"
format_stamp: "Formatted at 2026-08-11 17:08:43 on dist-test-slave-7vjv"
server_key: "fd68e580e4170b494f887a5b1ce410df"
server_key_iv: "e96bc140a6c2fa06d3aa6e8b4bbe7dad"
server_key_version: "encryptionkey@0"
I20260811 17:08:43.563798 13054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:43.569296 13054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:43.570030 13054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:43.570262 13054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:43.578243 13054 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:45029
I20260811 17:08:43.578276 13180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:45029 every 8 connection(s)
I20260811 17:08:43.579262 13054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:08:43.582947 13181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:43.588140 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 13054
I20260811 17:08:43.588296 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:08:43.588573 4683 external_mini_cluster.cc:1428] Setting key d742cfaace3d216365a2507136ce3af5
I20260811 17:08:43.589422 13181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ced145099f894ad88862dba530f38560: Bootstrap starting.
I20260811 17:08:43.591986 13181 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ced145099f894ad88862dba530f38560: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:43.593119 13181 log.cc:824] T 00000000000000000000000000000000 P ced145099f894ad88862dba530f38560: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:43.594621 13187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:43.590107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37040 (local address 127.4.146.254:45029)
0811 17:08:43.590787 (+ 680us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:43.590804 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:43.590842 (+ 38us) server_negotiation.cc:407] Connection header received
0811 17:08:43.591536 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:43.591555 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:43.591910 (+ 355us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:43.592302 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:43.593172 (+ 870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:43.593177 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:43.593189 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:08:43.593199 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:43.593255 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:08:43.593301 (+ 46us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:43.593413 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:43.593587 (+ 174us) server_negotiation.cc:299] Negotiation successful
0811 17:08:43.593851 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":180,"threads_started":1}
I20260811 17:08:43.595623 13181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ced145099f894ad88862dba530f38560: No bootstrap required, opened a new log
I20260811 17:08:43.600005 13181 raft_consensus.cc:348] T 00000000000000000000000000000000 P ced145099f894ad88862dba530f38560 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ced145099f894ad88862dba530f38560" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 45029 } }
I20260811 17:08:43.600351 13181 raft_consensus.cc:374] T 00000000000000000000000000000000 P ced145099f894ad88862dba530f38560 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:43.600409 13181 raft_consensus.cc:729] T 00000000000000000000000000000000 P ced145099f894ad88862dba530f38560 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ced145099f894ad88862dba530f38560, State: Initialized, Role: FOLLOWER
I20260811 17:08:43.600890 13181 consensus_queue.cc:260] T 00000000000000000000000000000000 P ced145099f894ad88862dba530f38560 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ced145099f894ad88862dba530f38560" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 45029 } }
I20260811 17:08:43.601029 13181 raft_consensus.cc:388] T 00000000000000000000000000000000 P ced145099f894ad88862dba530f38560 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:08:43.601085 13181 raft_consensus.cc:482] T 00000000000000000000000000000000 P ced145099f894ad88862dba530f38560 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:08:43.601169 13181 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ced145099f894ad88862dba530f38560 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:43.602244 13181 raft_consensus.cc:504] T 00000000000000000000000000000000 P ced145099f894ad88862dba530f38560 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ced145099f894ad88862dba530f38560" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 45029 } }
I20260811 17:08:43.602609 13181 leader_election.cc:302] T 00000000000000000000000000000000 P ced145099f894ad88862dba530f38560 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ced145099f894ad88862dba530f38560; no voters:
I20260811 17:08:43.603045 13181 leader_election.cc:288] T 00000000000000000000000000000000 P ced145099f894ad88862dba530f38560 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:08:43.603159 13191 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ced145099f894ad88862dba530f38560 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:43.603417 13191 raft_consensus.cc:686] T 00000000000000000000000000000000 P ced145099f894ad88862dba530f38560 [term 1 LEADER]: Becoming Leader. State: Replica: ced145099f894ad88862dba530f38560, State: Running, Role: LEADER
I20260811 17:08:43.603780 13191 consensus_queue.cc:237] T 00000000000000000000000000000000 P ced145099f894ad88862dba530f38560 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ced145099f894ad88862dba530f38560" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 45029 } }
I20260811 17:08:43.604562 13181 sys_catalog.cc:564] T 00000000000000000000000000000000 P ced145099f894ad88862dba530f38560 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:08:43.605700 13192 sys_catalog.cc:455] T 00000000000000000000000000000000 P ced145099f894ad88862dba530f38560 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ced145099f894ad88862dba530f38560" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ced145099f894ad88862dba530f38560" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 45029 } } }
I20260811 17:08:43.605866 13192 sys_catalog.cc:458] T 00000000000000000000000000000000 P ced145099f894ad88862dba530f38560 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:43.606302 13209 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:08:43.606307 13195 sys_catalog.cc:455] T 00000000000000000000000000000000 P ced145099f894ad88862dba530f38560 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ced145099f894ad88862dba530f38560. Latest consensus state: current_term: 1 leader_uuid: "ced145099f894ad88862dba530f38560" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ced145099f894ad88862dba530f38560" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 45029 } } }
I20260811 17:08:43.606595 13195 sys_catalog.cc:458] T 00000000000000000000000000000000 P ced145099f894ad88862dba530f38560 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:43.609530 13209 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:08:43.616281 13209 catalog_manager.cc:1347] Generated new cluster ID: 443bf2aad4d9439387e88d1bf8898589
I20260811 17:08:43.616402 13209 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:08:43.642204 13209 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:08:43.642622 13209 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:08:43.653743 13209 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ced145099f894ad88862dba530f38560: Generated new TSK 0
I20260811 17:08:43.654541 13209 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:08:43.663158 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:45029
--builtin_ntp_servers=127.4.146.212:44283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 17:08:43.802330 13228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:43.802659 13228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:43.802701 13228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:43.807265 13228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:43.807348 13228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:43.807410 13228 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:08:43.812755 13228 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:44283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:45029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13228
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:43.814035 13228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:43.815596 13228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:43.826064 13236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:43.826100 13239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:43.826084 13237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:43.826889 13228 server_base.cc:1034] running on GCE node
I20260811 17:08:43.827344 13228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:43.828039 13228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:43.829258 13228 hybrid_clock.cc:648] HybridClock initialized: now 1786468123829241 us; error 28 us; skew 500 ppm
I20260811 17:08:43.831288 13228 webserver.cc:460] Webserver started at http://127.4.146.193:36159/ using document root <none> and password file <none>
I20260811 17:08:43.831948 13228 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:43.832049 13228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:43.832360 13228 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:43.834616 13228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "61f540c6d02b4f9698449f34ac7be8dd"
format_stamp: "Formatted at 2026-08-11 17:08:43 on dist-test-slave-7vjv"
server_key: "0932edc45d52091674972c3b38915cff"
server_key_iv: "5a51cd77d984711b273d04615898f659"
server_key_version: "encryptionkey@0"
I20260811 17:08:43.835253 13228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "61f540c6d02b4f9698449f34ac7be8dd"
format_stamp: "Formatted at 2026-08-11 17:08:43 on dist-test-slave-7vjv"
server_key: "0932edc45d52091674972c3b38915cff"
server_key_iv: "5a51cd77d984711b273d04615898f659"
server_key_version: "encryptionkey@0"
I20260811 17:08:43.839260 13228 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 17:08:43.842123 13253 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:43.843837 13228 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 17:08:43.843972 13228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "61f540c6d02b4f9698449f34ac7be8dd"
format_stamp: "Formatted at 2026-08-11 17:08:43 on dist-test-slave-7vjv"
server_key: "0932edc45d52091674972c3b38915cff"
server_key_iv: "5a51cd77d984711b273d04615898f659"
server_key_version: "encryptionkey@0"
I20260811 17:08:43.844182 13228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:43.849511 13228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:43.850214 13228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:43.850384 13228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:43.850962 13228 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:43.851984 13228 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:43.852037 13228 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:43.852082 13228 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:43.852176 13228 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:43.862644 13228 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:45037
I20260811 17:08:43.862658 13450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:45037 every 8 connection(s)
I20260811 17:08:43.863737 13228 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:08:43.871271 13187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:43.865796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:45527 (local address 127.4.146.254:45029)
0811 17:08:43.865944 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:43.865948 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:43.867508 (+ 1560us) server_negotiation.cc:407] Connection header received
0811 17:08:43.869223 (+ 1715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:43.869227 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:43.869279 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:43.869387 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:43.870655 (+ 1268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:43.870659 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:43.870662 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:08:43.870685 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:43.870710 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:08:43.870719 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:43.870841 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:43.871048 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 17:08:43.871105 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 17:08:43.872323 13461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:43.866240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:45029 (local address 127.4.146.193:45527)
0811 17:08:43.867208 (+ 968us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:43.867291 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:43.868913 (+ 1622us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:43.869584 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:43.869591 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:43.869692 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:43.870330 (+ 638us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 17:08:43.870332 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:43.870378 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 17:08:43.870460 (+ 82us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:43.870821 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:43.870832 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:43.870838 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 17:08:43.871103 (+ 265us) client_negotiation.cc:240] Negotiation successful
0811 17:08:43.871376 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":127,"threads_started":1}
I20260811 17:08:43.872891 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 13228
I20260811 17:08:43.873042 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
I20260811 17:08:43.873459 4683 external_mini_cluster.cc:1428] Setting key 2318c7ee7778233c5ebd061112bb76d5
I20260811 17:08:43.873813 13451 heartbeater.cc:347] Connected to a master server at 127.4.146.254:45029
I20260811 17:08:43.874125 13451 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:43.874661 13451 heartbeater.cc:511] Master 127.4.146.254:45029 requested a full tablet report, sending...
I20260811 17:08:43.875864 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:45029
--builtin_ntp_servers=127.4.146.212:44283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 17:08:43.876657 13115 ts_manager.cc:194] Registered new tserver with Master: 61f540c6d02b4f9698449f34ac7be8dd (127.4.146.193:45037)
W20260811 17:08:43.993767 13462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:43.994057 13462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:43.994098 13462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:43.998229 13462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:43.998296 13462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:43.998353 13462 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:08:44.003427 13462 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:44283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:45029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13462
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:44.004701 13462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:44.006366 13462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 17:08:44.018726 13462 server_base.cc:1034] running on GCE node
W20260811 17:08:44.018783 13478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:44.018941 13475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:44.018738 13476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:44.019470 13462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:44.020241 13462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:44.021416 13462 hybrid_clock.cc:648] HybridClock initialized: now 1786468124021386 us; error 44 us; skew 500 ppm
I20260811 17:08:44.023424 13462 webserver.cc:460] Webserver started at http://127.4.146.194:34747/ using document root <none> and password file <none>
I20260811 17:08:44.024169 13462 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:44.024262 13462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:44.024509 13462 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:44.026701 13462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "d4006b4216e446029592404536064faa"
format_stamp: "Formatted at 2026-08-11 17:08:44 on dist-test-slave-7vjv"
server_key: "21198e57bf3f21970227543a52770ddb"
server_key_iv: "6de8883d6824cca7293a6e4c4dc3d016"
server_key_version: "encryptionkey@0"
I20260811 17:08:44.027310 13462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "d4006b4216e446029592404536064faa"
format_stamp: "Formatted at 2026-08-11 17:08:44 on dist-test-slave-7vjv"
server_key: "21198e57bf3f21970227543a52770ddb"
server_key_iv: "6de8883d6824cca7293a6e4c4dc3d016"
server_key_version: "encryptionkey@0"
I20260811 17:08:44.031347 13462 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 17:08:44.034232 13495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:44.035596 13462 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 17:08:44.035740 13462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "d4006b4216e446029592404536064faa"
format_stamp: "Formatted at 2026-08-11 17:08:44 on dist-test-slave-7vjv"
server_key: "21198e57bf3f21970227543a52770ddb"
server_key_iv: "6de8883d6824cca7293a6e4c4dc3d016"
server_key_version: "encryptionkey@0"
I20260811 17:08:44.035866 13462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:44.040953 13462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:44.041652 13462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:44.041858 13462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:44.042474 13462 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:44.043486 13462 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:44.043562 13462 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:44.043642 13462 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:44.043685 13462 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:44.054091 13462 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:34655
I20260811 17:08:44.054154 13719 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:34655 every 8 connection(s)
I20260811 17:08:44.055111 13462 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:08:44.062080 13187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:44.057375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:36609 (local address 127.4.146.254:45029)
0811 17:08:44.057544 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:44.057549 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:44.058792 (+ 1243us) server_negotiation.cc:407] Connection header received
0811 17:08:44.060204 (+ 1412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:44.060207 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:44.060254 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:44.060341 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:44.061636 (+ 1295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:44.061639 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:44.061641 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:08:44.061654 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:44.061673 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:08:44.061681 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:44.061779 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:44.061904 (+ 125us) server_negotiation.cc:299] Negotiation successful
0811 17:08:44.061946 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 17:08:44.063041 13725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:44.057898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:45029 (local address 127.4.146.194:36609)
0811 17:08:44.058627 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:44.058670 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:44.059910 (+ 1240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:44.060515 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:44.060523 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:44.060632 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:44.061359 (+ 727us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 17:08:44.061361 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:44.061406 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 17:08:44.061480 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:44.061774 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:44.061781 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:44.061785 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 17:08:44.061927 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 17:08:44.062139 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":134,"threads_started":1}
I20260811 17:08:44.064203 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 13462
I20260811 17:08:44.064360 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:08:44.064635 13721 heartbeater.cc:347] Connected to a master server at 127.4.146.254:45029
I20260811 17:08:44.064738 4683 external_mini_cluster.cc:1428] Setting key 0b33a47d95150bbd280d7e10785d27f1
I20260811 17:08:44.064942 13721 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:44.065446 13721 heartbeater.cc:511] Master 127.4.146.254:45029 requested a full tablet report, sending...
I20260811 17:08:44.066571 13115 ts_manager.cc:194] Registered new tserver with Master: d4006b4216e446029592404536064faa (127.4.146.194:34655)
I20260811 17:08:44.067041 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:45029
--builtin_ntp_servers=127.4.146.212:44283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 17:08:44.189652 13727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:44.189971 13727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:44.190053 13727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:44.194072 13727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:44.194128 13727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:44.194185 13727 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:08:44.198917 13727 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:44283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:45029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13727
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:44.200107 13727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:44.201566 13727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 17:08:44.211962 13727 server_base.cc:1034] running on GCE node
W20260811 17:08:44.211954 13736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:44.212009 13738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:44.211920 13735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:44.212743 13727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:44.213567 13727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:44.214784 13727 hybrid_clock.cc:648] HybridClock initialized: now 1786468124214748 us; error 49 us; skew 500 ppm
I20260811 17:08:44.216951 13727 webserver.cc:460] Webserver started at http://127.4.146.195:39057/ using document root <none> and password file <none>
I20260811 17:08:44.217599 13727 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:44.217700 13727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:44.217952 13727 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:44.220192 13727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "9edee6529cb941f386d9b7d54ef1af0b"
format_stamp: "Formatted at 2026-08-11 17:08:44 on dist-test-slave-7vjv"
server_key: "882195895cf40147494eed7b5050e218"
server_key_iv: "8faaff81cb01671d81f9b77f4eb92d4e"
server_key_version: "encryptionkey@0"
I20260811 17:08:44.220813 13727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "9edee6529cb941f386d9b7d54ef1af0b"
format_stamp: "Formatted at 2026-08-11 17:08:44 on dist-test-slave-7vjv"
server_key: "882195895cf40147494eed7b5050e218"
server_key_iv: "8faaff81cb01671d81f9b77f4eb92d4e"
server_key_version: "encryptionkey@0"
I20260811 17:08:44.225054 13727 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260811 17:08:44.228441 13751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:44.230167 13727 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 17:08:44.230376 13727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "9edee6529cb941f386d9b7d54ef1af0b"
format_stamp: "Formatted at 2026-08-11 17:08:44 on dist-test-slave-7vjv"
server_key: "882195895cf40147494eed7b5050e218"
server_key_iv: "8faaff81cb01671d81f9b77f4eb92d4e"
server_key_version: "encryptionkey@0"
I20260811 17:08:44.230557 13727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:44.237254 13727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:44.238014 13727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:44.238238 13727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:44.238883 13727 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:44.240039 13727 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:44.240137 13727 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:44.240231 13727 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:44.240270 13727 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:44.251190 13727 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:36707
I20260811 17:08:44.251214 13963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:36707 every 8 connection(s)
I20260811 17:08:44.252269 13727 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:08:44.255648 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 13727
I20260811 17:08:44.255824 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:08:44.256170 4683 external_mini_cluster.cc:1428] Setting key a20bbfa376de2b6d6364c7517a7ac832
I20260811 17:08:44.259363 13187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:44.254403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:35297 (local address 127.4.146.254:45029)
0811 17:08:44.254550 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:44.254554 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:44.255702 (+ 1148us) server_negotiation.cc:407] Connection header received
0811 17:08:44.257540 (+ 1838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:44.257545 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:44.257588 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:44.257681 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:44.258972 (+ 1291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:44.258975 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:44.258977 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:08:44.258988 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:44.259007 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:08:44.259014 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:44.259088 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:44.259224 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 17:08:44.259260 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 17:08:44.260411 13967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:44.254789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:45029 (local address 127.4.146.195:35297)
0811 17:08:44.255520 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:44.255564 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:44.257291 (+ 1727us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:44.257906 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:44.257916 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:44.258034 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:44.258713 (+ 679us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 17:08:44.258715 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:44.258758 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 17:08:44.258832 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:44.259095 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:44.259103 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:44.259107 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 17:08:44.259243 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 17:08:44.259440 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":124,"threads_started":1}
I20260811 17:08:44.261701 13964 heartbeater.cc:347] Connected to a master server at 127.4.146.254:45029
I20260811 17:08:44.262008 13964 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:44.262503 13964 heartbeater.cc:511] Master 127.4.146.254:45029 requested a full tablet report, sending...
I20260811 17:08:44.263616 13115 ts_manager.cc:194] Registered new tserver with Master: 9edee6529cb941f386d9b7d54ef1af0b (127.4.146.195:36707)
I20260811 17:08:44.270511 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 17:08:44.274735 13187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:44.272873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37054 (local address 127.4.146.254:45029)
0811 17:08:44.273073 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:44.273079 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:44.273254 (+ 175us) server_negotiation.cc:407] Connection header received
0811 17:08:44.273325 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:44.273328 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:44.273367 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:44.273444 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:44.274264 (+ 820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:44.274268 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:44.274270 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:08:44.274283 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:44.274305 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:08:44.274314 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:44.274404 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:44.274476 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 17:08:44.274516 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 17:08:44.277854 13115 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37054:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 17:08:44.281342 13115 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:08:44.294603 13983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:44.291027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:45037 (local address 127.0.0.1:54456)
0811 17:08:44.291931 (+ 904us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:44.291988 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:44.292141 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:44.292893 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:44.292900 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:44.292980 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:44.293668 (+ 688us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 17:08:44.293669 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:44.293690 (+ 21us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 17:08:44.293764 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:44.294192 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:44.294204 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:44.294211 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 17:08:44.294320 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 17:08:44.294396 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":774,"spinlock_wait_cycles":5888,"thread_start_us":128,"threads_started":1}
I20260811 17:08:44.295214 13986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:44.291420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54456 (local address 127.4.146.193:45037)
0811 17:08:44.292418 (+ 998us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:44.292428 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:44.292448 (+ 20us) server_negotiation.cc:407] Connection header received
0811 17:08:44.292493 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:44.292497 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:44.292727 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:44.292878 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:44.293907 (+ 1029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:44.293917 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:44.293935 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:08:44.293971 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:44.294025 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:08:44.294070 (+ 45us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:44.294845 (+ 775us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:44.294904 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 17:08:44.295013 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":889,"thread_start_us":109,"threads_started":1}
I20260811 17:08:44.295267 13988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:44.291813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:34655 (local address 127.0.0.1:60808)
0811 17:08:44.292434 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:44.292448 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:44.292540 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:44.293106 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:44.293109 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:44.293125 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:44.294011 (+ 886us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 17:08:44.294014 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:44.294026 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 17:08:44.294055 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:44.295009 (+ 954us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:44.295012 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:44.295016 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 17:08:44.295094 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 17:08:44.295135 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":85,"threads_started":1}
I20260811 17:08:44.295724 13989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:44.292023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60808 (local address 127.4.146.194:34655)
0811 17:08:44.292681 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:44.292691 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:44.292713 (+ 22us) server_negotiation.cc:407] Connection header received
0811 17:08:44.292793 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:44.292798 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:44.292965 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:44.293120 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:44.294241 (+ 1121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:44.294248 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:44.294260 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:08:44.294276 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:44.294641 (+ 365us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:08:44.294690 (+ 49us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:44.295387 (+ 697us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:44.295474 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 17:08:44.295552 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":541,"thread_start_us":135,"threads_started":1}
I20260811 17:08:44.295838 13982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:44.291012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:36707 (local address 127.0.0.1:57768)
0811 17:08:44.291933 (+ 921us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:44.291988 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:44.292143 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:44.294120 (+ 1977us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:44.294123 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:44.294137 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:44.294629 (+ 492us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 17:08:44.294631 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:44.294642 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 17:08:44.294671 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:44.295580 (+ 909us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:44.295584 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:44.295589 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 17:08:44.295650 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 17:08:44.295686 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":704,"spinlock_wait_cycles":61824,"thread_start_us":126,"threads_started":1}
I20260811 17:08:44.296479 13984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:44.291202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57768 (local address 127.4.146.195:36707)
0811 17:08:44.293721 (+ 2519us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:44.293732 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:44.293756 (+ 24us) server_negotiation.cc:407] Connection header received
0811 17:08:44.293813 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:44.293821 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:44.293986 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:44.294136 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:44.295096 (+ 960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:44.295104 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:44.295117 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:08:44.295129 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:44.295175 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:08:44.295206 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:44.296177 (+ 971us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:44.296235 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 17:08:44.296307 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2407,"thread_start_us":167,"threads_started":1}
I20260811 17:08:44.298538 13340 tablet_service.cc:1467] Processing CreateTablet for tablet 00bc93d93d7541f38e1f15f26562c8fb (DEFAULT_TABLE table=test-table [id=a58865577f51424ea39f51cd8f9c5e08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:44.298626 13594 tablet_service.cc:1467] Processing CreateTablet for tablet 00bc93d93d7541f38e1f15f26562c8fb (DEFAULT_TABLE table=test-table [id=a58865577f51424ea39f51cd8f9c5e08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:44.299738 13340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00bc93d93d7541f38e1f15f26562c8fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:44.299292 13837 tablet_service.cc:1467] Processing CreateTablet for tablet 00bc93d93d7541f38e1f15f26562c8fb (DEFAULT_TABLE table=test-table [id=a58865577f51424ea39f51cd8f9c5e08]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:44.299783 13594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00bc93d93d7541f38e1f15f26562c8fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:44.300381 13837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00bc93d93d7541f38e1f15f26562c8fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:44.306922 13990 tablet_bootstrap.cc:492] T 00bc93d93d7541f38e1f15f26562c8fb P 61f540c6d02b4f9698449f34ac7be8dd: Bootstrap starting.
I20260811 17:08:44.308725 13992 tablet_bootstrap.cc:492] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa: Bootstrap starting.
I20260811 17:08:44.309724 13990 tablet_bootstrap.cc:654] T 00bc93d93d7541f38e1f15f26562c8fb P 61f540c6d02b4f9698449f34ac7be8dd: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:44.310532 13990 log.cc:824] T 00bc93d93d7541f38e1f15f26562c8fb P 61f540c6d02b4f9698449f34ac7be8dd: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:44.310787 13992 tablet_bootstrap.cc:654] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:44.311815 13992 log.cc:824] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:44.312578 13993 tablet_bootstrap.cc:492] T 00bc93d93d7541f38e1f15f26562c8fb P 9edee6529cb941f386d9b7d54ef1af0b: Bootstrap starting.
I20260811 17:08:44.313277 13990 tablet_bootstrap.cc:492] T 00bc93d93d7541f38e1f15f26562c8fb P 61f540c6d02b4f9698449f34ac7be8dd: No bootstrap required, opened a new log
I20260811 17:08:44.313548 13990 ts_tablet_manager.cc:1397] T 00bc93d93d7541f38e1f15f26562c8fb P 61f540c6d02b4f9698449f34ac7be8dd: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 17:08:44.314328 13992 tablet_bootstrap.cc:492] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa: No bootstrap required, opened a new log
I20260811 17:08:44.314544 13992 ts_tablet_manager.cc:1397] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 17:08:44.315352 13993 tablet_bootstrap.cc:654] T 00bc93d93d7541f38e1f15f26562c8fb P 9edee6529cb941f386d9b7d54ef1af0b: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:44.316431 13993 log.cc:824] T 00bc93d93d7541f38e1f15f26562c8fb P 9edee6529cb941f386d9b7d54ef1af0b: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:44.318339 13990 raft_consensus.cc:348] T 00bc93d93d7541f38e1f15f26562c8fb P 61f540c6d02b4f9698449f34ac7be8dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edee6529cb941f386d9b7d54ef1af0b" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 36707 } } peers { permanent_uuid: "61f540c6d02b4f9698449f34ac7be8dd" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 45037 } } peers { permanent_uuid: "d4006b4216e446029592404536064faa" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 34655 } }
I20260811 17:08:44.318646 13990 raft_consensus.cc:374] T 00bc93d93d7541f38e1f15f26562c8fb P 61f540c6d02b4f9698449f34ac7be8dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:44.318712 13990 raft_consensus.cc:729] T 00bc93d93d7541f38e1f15f26562c8fb P 61f540c6d02b4f9698449f34ac7be8dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61f540c6d02b4f9698449f34ac7be8dd, State: Initialized, Role: FOLLOWER
I20260811 17:08:44.319249 13993 tablet_bootstrap.cc:492] T 00bc93d93d7541f38e1f15f26562c8fb P 9edee6529cb941f386d9b7d54ef1af0b: No bootstrap required, opened a new log
I20260811 17:08:44.319238 13990 consensus_queue.cc:260] T 00bc93d93d7541f38e1f15f26562c8fb P 61f540c6d02b4f9698449f34ac7be8dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edee6529cb941f386d9b7d54ef1af0b" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 36707 } } peers { permanent_uuid: "61f540c6d02b4f9698449f34ac7be8dd" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 45037 } } peers { permanent_uuid: "d4006b4216e446029592404536064faa" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 34655 } }
I20260811 17:08:44.319506 13993 ts_tablet_manager.cc:1397] T 00bc93d93d7541f38e1f15f26562c8fb P 9edee6529cb941f386d9b7d54ef1af0b: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 17:08:44.319655 13992 raft_consensus.cc:348] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edee6529cb941f386d9b7d54ef1af0b" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 36707 } } peers { permanent_uuid: "61f540c6d02b4f9698449f34ac7be8dd" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 45037 } } peers { permanent_uuid: "d4006b4216e446029592404536064faa" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 34655 } }
I20260811 17:08:44.320058 13992 raft_consensus.cc:374] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:44.320173 13992 raft_consensus.cc:729] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4006b4216e446029592404536064faa, State: Initialized, Role: FOLLOWER
I20260811 17:08:44.320271 13451 heartbeater.cc:503] Master 127.4.146.254:45029 was elected leader, sending a full tablet report...
I20260811 17:08:44.320554 13990 ts_tablet_manager.cc:1428] T 00bc93d93d7541f38e1f15f26562c8fb P 61f540c6d02b4f9698449f34ac7be8dd: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260811 17:08:44.320695 13992 consensus_queue.cc:260] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edee6529cb941f386d9b7d54ef1af0b" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 36707 } } peers { permanent_uuid: "61f540c6d02b4f9698449f34ac7be8dd" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 45037 } } peers { permanent_uuid: "d4006b4216e446029592404536064faa" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 34655 } }
I20260811 17:08:44.321533 13721 heartbeater.cc:503] Master 127.4.146.254:45029 was elected leader, sending a full tablet report...
I20260811 17:08:44.321870 13992 ts_tablet_manager.cc:1428] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260811 17:08:44.324615 13993 raft_consensus.cc:348] T 00bc93d93d7541f38e1f15f26562c8fb P 9edee6529cb941f386d9b7d54ef1af0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edee6529cb941f386d9b7d54ef1af0b" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 36707 } } peers { permanent_uuid: "61f540c6d02b4f9698449f34ac7be8dd" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 45037 } } peers { permanent_uuid: "d4006b4216e446029592404536064faa" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 34655 } }
I20260811 17:08:44.324901 13993 raft_consensus.cc:374] T 00bc93d93d7541f38e1f15f26562c8fb P 9edee6529cb941f386d9b7d54ef1af0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:44.324975 13993 raft_consensus.cc:729] T 00bc93d93d7541f38e1f15f26562c8fb P 9edee6529cb941f386d9b7d54ef1af0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9edee6529cb941f386d9b7d54ef1af0b, State: Initialized, Role: FOLLOWER
I20260811 17:08:44.325497 13993 consensus_queue.cc:260] T 00bc93d93d7541f38e1f15f26562c8fb P 9edee6529cb941f386d9b7d54ef1af0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edee6529cb941f386d9b7d54ef1af0b" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 36707 } } peers { permanent_uuid: "61f540c6d02b4f9698449f34ac7be8dd" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 45037 } } peers { permanent_uuid: "d4006b4216e446029592404536064faa" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 34655 } }
I20260811 17:08:44.326242 13964 heartbeater.cc:503] Master 127.4.146.254:45029 was elected leader, sending a full tablet report...
I20260811 17:08:44.327908 13993 ts_tablet_manager.cc:1428] T 00bc93d93d7541f38e1f15f26562c8fb P 9edee6529cb941f386d9b7d54ef1af0b: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
W20260811 17:08:44.365139 13454 tablet.cc:2369] T 00bc93d93d7541f38e1f15f26562c8fb P 61f540c6d02b4f9698449f34ac7be8dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 17:08:44.503422 13965 tablet.cc:2369] T 00bc93d93d7541f38e1f15f26562c8fb P 9edee6529cb941f386d9b7d54ef1af0b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 17:08:44.556366 13723 tablet.cc:2369] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 17:08:44.579502 14004 raft_consensus.cc:482] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:08:44.579761 14004 raft_consensus.cc:504] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edee6529cb941f386d9b7d54ef1af0b" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 36707 } } peers { permanent_uuid: "61f540c6d02b4f9698449f34ac7be8dd" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 45037 } } peers { permanent_uuid: "d4006b4216e446029592404536064faa" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 34655 } }
I20260811 17:08:44.581135 14004 leader_election.cc:288] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9edee6529cb941f386d9b7d54ef1af0b (127.4.146.195:36707), 61f540c6d02b4f9698449f34ac7be8dd (127.4.146.193:45037)
I20260811 17:08:44.583618 13984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:44.581562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:38939 (local address 127.4.146.195:36707)
0811 17:08:44.581694 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:44.581699 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:44.582028 (+ 329us) server_negotiation.cc:407] Connection header received
0811 17:08:44.582108 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:44.582115 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:44.582168 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:44.582259 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:44.583210 (+ 951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:44.583214 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:44.583217 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:08:44.583230 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:44.583255 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:08:44.583265 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:44.583359 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:44.583442 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 17:08:44.583482 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 17:08:44.583680 14010 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:44.581453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:36707 (local address 127.4.146.194:38939)
0811 17:08:44.581849 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:44.581865 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:44.582011 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:44.582308 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:44.582311 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:44.582332 (+ 21us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:44.582981 (+ 649us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 17:08:44.582984 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:44.582997 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 17:08:44.583052 (+ 55us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:44.583349 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:44.583352 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:44.583357 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 17:08:44.583455 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 17:08:44.583499 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":84,"threads_started":1}
I20260811 17:08:44.583864 13986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:44.581684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:60549 (local address 127.4.146.193:45037)
0811 17:08:44.581837 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:44.581843 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:44.582215 (+ 372us) server_negotiation.cc:407] Connection header received
0811 17:08:44.582277 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:44.582280 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:44.582321 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:44.582416 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:44.583336 (+ 920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:44.583341 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:44.583344 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:08:44.583358 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:44.583383 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:08:44.583399 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:44.583513 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:44.583673 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 17:08:44.583725 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 17:08:44.584285 14011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:44.581453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:45037 (local address 127.4.146.194:60549)
0811 17:08:44.582057 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:44.582072 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:44.582175 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:44.582459 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:44.582462 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:44.582478 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:44.583161 (+ 683us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 17:08:44.583163 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:44.583174 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 17:08:44.583200 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:44.583557 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:44.583561 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:44.583564 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 17:08:44.584031 (+ 467us) client_negotiation.cc:240] Negotiation successful
0811 17:08:44.584077 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"mutex_wait_us":247,"thread_start_us":73,"threads_started":1}
I20260811 17:08:44.584473 13872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00bc93d93d7541f38e1f15f26562c8fb" candidate_uuid: "d4006b4216e446029592404536064faa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edee6529cb941f386d9b7d54ef1af0b" is_pre_election: true
I20260811 17:08:44.584831 13872 raft_consensus.cc:2454] T 00bc93d93d7541f38e1f15f26562c8fb P 9edee6529cb941f386d9b7d54ef1af0b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4006b4216e446029592404536064faa in term 0.
I20260811 17:08:44.584934 13371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00bc93d93d7541f38e1f15f26562c8fb" candidate_uuid: "d4006b4216e446029592404536064faa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61f540c6d02b4f9698449f34ac7be8dd" is_pre_election: true
I20260811 17:08:44.585218 13371 raft_consensus.cc:2454] T 00bc93d93d7541f38e1f15f26562c8fb P 61f540c6d02b4f9698449f34ac7be8dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4006b4216e446029592404536064faa in term 0.
I20260811 17:08:44.585398 13503 leader_election.cc:302] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9edee6529cb941f386d9b7d54ef1af0b, d4006b4216e446029592404536064faa; no voters:
I20260811 17:08:44.585978 14004 raft_consensus.cc:2781] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:08:44.586066 14004 raft_consensus.cc:482] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:08:44.586103 14004 raft_consensus.cc:3037] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:44.587430 14004 raft_consensus.cc:504] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edee6529cb941f386d9b7d54ef1af0b" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 36707 } } peers { permanent_uuid: "61f540c6d02b4f9698449f34ac7be8dd" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 45037 } } peers { permanent_uuid: "d4006b4216e446029592404536064faa" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 34655 } }
I20260811 17:08:44.587802 14004 leader_election.cc:288] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa [CANDIDATE]: Term 1 election: Requested vote from peers 9edee6529cb941f386d9b7d54ef1af0b (127.4.146.195:36707), 61f540c6d02b4f9698449f34ac7be8dd (127.4.146.193:45037)
I20260811 17:08:44.588331 13872 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00bc93d93d7541f38e1f15f26562c8fb" candidate_uuid: "d4006b4216e446029592404536064faa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9edee6529cb941f386d9b7d54ef1af0b"
I20260811 17:08:44.588338 13371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00bc93d93d7541f38e1f15f26562c8fb" candidate_uuid: "d4006b4216e446029592404536064faa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61f540c6d02b4f9698449f34ac7be8dd"
I20260811 17:08:44.588481 13371 raft_consensus.cc:3037] T 00bc93d93d7541f38e1f15f26562c8fb P 61f540c6d02b4f9698449f34ac7be8dd [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:44.588514 13872 raft_consensus.cc:3037] T 00bc93d93d7541f38e1f15f26562c8fb P 9edee6529cb941f386d9b7d54ef1af0b [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:44.589795 13872 raft_consensus.cc:2454] T 00bc93d93d7541f38e1f15f26562c8fb P 9edee6529cb941f386d9b7d54ef1af0b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4006b4216e446029592404536064faa in term 1.
I20260811 17:08:44.589818 13371 raft_consensus.cc:2454] T 00bc93d93d7541f38e1f15f26562c8fb P 61f540c6d02b4f9698449f34ac7be8dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4006b4216e446029592404536064faa in term 1.
I20260811 17:08:44.590215 13501 leader_election.cc:302] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61f540c6d02b4f9698449f34ac7be8dd, d4006b4216e446029592404536064faa; no voters:
I20260811 17:08:44.590433 14004 raft_consensus.cc:2781] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:44.590734 14004 raft_consensus.cc:686] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa [term 1 LEADER]: Becoming Leader. State: Replica: d4006b4216e446029592404536064faa, State: Running, Role: LEADER
I20260811 17:08:44.591154 14004 consensus_queue.cc:237] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edee6529cb941f386d9b7d54ef1af0b" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 36707 } } peers { permanent_uuid: "61f540c6d02b4f9698449f34ac7be8dd" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 45037 } } peers { permanent_uuid: "d4006b4216e446029592404536064faa" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 34655 } }
I20260811 17:08:44.594815 13113 catalog_manager.cc:5495] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa reported cstate change: term changed from 0 to 1, leader changed from <none> to d4006b4216e446029592404536064faa (127.4.146.194). New cstate: current_term: 1 leader_uuid: "d4006b4216e446029592404536064faa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9edee6529cb941f386d9b7d54ef1af0b" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 36707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61f540c6d02b4f9698449f34ac7be8dd" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4006b4216e446029592404536064faa" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 34655 } health_report { overall_health: HEALTHY } } }
I20260811 17:08:44.665218 13989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:44.663195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60820 (local address 127.4.146.194:34655)
0811 17:08:44.663361 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:44.663368 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:44.663387 (+ 19us) server_negotiation.cc:407] Connection header received
0811 17:08:44.663500 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:44.663503 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:44.663578 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:44.663692 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:44.664692 (+ 1000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:44.664697 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:44.664702 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:08:44.664720 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:44.664743 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:08:44.664752 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:44.664871 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:44.664998 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 17:08:44.665049 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 17:08:44.672557 13371 raft_consensus.cc:1261] T 00bc93d93d7541f38e1f15f26562c8fb P 61f540c6d02b4f9698449f34ac7be8dd [term 1 FOLLOWER]: Refusing update from remote peer d4006b4216e446029592404536064faa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:08:44.672557 13872 raft_consensus.cc:1261] T 00bc93d93d7541f38e1f15f26562c8fb P 9edee6529cb941f386d9b7d54ef1af0b [term 1 FOLLOWER]: Refusing update from remote peer d4006b4216e446029592404536064faa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:08:44.673400 14004 consensus_queue.cc:1035] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa [LEADER]: Connected to new peer: Peer: permanent_uuid: "61f540c6d02b4f9698449f34ac7be8dd" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:08:44.673647 14013 consensus_queue.cc:1035] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa [LEADER]: Connected to new peer: Peer: permanent_uuid: "9edee6529cb941f386d9b7d54ef1af0b" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 36707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:08:44.681938 14021 mvcc.cc:205] Tried to move back new op lower bound from 7317373438648938496 to 7317373438328569856. Current Snapshot: MvccSnapshot[applied={T|T < 7317373438648938496}]
I20260811 17:08:44.684705 14027 mvcc.cc:205] Tried to move back new op lower bound from 7317373438648938496 to 7317373438328569856. Current Snapshot: MvccSnapshot[applied={T|T < 7317373438648938496}]
I20260811 17:08:44.684948 14029 mvcc.cc:205] Tried to move back new op lower bound from 7317373438648938496 to 7317373438328569856. Current Snapshot: MvccSnapshot[applied={T|T < 7317373438648938496}]
I20260811 17:08:44.692373 13115 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:08:44.692553 13115 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37054:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:08:44.695370 13115 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ced145099f894ad88862dba530f38560: Sending DeleteTablet for 3 replicas of tablet 00bc93d93d7541f38e1f15f26562c8fb
I20260811 17:08:44.696501 13837 tablet_service.cc:1514] Processing DeleteTablet for tablet 00bc93d93d7541f38e1f15f26562c8fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:44 UTC) from {username='slave'} at 127.0.0.1:57768
I20260811 17:08:44.696524 13340 tablet_service.cc:1514] Processing DeleteTablet for tablet 00bc93d93d7541f38e1f15f26562c8fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:44 UTC) from {username='slave'} at 127.0.0.1:54456
I20260811 17:08:44.696635 13594 tablet_service.cc:1514] Processing DeleteTablet for tablet 00bc93d93d7541f38e1f15f26562c8fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:44 UTC) from {username='slave'} at 127.0.0.1:60808
I20260811 17:08:44.697222 14042 tablet_replica.cc:330] T 00bc93d93d7541f38e1f15f26562c8fb P 61f540c6d02b4f9698449f34ac7be8dd: stopping tablet replica
I20260811 17:08:44.697467 14043 tablet_replica.cc:330] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa: stopping tablet replica
I20260811 17:08:44.697656 14042 raft_consensus.cc:2229] T 00bc93d93d7541f38e1f15f26562c8fb P 61f540c6d02b4f9698449f34ac7be8dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:08:44.697779 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 13228
I20260811 17:08:44.698030 14043 raft_consensus.cc:2229] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa [term 1 LEADER]: Raft consensus shutting down.
I20260811 17:08:44.698122 14042 raft_consensus.cc:2258] T 00bc93d93d7541f38e1f15f26562c8fb P 61f540c6d02b4f9698449f34ac7be8dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:44.698577 14043 raft_consensus.cc:2258] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:44.699090 14041 tablet_replica.cc:330] T 00bc93d93d7541f38e1f15f26562c8fb P 9edee6529cb941f386d9b7d54ef1af0b: stopping tablet replica
I20260811 17:08:44.699496 14041 raft_consensus.cc:2229] T 00bc93d93d7541f38e1f15f26562c8fb P 9edee6529cb941f386d9b7d54ef1af0b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:08:44.699895 14041 raft_consensus.cc:2258] T 00bc93d93d7541f38e1f15f26562c8fb P 9edee6529cb941f386d9b7d54ef1af0b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:44.702616 14043 ts_tablet_manager.cc:1905] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:44.702616 14041 ts_tablet_manager.cc:1905] T 00bc93d93d7541f38e1f15f26562c8fb P 9edee6529cb941f386d9b7d54ef1af0b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:44.706158 14043 ts_tablet_manager.cc:1918] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:08:44.706410 14043 log.cc:1196] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-1/wal/wals/00bc93d93d7541f38e1f15f26562c8fb
I20260811 17:08:44.706835 14041 ts_tablet_manager.cc:1918] T 00bc93d93d7541f38e1f15f26562c8fb P 9edee6529cb941f386d9b7d54ef1af0b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:08:44.706967 14041 log.cc:1196] T 00bc93d93d7541f38e1f15f26562c8fb P 9edee6529cb941f386d9b7d54ef1af0b: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/00bc93d93d7541f38e1f15f26562c8fb
I20260811 17:08:44.707195 14043 ts_tablet_manager.cc:1939] T 00bc93d93d7541f38e1f15f26562c8fb P d4006b4216e446029592404536064faa: Deleting consensus metadata
I20260811 17:08:44.707365 14041 ts_tablet_manager.cc:1939] T 00bc93d93d7541f38e1f15f26562c8fb P 9edee6529cb941f386d9b7d54ef1af0b: Deleting consensus metadata
I20260811 17:08:44.708877 13086 catalog_manager.cc:4841] TS d4006b4216e446029592404536064faa (127.4.146.194:34655): tablet 00bc93d93d7541f38e1f15f26562c8fb (table test-table [id=a58865577f51424ea39f51cd8f9c5e08]) successfully deleted
I20260811 17:08:44.710019 13087 catalog_manager.cc:4841] TS 9edee6529cb941f386d9b7d54ef1af0b (127.4.146.195:36707): tablet 00bc93d93d7541f38e1f15f26562c8fb (table test-table [id=a58865577f51424ea39f51cd8f9c5e08]) successfully deleted
I20260811 17:08:44.719987 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 13462
W20260811 17:08:44.720065 13086 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.146.193:45037 (error 108)
I20260811 17:08:44.727985 13982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:44.725949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:45037 (local address 127.0.0.1:54462)
0811 17:08:44.727735 (+ 1786us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:44.727857 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.193:45037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1634}
W20260811 17:08:44.730432 13086 catalog_manager.cc:4584] TS 61f540c6d02b4f9698449f34ac7be8dd (127.4.146.193:45037): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 00bc93d93d7541f38e1f15f26562c8fb: Network error: Client connection negotiation failed: client connection to 127.4.146.193:45037: connect: Connection refused (error 111)
I20260811 17:08:44.736454 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 13727
I20260811 17:08:44.750928 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 13054
2026-08-11T17:08:44Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1396 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 17:08:44.786881 4683 mini_oidc.cc:152] Starting JWKS server
I20260811 17:08:44.788870 4683 webserver.cc:460] Webserver started at https://127.0.0.1:45303/ using document root <none> and password file <none>
I20260811 17:08:44.789081 4683 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 17:08:44.789372 4683 webserver.cc:460] Webserver started at http://127.0.0.1:32973/ using document root <none> and password file <none>
2026-08-11T17:08:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:08:44Z Disabled control of system clock
I20260811 17:08:44.801095 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:36833
--webserver_interface=127.4.146.254
--webserver_port=0
--builtin_ntp_servers=127.4.146.212:43877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:36833
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45303/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786468091870818-4683-0/testchainca.cert with env {}
W20260811 17:08:44.919979 14058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:44.920333 14058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:44.920387 14058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:44.924645 14058 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:08:44.924728 14058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:44.924744 14058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:44.924762 14058 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:08:44.924777 14058 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 17:08:44.924794 14058 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 17:08:44.924808 14058 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45303/jwks.json
I20260811 17:08:44.930830 14058 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:43877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:36833
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:36833
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45303/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786468091870818-4683-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14058
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:44.932021 14058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:44.933173 14058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:44.942862 14073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:44.942875 14067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:44.942862 14068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:44.943177 14058 server_base.cc:1034] running on GCE node
I20260811 17:08:44.943981 14058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:44.945356 14058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:44.946593 14058 hybrid_clock.cc:648] HybridClock initialized: now 1786468124946556 us; error 63 us; skew 500 ppm
I20260811 17:08:44.949420 14058 webserver.cc:460] Webserver started at http://127.4.146.254:37593/ using document root <none> and password file <none>
I20260811 17:08:44.950121 14058 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:44.950201 14058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:44.950440 14058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:44.952812 14058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "502d90ad856a444d850b34f023a0ec9b"
format_stamp: "Formatted at 2026-08-11 17:08:44 on dist-test-slave-7vjv"
server_key: "59ca0944c85cd9844dca2d4c7f3ce1b8"
server_key_iv: "619e0cd79c9a40455b90f8f6ef154494"
server_key_version: "encryptionkey@0"
I20260811 17:08:44.953447 14058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "502d90ad856a444d850b34f023a0ec9b"
format_stamp: "Formatted at 2026-08-11 17:08:44 on dist-test-slave-7vjv"
server_key: "59ca0944c85cd9844dca2d4c7f3ce1b8"
server_key_iv: "619e0cd79c9a40455b90f8f6ef154494"
server_key_version: "encryptionkey@0"
I20260811 17:08:44.957751 14058 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 17:08:44.960717 14090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:44.962383 14058 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:08:44.962576 14058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "502d90ad856a444d850b34f023a0ec9b"
format_stamp: "Formatted at 2026-08-11 17:08:44 on dist-test-slave-7vjv"
server_key: "59ca0944c85cd9844dca2d4c7f3ce1b8"
server_key_iv: "619e0cd79c9a40455b90f8f6ef154494"
server_key_version: "encryptionkey@0"
I20260811 17:08:44.962728 14058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:45.000703 14058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:45.001570 14058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:45.001811 14058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:45.010643 14058 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:36833
I20260811 17:08:45.010663 14171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:36833 every 8 connection(s)
I20260811 17:08:45.011768 14058 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:08:45.015489 14175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:45.019119 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 14058
I20260811 17:08:45.019317 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:08:45.019652 4683 external_mini_cluster.cc:1428] Setting key 73e0236ee276f3ae67e007665516cb92
I20260811 17:08:45.022522 14175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 502d90ad856a444d850b34f023a0ec9b: Bootstrap starting.
I20260811 17:08:45.025210 14175 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 502d90ad856a444d850b34f023a0ec9b: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:45.026059 14175 log.cc:824] T 00000000000000000000000000000000 P 502d90ad856a444d850b34f023a0ec9b: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:45.028723 14175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 502d90ad856a444d850b34f023a0ec9b: No bootstrap required, opened a new log
I20260811 17:08:45.030094 14185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:45.021321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57796 (local address 127.4.146.254:36833)
0811 17:08:45.022061 (+ 740us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:45.022078 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:45.022118 (+ 40us) server_negotiation.cc:407] Connection header received
0811 17:08:45.022863 (+ 745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:45.022884 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:45.023313 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:45.023623 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:45.024206 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:45.025246 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:45.026326 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:45.026993 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:45.027225 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:45.028190 (+ 965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:45.028196 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:45.028211 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:08:45.028652 (+ 441us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:45.028719 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:08:45.028743 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:45.028865 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:45.029018 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 17:08:45.029317 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":181,"threads_started":1}
I20260811 17:08:45.033483 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:08:45.033368 14175 raft_consensus.cc:348] T 00000000000000000000000000000000 P 502d90ad856a444d850b34f023a0ec9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "502d90ad856a444d850b34f023a0ec9b" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 36833 } }
I20260811 17:08:45.033706 14175 raft_consensus.cc:374] T 00000000000000000000000000000000 P 502d90ad856a444d850b34f023a0ec9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:45.033785 14175 raft_consensus.cc:729] T 00000000000000000000000000000000 P 502d90ad856a444d850b34f023a0ec9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 502d90ad856a444d850b34f023a0ec9b, State: Initialized, Role: FOLLOWER
I20260811 17:08:45.034287 14175 consensus_queue.cc:260] T 00000000000000000000000000000000 P 502d90ad856a444d850b34f023a0ec9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "502d90ad856a444d850b34f023a0ec9b" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 36833 } }
I20260811 17:08:45.034448 14175 raft_consensus.cc:388] T 00000000000000000000000000000000 P 502d90ad856a444d850b34f023a0ec9b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:08:45.034521 14175 raft_consensus.cc:482] T 00000000000000000000000000000000 P 502d90ad856a444d850b34f023a0ec9b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:08:45.034646 14175 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 502d90ad856a444d850b34f023a0ec9b [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:45.036022 14175 raft_consensus.cc:504] T 00000000000000000000000000000000 P 502d90ad856a444d850b34f023a0ec9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "502d90ad856a444d850b34f023a0ec9b" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 36833 } }
I20260811 17:08:45.036410 14175 leader_election.cc:302] T 00000000000000000000000000000000 P 502d90ad856a444d850b34f023a0ec9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 502d90ad856a444d850b34f023a0ec9b; no voters:
I20260811 17:08:45.036912 14189 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 502d90ad856a444d850b34f023a0ec9b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:45.036823 14175 leader_election.cc:288] T 00000000000000000000000000000000 P 502d90ad856a444d850b34f023a0ec9b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:08:45.037262 14189 raft_consensus.cc:686] T 00000000000000000000000000000000 P 502d90ad856a444d850b34f023a0ec9b [term 1 LEADER]: Becoming Leader. State: Replica: 502d90ad856a444d850b34f023a0ec9b, State: Running, Role: LEADER
I20260811 17:08:45.037669 14189 consensus_queue.cc:237] T 00000000000000000000000000000000 P 502d90ad856a444d850b34f023a0ec9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "502d90ad856a444d850b34f023a0ec9b" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 36833 } }
I20260811 17:08:45.038487 14175 sys_catalog.cc:564] T 00000000000000000000000000000000 P 502d90ad856a444d850b34f023a0ec9b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:08:45.039625 14191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 502d90ad856a444d850b34f023a0ec9b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 502d90ad856a444d850b34f023a0ec9b. Latest consensus state: current_term: 1 leader_uuid: "502d90ad856a444d850b34f023a0ec9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "502d90ad856a444d850b34f023a0ec9b" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 36833 } } }
I20260811 17:08:45.039804 14191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 502d90ad856a444d850b34f023a0ec9b [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:45.040239 14205 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:08:45.040210 14192 sys_catalog.cc:455] T 00000000000000000000000000000000 P 502d90ad856a444d850b34f023a0ec9b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "502d90ad856a444d850b34f023a0ec9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "502d90ad856a444d850b34f023a0ec9b" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 36833 } } }
I20260811 17:08:45.040359 14192 sys_catalog.cc:458] T 00000000000000000000000000000000 P 502d90ad856a444d850b34f023a0ec9b [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:45.044561 14205 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:08:45.051452 14205 catalog_manager.cc:1347] Generated new cluster ID: 6abcefed7480464fa8bf06ce5f70caf7
I20260811 17:08:45.051609 14205 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:08:45.070111 14205 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:08:45.071578 14205 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:08:45.079926 14205 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 502d90ad856a444d850b34f023a0ec9b: Generated new TSK 0
I20260811 17:08:45.081015 14205 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 17:08:45.117868 14238 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 17:08:45.118090 14238 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 17:08:45.118681 14185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:45.100013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57798 (local address 127.4.146.254:36833)
0811 17:08:45.100206 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:45.100212 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:45.100454 (+ 242us) server_negotiation.cc:407] Connection header received
0811 17:08:45.100691 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:45.100694 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:45.100750 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:45.100853 (+ 103us) server_negotiation.cc:226] Negotiated authn=JWT
0811 17:08:45.101196 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:45.101807 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:45.103094 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:45.103347 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:45.103439 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:45.103896 (+ 457us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 17:08:45.118231 (+ 14335us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45303/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 17:08:45.118544 (+ 313us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57798: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45303/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":67}
W20260811 17:08:45.118803 14185 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57798: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45303/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 17:08:45.120306 14236 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:08:45.099901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:36833 (local address 127.0.0.1:57798)
0811 17:08:45.100346 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:45.100363 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:45.100513 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:45.100900 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:45.100904 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:45.100913 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0811 17:08:45.101042 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:45.101049 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:45.101927 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:45.101931 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:45.102944 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:45.102954 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:45.103481 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:45.103485 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:45.103587 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:45.103672 (+ 85us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 17:08:45.118538 (+ 14866us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45303/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 17:08:45.118831 (+ 293us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.4.146.254:36833: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45303/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":183,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.4.146.254:36833: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45303/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 17:08:45.121105 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 14058
2026-08-11T17:08:45Z chronyd exiting
I20260811 17:08:45.168210 4683 test_util.cc:175] -----------------------------------------------
I20260811 17:08:45.168313 4683 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786468091870818-4683-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (383 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 17:08:45.169503 4683 mini_oidc.cc:152] Starting JWKS server
I20260811 17:08:45.170508 4683 webserver.cc:460] Webserver started at https://127.0.0.1:38685/ using document root <none> and password file <none>
I20260811 17:08:45.170632 4683 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 17:08:45.170928 4683 webserver.cc:460] Webserver started at http://127.0.0.1:39293/ using document root <none> and password file <none>
2026-08-11T17:08:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:08:45Z Disabled control of system clock
I20260811 17:08:45.182236 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:45649
--webserver_interface=127.4.146.254
--webserver_port=0
--builtin_ntp_servers=127.4.146.212:34201
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:45649
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38685/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786468091870818-4683-0/testchainca.cert with env {}
W20260811 17:08:45.304986 14247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:45.305315 14247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:45.305359 14247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:45.309587 14247 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:08:45.309671 14247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:45.309686 14247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:45.309705 14247 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:08:45.309721 14247 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 17:08:45.309738 14247 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 17:08:45.309751 14247 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38685/jwks.json
I20260811 17:08:45.315622 14247 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:34201
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:45649
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:45649
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38685/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786468091870818-4683-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14247
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:45.316855 14247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:45.317958 14247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:45.327633 14258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:45.327677 14263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:45.327636 14261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:45.327744 14247 server_base.cc:1034] running on GCE node
I20260811 17:08:45.328611 14247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:45.329921 14247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:45.331156 14247 hybrid_clock.cc:648] HybridClock initialized: now 1786468125331113 us; error 49 us; skew 500 ppm
I20260811 17:08:45.337395 14247 webserver.cc:460] Webserver started at http://127.4.146.254:46731/ using document root <none> and password file <none>
I20260811 17:08:45.338129 14247 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:45.338248 14247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:45.338511 14247 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:45.340929 14247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "1ab4533ff82c4fd0be8611954b35930f"
format_stamp: "Formatted at 2026-08-11 17:08:45 on dist-test-slave-7vjv"
server_key: "1e7adeba8f20846a292d412e0201957e"
server_key_iv: "fd99b7935ca8741ff18e7f0e574a587a"
server_key_version: "encryptionkey@0"
I20260811 17:08:45.341554 14247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "1ab4533ff82c4fd0be8611954b35930f"
format_stamp: "Formatted at 2026-08-11 17:08:45 on dist-test-slave-7vjv"
server_key: "1e7adeba8f20846a292d412e0201957e"
server_key_iv: "fd99b7935ca8741ff18e7f0e574a587a"
server_key_version: "encryptionkey@0"
I20260811 17:08:45.345757 14247 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 17:08:45.348672 14271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:45.350097 14247 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:08:45.350299 14247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "1ab4533ff82c4fd0be8611954b35930f"
format_stamp: "Formatted at 2026-08-11 17:08:45 on dist-test-slave-7vjv"
server_key: "1e7adeba8f20846a292d412e0201957e"
server_key_iv: "fd99b7935ca8741ff18e7f0e574a587a"
server_key_version: "encryptionkey@0"
I20260811 17:08:45.350450 14247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:45.365926 14247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:45.366765 14247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:45.367003 14247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:45.375706 14247 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:45649
I20260811 17:08:45.375717 14362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:45649 every 8 connection(s)
I20260811 17:08:45.376818 14247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:08:45.380302 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 14247
I20260811 17:08:45.380468 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:08:45.380757 4683 external_mini_cluster.cc:1428] Setting key 3450f490a50aae4003076b04282bbf54
I20260811 17:08:45.380782 14363 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:45.387665 14363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ab4533ff82c4fd0be8611954b35930f: Bootstrap starting.
I20260811 17:08:45.390151 14363 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ab4533ff82c4fd0be8611954b35930f: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:45.390447 14367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:45.382142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56534 (local address 127.4.146.254:45649)
0811 17:08:45.382876 (+ 734us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:45.382898 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:45.382944 (+ 46us) server_negotiation.cc:407] Connection header received
0811 17:08:45.383696 (+ 752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:45.383717 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:45.384193 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:45.384552 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:45.384983 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:45.385956 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:45.386866 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:45.387365 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:45.387543 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:45.388544 (+ 1001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:45.388549 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:45.388563 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:08:45.388964 (+ 401us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:45.389034 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:08:45.389057 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:45.389170 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:45.389327 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 17:08:45.389646 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":157,"threads_started":1}
I20260811 17:08:45.391057 14363 log.cc:824] T 00000000000000000000000000000000 P 1ab4533ff82c4fd0be8611954b35930f: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:45.393342 14363 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ab4533ff82c4fd0be8611954b35930f: No bootstrap required, opened a new log
I20260811 17:08:45.393445 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:08:45.397250 14363 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ab4533ff82c4fd0be8611954b35930f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ab4533ff82c4fd0be8611954b35930f" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 45649 } }
I20260811 17:08:45.397507 14363 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1ab4533ff82c4fd0be8611954b35930f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:45.397547 14363 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ab4533ff82c4fd0be8611954b35930f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ab4533ff82c4fd0be8611954b35930f, State: Initialized, Role: FOLLOWER
I20260811 17:08:45.397925 14363 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ab4533ff82c4fd0be8611954b35930f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ab4533ff82c4fd0be8611954b35930f" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 45649 } }
I20260811 17:08:45.398048 14363 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1ab4533ff82c4fd0be8611954b35930f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:08:45.398089 14363 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ab4533ff82c4fd0be8611954b35930f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:08:45.398155 14363 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ab4533ff82c4fd0be8611954b35930f [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:45.399180 14363 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ab4533ff82c4fd0be8611954b35930f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ab4533ff82c4fd0be8611954b35930f" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 45649 } }
I20260811 17:08:45.399509 14363 leader_election.cc:302] T 00000000000000000000000000000000 P 1ab4533ff82c4fd0be8611954b35930f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ab4533ff82c4fd0be8611954b35930f; no voters:
I20260811 17:08:45.399832 14363 leader_election.cc:288] T 00000000000000000000000000000000 P 1ab4533ff82c4fd0be8611954b35930f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:08:45.399982 14372 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ab4533ff82c4fd0be8611954b35930f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:45.400272 14372 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ab4533ff82c4fd0be8611954b35930f [term 1 LEADER]: Becoming Leader. State: Replica: 1ab4533ff82c4fd0be8611954b35930f, State: Running, Role: LEADER
I20260811 17:08:45.400672 14372 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ab4533ff82c4fd0be8611954b35930f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ab4533ff82c4fd0be8611954b35930f" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 45649 } }
I20260811 17:08:45.401270 14363 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ab4533ff82c4fd0be8611954b35930f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:08:45.402587 14380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ab4533ff82c4fd0be8611954b35930f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ab4533ff82c4fd0be8611954b35930f. Latest consensus state: current_term: 1 leader_uuid: "1ab4533ff82c4fd0be8611954b35930f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ab4533ff82c4fd0be8611954b35930f" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 45649 } } }
I20260811 17:08:45.402640 14375 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ab4533ff82c4fd0be8611954b35930f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1ab4533ff82c4fd0be8611954b35930f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ab4533ff82c4fd0be8611954b35930f" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 45649 } } }
I20260811 17:08:45.402729 14380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ab4533ff82c4fd0be8611954b35930f [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:45.402742 14375 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ab4533ff82c4fd0be8611954b35930f [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:45.403216 14390 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:08:45.406591 14390 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:08:45.413652 14390 catalog_manager.cc:1347] Generated new cluster ID: cfc7291b88ad43c0a77b5c93baf6be13
I20260811 17:08:45.413767 14390 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:08:45.422271 14390 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:08:45.423614 14390 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:08:45.430976 14390 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1ab4533ff82c4fd0be8611954b35930f: Generated new TSK 0
I20260811 17:08:45.431845 14390 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 17:08:45.459872 14415 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 17:08:45.459977 14415 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 17:08:45.460716 14367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:45.444332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56542 (local address 127.4.146.254:45649)
0811 17:08:45.444490 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:45.444496 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:45.444695 (+ 199us) server_negotiation.cc:407] Connection header received
0811 17:08:45.444870 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:45.444872 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:45.444924 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:45.445024 (+ 100us) server_negotiation.cc:226] Negotiated authn=JWT
0811 17:08:45.445298 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:45.445824 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:45.447122 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:45.447342 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:45.447428 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:45.447780 (+ 352us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 17:08:45.460349 (+ 12569us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38685/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 17:08:45.460585 (+ 236us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56542: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38685/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":61}
W20260811 17:08:45.460807 14367 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56542: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38685/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260811 17:08:45.460968 14414 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:08:45.444255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:45649 (local address 127.0.0.1:56542)
0811 17:08:45.444591 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:45.444608 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:45.444734 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:45.445054 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:45.445057 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:45.445065 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0811 17:08:45.445186 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:45.445193 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:45.445935 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:45.445939 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:45.446961 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:45.446972 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:45.447473 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:45.447477 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:45.447568 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:45.447600 (+ 32us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 17:08:45.460570 (+ 12970us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38685/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 17:08:45.460778 (+ 208us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.4.146.254:45649: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38685/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":140,"threads_started":1}
I20260811 17:08:45.461678 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 14247
2026-08-11T17:08:45Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (346 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 17:08:45.516423 4683 mini_oidc.cc:152] Starting JWKS server
I20260811 17:08:45.517372 4683 webserver.cc:460] Webserver started at https://127.0.0.1:33927/ using document root <none> and password file <none>
I20260811 17:08:45.517493 4683 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 17:08:45.517802 4683 webserver.cc:460] Webserver started at http://127.0.0.1:41859/ using document root <none> and password file <none>
2026-08-11T17:08:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:08:45Z Disabled control of system clock
I20260811 17:08:45.529292 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:41285
--webserver_interface=127.4.146.254
--webserver_port=0
--builtin_ntp_servers=127.4.146.212:36125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:41285
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33927/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 17:08:45.648646 14425 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:45.648985 14425 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:45.649029 14425 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:45.653414 14425 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:08:45.653497 14425 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:45.653513 14425 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:45.653530 14425 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:08:45.653545 14425 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 17:08:45.653602 14425 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 17:08:45.653630 14425 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33927/jwks.json
I20260811 17:08:45.658665 14425 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:36125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:41285
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:41285
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33927/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14425
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:45.659912 14425 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:45.661448 14425 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:45.671178 14433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:45.671213 14439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:45.671315 14425 server_base.cc:1034] running on GCE node
W20260811 17:08:45.671190 14434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:45.672071 14425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:45.673288 14425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:45.674456 14425 hybrid_clock.cc:648] HybridClock initialized: now 1786468125674420 us; error 52 us; skew 500 ppm
I20260811 17:08:45.676576 14425 webserver.cc:460] Webserver started at http://127.4.146.254:44543/ using document root <none> and password file <none>
I20260811 17:08:45.677196 14425 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:45.677263 14425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:45.677481 14425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:45.679642 14425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "6f3e8b8bb1aa4ab1836ca67bf1f55849"
format_stamp: "Formatted at 2026-08-11 17:08:45 on dist-test-slave-7vjv"
server_key: "0a33b8a5d6e7bfba0bd904a4dc7f8094"
server_key_iv: "25210e4d600b2b9b379876f2623b9d85"
server_key_version: "encryptionkey@0"
I20260811 17:08:45.680313 14425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "6f3e8b8bb1aa4ab1836ca67bf1f55849"
format_stamp: "Formatted at 2026-08-11 17:08:45 on dist-test-slave-7vjv"
server_key: "0a33b8a5d6e7bfba0bd904a4dc7f8094"
server_key_iv: "25210e4d600b2b9b379876f2623b9d85"
server_key_version: "encryptionkey@0"
I20260811 17:08:45.684739 14425 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 17:08:45.687676 14451 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:45.689301 14425 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:08:45.689491 14425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "6f3e8b8bb1aa4ab1836ca67bf1f55849"
format_stamp: "Formatted at 2026-08-11 17:08:45 on dist-test-slave-7vjv"
server_key: "0a33b8a5d6e7bfba0bd904a4dc7f8094"
server_key_iv: "25210e4d600b2b9b379876f2623b9d85"
server_key_version: "encryptionkey@0"
I20260811 17:08:45.689638 14425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:45.701910 14425 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:45.702687 14425 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:45.702910 14425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:45.710777 14425 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:41285
I20260811 17:08:45.710829 14540 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:41285 every 8 connection(s)
I20260811 17:08:45.711865 14425 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:08:45.715373 14541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:45.716883 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 14425
I20260811 17:08:45.717103 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:08:45.717423 4683 external_mini_cluster.cc:1428] Setting key 2019928ffccd959021f32e8ef655aabe
I20260811 17:08:45.722453 14541 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f3e8b8bb1aa4ab1836ca67bf1f55849: Bootstrap starting.
I20260811 17:08:45.725382 14541 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f3e8b8bb1aa4ab1836ca67bf1f55849: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:45.726352 14541 log.cc:824] T 00000000000000000000000000000000 P 6f3e8b8bb1aa4ab1836ca67bf1f55849: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:45.728192 14548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:45.719001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59956 (local address 127.4.146.254:41285)
0811 17:08:45.719747 (+ 746us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:45.719767 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:45.719810 (+ 43us) server_negotiation.cc:407] Connection header received
0811 17:08:45.720651 (+ 841us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:45.720675 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:45.721163 (+ 488us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:45.721497 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:45.721882 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:45.723017 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:45.724327 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:45.724905 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:45.725071 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:45.726132 (+ 1061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:45.726139 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:45.726155 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:08:45.726637 (+ 482us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:45.726703 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:08:45.726725 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:45.726860 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:45.727028 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 17:08:45.727368 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":164,"threads_started":1}
I20260811 17:08:45.728879 14541 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f3e8b8bb1aa4ab1836ca67bf1f55849: No bootstrap required, opened a new log
I20260811 17:08:45.731166 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:08:45.733089 14541 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f3e8b8bb1aa4ab1836ca67bf1f55849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f3e8b8bb1aa4ab1836ca67bf1f55849" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41285 } }
I20260811 17:08:45.733328 14541 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f3e8b8bb1aa4ab1836ca67bf1f55849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:45.733404 14541 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f3e8b8bb1aa4ab1836ca67bf1f55849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3e8b8bb1aa4ab1836ca67bf1f55849, State: Initialized, Role: FOLLOWER
I20260811 17:08:45.733855 14541 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f3e8b8bb1aa4ab1836ca67bf1f55849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f3e8b8bb1aa4ab1836ca67bf1f55849" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41285 } }
I20260811 17:08:45.734000 14541 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6f3e8b8bb1aa4ab1836ca67bf1f55849 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:08:45.734068 14541 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6f3e8b8bb1aa4ab1836ca67bf1f55849 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:08:45.734171 14541 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f3e8b8bb1aa4ab1836ca67bf1f55849 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:45.735165 14541 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6f3e8b8bb1aa4ab1836ca67bf1f55849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f3e8b8bb1aa4ab1836ca67bf1f55849" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41285 } }
I20260811 17:08:45.735522 14541 leader_election.cc:302] T 00000000000000000000000000000000 P 6f3e8b8bb1aa4ab1836ca67bf1f55849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6f3e8b8bb1aa4ab1836ca67bf1f55849; no voters:
I20260811 17:08:45.735893 14541 leader_election.cc:288] T 00000000000000000000000000000000 P 6f3e8b8bb1aa4ab1836ca67bf1f55849 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:08:45.736019 14552 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6f3e8b8bb1aa4ab1836ca67bf1f55849 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:45.736349 14552 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6f3e8b8bb1aa4ab1836ca67bf1f55849 [term 1 LEADER]: Becoming Leader. State: Replica: 6f3e8b8bb1aa4ab1836ca67bf1f55849, State: Running, Role: LEADER
I20260811 17:08:45.736706 14552 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6f3e8b8bb1aa4ab1836ca67bf1f55849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f3e8b8bb1aa4ab1836ca67bf1f55849" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41285 } }
I20260811 17:08:45.737268 14541 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f3e8b8bb1aa4ab1836ca67bf1f55849 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:08:45.738507 14553 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f3e8b8bb1aa4ab1836ca67bf1f55849 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6f3e8b8bb1aa4ab1836ca67bf1f55849" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f3e8b8bb1aa4ab1836ca67bf1f55849" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41285 } } }
I20260811 17:08:45.738668 14553 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f3e8b8bb1aa4ab1836ca67bf1f55849 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:45.738651 14554 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f3e8b8bb1aa4ab1836ca67bf1f55849 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6f3e8b8bb1aa4ab1836ca67bf1f55849. Latest consensus state: current_term: 1 leader_uuid: "6f3e8b8bb1aa4ab1836ca67bf1f55849" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6f3e8b8bb1aa4ab1836ca67bf1f55849" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41285 } } }
I20260811 17:08:45.738732 14554 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f3e8b8bb1aa4ab1836ca67bf1f55849 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:45.739063 14566 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:08:45.742053 14566 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:08:45.748687 14566 catalog_manager.cc:1347] Generated new cluster ID: 19ba63551feb4c2aaf1bb6b189420632
I20260811 17:08:45.748790 14566 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:08:45.757332 14566 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:08:45.758312 14566 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:08:45.770934 14566 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6f3e8b8bb1aa4ab1836ca67bf1f55849: Generated new TSK 0
I20260811 17:08:45.771835 14566 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:08:45.793398 14548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:45.787644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59972 (local address 127.4.146.254:41285)
0811 17:08:45.787793 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:45.787798 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:45.788016 (+ 218us) server_negotiation.cc:407] Connection header received
0811 17:08:45.788220 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:45.788224 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:45.788284 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:45.788401 (+ 117us) server_negotiation.cc:226] Negotiated authn=JWT
0811 17:08:45.788638 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:45.789511 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:45.790466 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:45.790830 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:45.790936 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:45.791366 (+ 430us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 17:08:45.792986 (+ 1620us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33927/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 17:08:45.793247 (+ 261us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59972: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33927/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":57}
W20260811 17:08:45.793489 14548 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59972: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33927/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 17:08:45.795259 14594 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:08:45.787575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:41285 (local address 127.0.0.1:59972)
0811 17:08:45.787919 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:45.787932 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:45.788044 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:45.788409 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:45.788411 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:45.788418 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0811 17:08:45.788529 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:45.788534 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:45.789653 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:45.789656 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:45.790345 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:45.790353 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:45.791042 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:45.791047 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:45.791132 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:45.791160 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 17:08:45.793179 (+ 2019us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33927/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 17:08:45.795033 (+ 1854us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.4.146.254:41285: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33927/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":246,"mutex_wait_us":1577,"thread_start_us":158,"threads_started":1}
I20260811 17:08:45.795879 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 14425
E20260811 17:08:45.817324 14596 webserver.cc:533] Webserver: sslize failed:
E20260811 17:08:45.817425 14596 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T17:08:45Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (333 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T17:08:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:08:45Z Disabled control of system clock
I20260811 17:08:45.861699 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:41347
--webserver_interface=127.4.146.254
--webserver_port=0
--builtin_ntp_servers=127.4.146.212:44857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:41347
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786468091870818-4683-0/testchainca.cert with env {}
W20260811 17:08:45.982084 14602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:45.982416 14602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:45.982470 14602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:45.986631 14602 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:08:45.986711 14602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:45.986727 14602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:45.986745 14602 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:08:45.986761 14602 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 17:08:45.986778 14602 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 17:08:45.986790 14602 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 17:08:45.992668 14602 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:44857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:41347
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:41347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786468091870818-4683-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14602
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:45.993799 14602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:45.994822 14602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 17:08:46.004163 14602 server_base.cc:1034] running on GCE node
W20260811 17:08:46.004055 14615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:46.004060 14613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:46.004055 14612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:46.005054 14602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:46.006212 14602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:46.007418 14602 hybrid_clock.cc:648] HybridClock initialized: now 1786468126007381 us; error 49 us; skew 500 ppm
I20260811 17:08:46.009847 14602 webserver.cc:460] Webserver started at http://127.4.146.254:46673/ using document root <none> and password file <none>
I20260811 17:08:46.010501 14602 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:46.010624 14602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:46.010867 14602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:46.013113 14602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "f728f990867c4577989be676d420adf3"
format_stamp: "Formatted at 2026-08-11 17:08:46 on dist-test-slave-7vjv"
server_key: "354c32fb726dcbd51d75093f8fc46a11"
server_key_iv: "0a23ec155d8f123b7f9c256e4144e498"
server_key_version: "encryptionkey@0"
I20260811 17:08:46.013809 14602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "f728f990867c4577989be676d420adf3"
format_stamp: "Formatted at 2026-08-11 17:08:46 on dist-test-slave-7vjv"
server_key: "354c32fb726dcbd51d75093f8fc46a11"
server_key_iv: "0a23ec155d8f123b7f9c256e4144e498"
server_key_version: "encryptionkey@0"
I20260811 17:08:46.018020 14602 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260811 17:08:46.020891 14621 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:46.022416 14602 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:08:46.022635 14602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "f728f990867c4577989be676d420adf3"
format_stamp: "Formatted at 2026-08-11 17:08:46 on dist-test-slave-7vjv"
server_key: "354c32fb726dcbd51d75093f8fc46a11"
server_key_iv: "0a23ec155d8f123b7f9c256e4144e498"
server_key_version: "encryptionkey@0"
I20260811 17:08:46.022784 14602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:46.042794 14602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:46.043712 14602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:46.043983 14602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:46.053035 14602 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:41347
I20260811 17:08:46.053059 14719 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:41347 every 8 connection(s)
I20260811 17:08:46.054230 14602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:08:46.057948 14720 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:46.060029 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 14602
I20260811 17:08:46.060232 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:08:46.060536 4683 external_mini_cluster.cc:1428] Setting key 1f6618d15847e1ff375f2315a5ee403b
I20260811 17:08:46.065407 14720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f728f990867c4577989be676d420adf3: Bootstrap starting.
I20260811 17:08:46.067951 14720 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f728f990867c4577989be676d420adf3: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:46.068876 14720 log.cc:824] T 00000000000000000000000000000000 P f728f990867c4577989be676d420adf3: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:46.070461 14725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:46.062140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54744 (local address 127.4.146.254:41347)
0811 17:08:46.062861 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:46.062878 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:46.062918 (+ 40us) server_negotiation.cc:407] Connection header received
0811 17:08:46.063603 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:46.063656 (+ 53us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:46.064082 (+ 426us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:46.064522 (+ 440us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:46.064980 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:46.066008 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:46.066941 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:46.067417 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:46.067606 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:46.068618 (+ 1012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:46.068624 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:46.068637 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:08:46.069098 (+ 461us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:46.069163 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:08:46.069186 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:46.069297 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:46.069454 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 17:08:46.069729 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":155,"threads_started":1}
I20260811 17:08:46.071202 14720 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f728f990867c4577989be676d420adf3: No bootstrap required, opened a new log
I20260811 17:08:46.073769 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:08:46.076282 14720 raft_consensus.cc:348] T 00000000000000000000000000000000 P f728f990867c4577989be676d420adf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f728f990867c4577989be676d420adf3" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41347 } }
I20260811 17:08:46.076561 14720 raft_consensus.cc:374] T 00000000000000000000000000000000 P f728f990867c4577989be676d420adf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:46.076673 14720 raft_consensus.cc:729] T 00000000000000000000000000000000 P f728f990867c4577989be676d420adf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f728f990867c4577989be676d420adf3, State: Initialized, Role: FOLLOWER
I20260811 17:08:46.077144 14720 consensus_queue.cc:260] T 00000000000000000000000000000000 P f728f990867c4577989be676d420adf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f728f990867c4577989be676d420adf3" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41347 } }
I20260811 17:08:46.077308 14720 raft_consensus.cc:388] T 00000000000000000000000000000000 P f728f990867c4577989be676d420adf3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:08:46.077409 14720 raft_consensus.cc:482] T 00000000000000000000000000000000 P f728f990867c4577989be676d420adf3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:08:46.077525 14720 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f728f990867c4577989be676d420adf3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:46.078660 14720 raft_consensus.cc:504] T 00000000000000000000000000000000 P f728f990867c4577989be676d420adf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f728f990867c4577989be676d420adf3" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41347 } }
I20260811 17:08:46.079046 14720 leader_election.cc:302] T 00000000000000000000000000000000 P f728f990867c4577989be676d420adf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f728f990867c4577989be676d420adf3; no voters:
I20260811 17:08:46.079411 14720 leader_election.cc:288] T 00000000000000000000000000000000 P f728f990867c4577989be676d420adf3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:08:46.079537 14727 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f728f990867c4577989be676d420adf3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:46.079813 14727 raft_consensus.cc:686] T 00000000000000000000000000000000 P f728f990867c4577989be676d420adf3 [term 1 LEADER]: Becoming Leader. State: Replica: f728f990867c4577989be676d420adf3, State: Running, Role: LEADER
I20260811 17:08:46.080271 14727 consensus_queue.cc:237] T 00000000000000000000000000000000 P f728f990867c4577989be676d420adf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f728f990867c4577989be676d420adf3" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41347 } }
I20260811 17:08:46.080931 14720 sys_catalog.cc:564] T 00000000000000000000000000000000 P f728f990867c4577989be676d420adf3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:08:46.082121 14730 sys_catalog.cc:455] T 00000000000000000000000000000000 P f728f990867c4577989be676d420adf3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f728f990867c4577989be676d420adf3. Latest consensus state: current_term: 1 leader_uuid: "f728f990867c4577989be676d420adf3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f728f990867c4577989be676d420adf3" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41347 } } }
I20260811 17:08:46.082280 14730 sys_catalog.cc:458] T 00000000000000000000000000000000 P f728f990867c4577989be676d420adf3 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:46.082702 14743 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:08:46.082140 14728 sys_catalog.cc:455] T 00000000000000000000000000000000 P f728f990867c4577989be676d420adf3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f728f990867c4577989be676d420adf3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f728f990867c4577989be676d420adf3" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41347 } } }
I20260811 17:08:46.084174 14728 sys_catalog.cc:458] T 00000000000000000000000000000000 P f728f990867c4577989be676d420adf3 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:46.086264 14743 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:08:46.093024 14743 catalog_manager.cc:1347] Generated new cluster ID: 00d9b81777e14016b6e8e56a8aeff1f9
I20260811 17:08:46.093125 14743 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:08:46.107805 14743 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:08:46.109066 14743 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:08:46.115545 14743 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f728f990867c4577989be676d420adf3: Generated new TSK 0
I20260811 17:08:46.116449 14743 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:08:46.603880 14725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:46.125061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54752 (local address 127.4.146.254:41347)
0811 17:08:46.125233 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:46.125238 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:46.125377 (+ 139us) server_negotiation.cc:407] Connection header received
0811 17:08:46.125564 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:46.125567 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:46.125628 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:46.125728 (+ 100us) server_negotiation.cc:226] Negotiated authn=JWT
0811 17:08:46.126074 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:46.126777 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:46.128217 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:46.128454 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:46.128550 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:46.128924 (+ 374us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 17:08:46.603419 (+474495us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 17:08:46.603741 (+ 322us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54752: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":79}
W20260811 17:08:46.604024 14725 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54752: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 17:08:46.604276 14772 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:08:46.124898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:41347 (local address 127.0.0.1:54752)
0811 17:08:46.125268 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:46.125285 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:46.125419 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:46.125763 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:46.125766 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:46.125776 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0811 17:08:46.125907 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:46.125914 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:46.126906 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:46.126910 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:46.128065 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:46.128078 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:46.128589 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:46.128592 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:46.128695 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:46.128728 (+ 33us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 17:08:46.603735 (+475007us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 17:08:46.603928 (+ 193us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.4.146.254:41347: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":137,"threads_started":1}
I20260811 17:08:46.605021 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 14602
2026-08-11T17:08:46Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (790 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (138 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (135 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:08:46 dist-test-slave-7vjv krb5kdc[14792](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:08:46 dist-test-slave-7vjv krb5kdc[14792](info): set up 2 sockets
Aug 11 17:08:46 dist-test-slave-7vjv krb5kdc[14792](info): commencing operation
krb5kdc: starting...
W20260811 17:08:48.211449 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.296s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:08:48 dist-test-slave-7vjv krb5kdc[14792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:08:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:08:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:08:48.372713 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:42905
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:41699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:42905
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:48.494035 14812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:48.494350 14812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:48.494392 14812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:48.498700 14812 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:08:48.498791 14812 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:48.498811 14812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:48.498829 14812 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:08:48.498844 14812 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:08:48.505040 14812 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:41699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:42905
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:42905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14812
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:48.506294 14812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:48.507386 14812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:48.516381 14820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:48.516408 14824 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:48.516381 14826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:48.516738 14812 server_base.cc:1034] running on GCE node
I20260811 17:08:48.517362 14812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:48.518680 14812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:48.519901 14812 hybrid_clock.cc:648] HybridClock initialized: now 1786468128519884 us; error 28 us; skew 500 ppm
Aug 11 17:08:48 dist-test-slave-7vjv krb5kdc[14792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468128, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:48.523109 14812 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:08:48.524060 14812 webserver.cc:460] Webserver started at http://127.4.146.254:45393/ using document root <none> and password file <none>
I20260811 17:08:48.524678 14812 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:48.524775 14812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:48.525018 14812 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:48.527159 14812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "2722949319fd4c3db5ebef7eccadb1bb"
format_stamp: "Formatted at 2026-08-11 17:08:48 on dist-test-slave-7vjv"
server_key: "ebbed23c761cdb1483b2f003211be873"
server_key_iv: "cfe05ed17e37e308cafe6674eb4b86e9"
server_key_version: "encryptionkey@0"
I20260811 17:08:48.527774 14812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "2722949319fd4c3db5ebef7eccadb1bb"
format_stamp: "Formatted at 2026-08-11 17:08:48 on dist-test-slave-7vjv"
server_key: "ebbed23c761cdb1483b2f003211be873"
server_key_iv: "cfe05ed17e37e308cafe6674eb4b86e9"
server_key_version: "encryptionkey@0"
I20260811 17:08:48.531741 14812 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20260811 17:08:48.534451 14836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:48.535777 14812 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 17:08:48.535951 14812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "2722949319fd4c3db5ebef7eccadb1bb"
format_stamp: "Formatted at 2026-08-11 17:08:48 on dist-test-slave-7vjv"
server_key: "ebbed23c761cdb1483b2f003211be873"
server_key_iv: "cfe05ed17e37e308cafe6674eb4b86e9"
server_key_version: "encryptionkey@0"
I20260811 17:08:48.536145 14812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:48.556066 14812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:48.559450 14812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:48.559702 14812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:48.567441 14812 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:42905
I20260811 17:08:48.567474 14937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:42905 every 8 connection(s)
I20260811 17:08:48.568544 14812 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:08:48.571239 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 14812
I20260811 17:08:48.571389 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:08:48.571714 4683 external_mini_cluster.cc:1428] Setting key c194f8165c36f13ea998da290b31c259
I20260811 17:08:48.571717 14940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:48.578894 14940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2722949319fd4c3db5ebef7eccadb1bb: Bootstrap starting.
Aug 11 17:08:48 dist-test-slave-7vjv krb5kdc[14792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:48.581877 14940 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2722949319fd4c3db5ebef7eccadb1bb: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:48.582685 14940 log.cc:824] T 00000000000000000000000000000000 P 2722949319fd4c3db5ebef7eccadb1bb: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:48.585074 14940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2722949319fd4c3db5ebef7eccadb1bb: No bootstrap required, opened a new log
I20260811 17:08:48.587874 14944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:48.573413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51900 (local address 127.4.146.254:42905)
0811 17:08:48.573897 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:48.573913 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:48.573950 (+ 37us) server_negotiation.cc:407] Connection header received
0811 17:08:48.574807 (+ 857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:48.574827 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:48.575177 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:48.575542 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:48.576537 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:48.577569 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:48.578496 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:48.579064 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:48.579248 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:48.582404 (+ 3156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:48.582410 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:48.582426 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:48.582461 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:48.584525 (+ 2064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:48.585071 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:48.585077 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:48.585082 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:48.585253 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:48.585620 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:48.585624 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:48.585626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:48.586103 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:48.586349 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:48.586683 (+ 334us) server_negotiation.cc:299] Negotiation successful
0811 17:08:48.587041 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":144,"threads_started":1}
I20260811 17:08:48.589323 14940 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2722949319fd4c3db5ebef7eccadb1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2722949319fd4c3db5ebef7eccadb1bb" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42905 } }
I20260811 17:08:48.589596 14940 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2722949319fd4c3db5ebef7eccadb1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:48.589691 14940 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2722949319fd4c3db5ebef7eccadb1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2722949319fd4c3db5ebef7eccadb1bb, State: Initialized, Role: FOLLOWER
I20260811 17:08:48.590206 14940 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2722949319fd4c3db5ebef7eccadb1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2722949319fd4c3db5ebef7eccadb1bb" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42905 } }
I20260811 17:08:48.590377 14940 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2722949319fd4c3db5ebef7eccadb1bb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:08:48.590464 14940 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2722949319fd4c3db5ebef7eccadb1bb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:08:48.590559 14940 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2722949319fd4c3db5ebef7eccadb1bb [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:48.591573 14940 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2722949319fd4c3db5ebef7eccadb1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2722949319fd4c3db5ebef7eccadb1bb" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42905 } }
I20260811 17:08:48.591899 14940 leader_election.cc:302] T 00000000000000000000000000000000 P 2722949319fd4c3db5ebef7eccadb1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2722949319fd4c3db5ebef7eccadb1bb; no voters:
I20260811 17:08:48.592262 14940 leader_election.cc:288] T 00000000000000000000000000000000 P 2722949319fd4c3db5ebef7eccadb1bb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:08:48.592399 14947 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2722949319fd4c3db5ebef7eccadb1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:48.592684 14947 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2722949319fd4c3db5ebef7eccadb1bb [term 1 LEADER]: Becoming Leader. State: Replica: 2722949319fd4c3db5ebef7eccadb1bb, State: Running, Role: LEADER
I20260811 17:08:48.593087 14947 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2722949319fd4c3db5ebef7eccadb1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2722949319fd4c3db5ebef7eccadb1bb" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42905 } }
I20260811 17:08:48.593667 14940 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2722949319fd4c3db5ebef7eccadb1bb [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:08:48.594753 14949 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2722949319fd4c3db5ebef7eccadb1bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2722949319fd4c3db5ebef7eccadb1bb. Latest consensus state: current_term: 1 leader_uuid: "2722949319fd4c3db5ebef7eccadb1bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2722949319fd4c3db5ebef7eccadb1bb" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42905 } } }
I20260811 17:08:48.594889 14949 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2722949319fd4c3db5ebef7eccadb1bb [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:48.595068 14948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2722949319fd4c3db5ebef7eccadb1bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2722949319fd4c3db5ebef7eccadb1bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2722949319fd4c3db5ebef7eccadb1bb" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42905 } } }
I20260811 17:08:48.595271 14948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2722949319fd4c3db5ebef7eccadb1bb [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:48.595413 14959 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:08:48.598589 14959 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:08:48.606320 14959 catalog_manager.cc:1347] Generated new cluster ID: 2c962c7742034144b9bbe5f3cba41207
I20260811 17:08:48.606424 14959 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:08:48.622865 14959 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:08:48.623958 14959 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:08:48.631349 14959 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2722949319fd4c3db5ebef7eccadb1bb: Generated new TSK 0
I20260811 17:08:48.632329 14959 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
I20260811 17:08:48.672307 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:42905
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:41699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:48.792362 14979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:48.792666 14979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:48.792711 14979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:48.797137 14979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:48.797214 14979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:48.797303 14979 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:08:48.803004 14979 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:41699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:42905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14979
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:48.804239 14979 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:48.805361 14979 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:48.816764 14989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:48.816744 14990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:48.816744 14993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:48.816793 14979 server_base.cc:1034] running on GCE node
I20260811 17:08:48.817648 14979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:48.818446 14979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:48.819684 14979 hybrid_clock.cc:648] HybridClock initialized: now 1786468128819655 us; error 34 us; skew 500 ppm
Aug 11 17:08:48 dist-test-slave-7vjv krb5kdc[14792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468128, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:48.823055 14979 init.cc:377] Logged in from keytab as kudu/127.4.146.193@KRBTEST.COM (short username kudu)
I20260811 17:08:48.824209 14979 webserver.cc:460] Webserver started at http://127.4.146.193:40733/ using document root <none> and password file <none>
I20260811 17:08:48.824834 14979 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:48.824939 14979 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:48.825201 14979 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:48.827451 14979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "d546924af80f4cb69e1203bae352b4dd"
format_stamp: "Formatted at 2026-08-11 17:08:48 on dist-test-slave-7vjv"
server_key: "4af09c0d9be3037f9916b176ce6a5f84"
server_key_iv: "b744d8cf6bc271792414e105392100b6"
server_key_version: "encryptionkey@0"
I20260811 17:08:48.828233 14979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "d546924af80f4cb69e1203bae352b4dd"
format_stamp: "Formatted at 2026-08-11 17:08:48 on dist-test-slave-7vjv"
server_key: "4af09c0d9be3037f9916b176ce6a5f84"
server_key_iv: "b744d8cf6bc271792414e105392100b6"
server_key_version: "encryptionkey@0"
I20260811 17:08:48.832659 14979 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 17:08:48.835774 15005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:48.837410 14979 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:08:48.837561 14979 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "d546924af80f4cb69e1203bae352b4dd"
format_stamp: "Formatted at 2026-08-11 17:08:48 on dist-test-slave-7vjv"
server_key: "4af09c0d9be3037f9916b176ce6a5f84"
server_key_iv: "b744d8cf6bc271792414e105392100b6"
server_key_version: "encryptionkey@0"
I20260811 17:08:48.837673 14979 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:48.859544 14979 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:48.863310 14979 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:48.863535 14979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:48.864279 14979 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:48.865186 14979 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:48.865239 14979 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:48.865283 14979 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:48.865298 14979 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:48.875823 14979 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:45881
I20260811 17:08:48.875845 15217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:45881 every 8 connection(s)
I20260811 17:08:48.876827 14979 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:08:48.880748 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 14979
I20260811 17:08:48.880848 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
I20260811 17:08:48.881160 4683 external_mini_cluster.cc:1428] Setting key 60dab627b1c92955b33c9b5ce44075ae
Aug 11 17:08:48 dist-test-slave-7vjv krb5kdc[14792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468128, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.146.194@KRBTEST.COM; defaulting to no policy
I20260811 17:08:48.891819 14944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:48.878791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:58387 (local address 127.4.146.254:42905)
0811 17:08:48.878953 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:48.878958 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:48.879881 (+ 923us) server_negotiation.cc:407] Connection header received
0811 17:08:48.881442 (+ 1561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:48.881445 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:48.881507 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:48.881618 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:48.882848 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:48.883413 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:48.884718 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:48.884971 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:48.885053 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:48.888060 (+ 3007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:48.888063 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:48.888065 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:48.888162 (+ 97us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:48.889653 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:48.890199 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:48.890203 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:48.890205 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:48.890290 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:48.890655 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:48.890668 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:48.890670 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:48.890868 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:48.890981 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:48.891510 (+ 529us) server_negotiation.cc:299] Negotiation successful
0811 17:08:48.891651 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 17:08:48.892765 15222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:48.879231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:42905 (local address 127.4.146.193:58387)
0811 17:08:48.879711 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:48.879757 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:48.881172 (+ 1415us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:48.881809 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:48.881815 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:48.882193 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:48.882691 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:48.882705 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:48.883545 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:48.883556 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:48.884545 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:48.884560 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:48.885131 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:48.885137 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:48.885366 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:48.886049 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:48.886078 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:48.887864 (+ 1786us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:48.889792 (+ 1928us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:48.889798 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:48.889815 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:48.890090 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:48.890392 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:48.890395 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:48.890397 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:48.890548 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:48.890981 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:48.890989 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:48.891263 (+ 274us) client_negotiation.cc:769] Sending connection context
0811 17:08:48.891470 (+ 207us) client_negotiation.cc:240] Negotiation successful
0811 17:08:48.891830 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":116,"threads_started":1}
I20260811 17:08:48.894376 15218 heartbeater.cc:347] Connected to a master server at 127.4.146.254:42905
I20260811 17:08:48.894773 15218 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.194@KRBTEST.COM" created.
I20260811 17:08:48.895334 15218 heartbeater.cc:511] Master 127.4.146.254:42905 requested a full tablet report, sending...
I20260811 17:08:48.897239 14866 ts_manager.cc:194] Registered new tserver with Master: d546924af80f4cb69e1203bae352b4dd (127.4.146.193:45881)
I20260811 17:08:48.898478 14866 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.193@KRBTEST.COM'} at 127.4.146.193:58387
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
I20260811 17:08:48.913944 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:42905
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:41699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:49.035296 15225 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:49.035660 15225 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:49.035761 15225 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:49.040052 15225 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:49.040166 15225 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:49.040258 15225 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:08:49.046197 15225 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:41699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:42905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15225
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:49.047461 15225 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:49.048588 15225 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:49.058952 15234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:49.058952 15233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:49.058969 15238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:49.059340 15225 server_base.cc:1034] running on GCE node
I20260811 17:08:49.059924 15225 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:49.060946 15225 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:49.062153 15225 hybrid_clock.cc:648] HybridClock initialized: now 1786468129062134 us; error 32 us; skew 500 ppm
Aug 11 17:08:49 dist-test-slave-7vjv krb5kdc[14792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468129, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:49.065109 15225 init.cc:377] Logged in from keytab as kudu/127.4.146.194@KRBTEST.COM (short username kudu)
I20260811 17:08:49.066110 15225 webserver.cc:460] Webserver started at http://127.4.146.194:46843/ using document root <none> and password file <none>
I20260811 17:08:49.066732 15225 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:49.066831 15225 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:49.067088 15225 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:49.069312 15225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "215e280863fa4d50a2d71f1a9a098c78"
format_stamp: "Formatted at 2026-08-11 17:08:49 on dist-test-slave-7vjv"
server_key: "2f4c645823830ec8e5187aff99eaf33a"
server_key_iv: "382031e2ecbbab55d44b53e7d132dab6"
server_key_version: "encryptionkey@0"
I20260811 17:08:49.069900 15225 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "215e280863fa4d50a2d71f1a9a098c78"
format_stamp: "Formatted at 2026-08-11 17:08:49 on dist-test-slave-7vjv"
server_key: "2f4c645823830ec8e5187aff99eaf33a"
server_key_iv: "382031e2ecbbab55d44b53e7d132dab6"
server_key_version: "encryptionkey@0"
I20260811 17:08:49.074225 15225 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 17:08:49.076838 15251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:49.078073 15225 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260811 17:08:49.078236 15225 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "215e280863fa4d50a2d71f1a9a098c78"
format_stamp: "Formatted at 2026-08-11 17:08:49 on dist-test-slave-7vjv"
server_key: "2f4c645823830ec8e5187aff99eaf33a"
server_key_iv: "382031e2ecbbab55d44b53e7d132dab6"
server_key_version: "encryptionkey@0"
I20260811 17:08:49.078361 15225 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:49.101089 15225 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:49.104542 15225 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:49.104769 15225 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:49.105402 15225 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:49.106304 15225 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:49.106379 15225 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:49.106455 15225 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:49.106506 15225 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:49.116168 15225 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:43019
I20260811 17:08:49.116222 15461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:43019 every 8 connection(s)
I20260811 17:08:49.117158 15225 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:08:49.122934 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 15225
I20260811 17:08:49.123116 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:08:49.123401 4683 external_mini_cluster.cc:1428] Setting key 05664e7209a924e2cf3250d5b3c0d910
Aug 11 17:08:49 dist-test-slave-7vjv krb5kdc[14792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468129, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:49.133435 14944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:49.119232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:58055 (local address 127.4.146.254:42905)
0811 17:08:49.119417 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:49.119422 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:49.120361 (+ 939us) server_negotiation.cc:407] Connection header received
0811 17:08:49.121752 (+ 1391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:49.121755 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:49.121805 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:49.121885 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:49.123159 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:49.123836 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:49.125481 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:49.125729 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:49.125822 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:49.128856 (+ 3034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:49.128863 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:49.128869 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:49.128906 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:49.130841 (+ 1935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:49.131552 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:49.131566 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:49.131570 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:49.131683 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:49.132075 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:49.132082 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:49.132085 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:49.132407 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:49.132540 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:49.133070 (+ 530us) server_negotiation.cc:299] Negotiation successful
0811 17:08:49.133231 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 17:08:49.134361 15465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:49.119601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:42905 (local address 127.4.146.194:58055)
0811 17:08:49.120205 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:49.120252 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:49.121533 (+ 1281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:49.122083 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:49.122091 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:49.122466 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:49.122966 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:49.122979 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:49.124026 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:49.124030 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:49.125339 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:49.125355 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:49.125898 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:49.125905 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:49.126166 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:49.126861 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:49.126888 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:49.128656 (+ 1768us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:49.130976 (+ 2320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:49.130982 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:49.130998 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:49.131388 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:49.131800 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:49.131803 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:49.131804 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:49.131960 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:49.132519 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:49.132524 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:49.132793 (+ 269us) client_negotiation.cc:769] Sending connection context
0811 17:08:49.132957 (+ 164us) client_negotiation.cc:240] Negotiation successful
0811 17:08:49.133345 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":135,"threads_started":1}
WARNING: no policy specified for kudu/127.4.146.195@KRBTEST.COM; defaulting to no policy
I20260811 17:08:49.135757 15462 heartbeater.cc:347] Connected to a master server at 127.4.146.254:42905
I20260811 17:08:49.136051 15462 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:49.136770 15462 heartbeater.cc:511] Master 127.4.146.254:42905 requested a full tablet report, sending...
I20260811 17:08:49.138162 14866 ts_manager.cc:194] Registered new tserver with Master: 215e280863fa4d50a2d71f1a9a098c78 (127.4.146.194:43019)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.195@KRBTEST.COM" created.
I20260811 17:08:49.138988 14866 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.194@KRBTEST.COM'} at 127.4.146.194:58055
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
I20260811 17:08:49.159636 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:42905
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:41699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:49.277658 15472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:49.277978 15472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:49.278052 15472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:49.282250 15472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:49.282347 15472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:49.282441 15472 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:08:49.287911 15472 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:41699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:42905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:49.289184 15472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:49.290328 15472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:49.301023 15481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:49.301045 15493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:49.301107 15483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:49.301252 15472 server_base.cc:1034] running on GCE node
I20260811 17:08:49.302021 15472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:49.302762 15472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:49.304000 15472 hybrid_clock.cc:648] HybridClock initialized: now 1786468129303969 us; error 57 us; skew 500 ppm
Aug 11 17:08:49 dist-test-slave-7vjv krb5kdc[14792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468129, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:49.307248 15472 init.cc:377] Logged in from keytab as kudu/127.4.146.195@KRBTEST.COM (short username kudu)
I20260811 17:08:49.308362 15472 webserver.cc:460] Webserver started at http://127.4.146.195:37121/ using document root <none> and password file <none>
I20260811 17:08:49.308998 15472 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:49.309073 15472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:49.309320 15472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:49.311605 15472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "a70211f964ff44a1bae8c7f0c4ab24e8"
format_stamp: "Formatted at 2026-08-11 17:08:49 on dist-test-slave-7vjv"
server_key: "3b5d840e3744f466344320ef99741923"
server_key_iv: "ab17e4bdbf8c6b0a9084308c4c5126d0"
server_key_version: "encryptionkey@0"
I20260811 17:08:49.312311 15472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "a70211f964ff44a1bae8c7f0c4ab24e8"
format_stamp: "Formatted at 2026-08-11 17:08:49 on dist-test-slave-7vjv"
server_key: "3b5d840e3744f466344320ef99741923"
server_key_iv: "ab17e4bdbf8c6b0a9084308c4c5126d0"
server_key_version: "encryptionkey@0"
I20260811 17:08:49.316748 15472 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 17:08:49.319649 15504 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:49.321192 15472 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:08:49.321332 15472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "a70211f964ff44a1bae8c7f0c4ab24e8"
format_stamp: "Formatted at 2026-08-11 17:08:49 on dist-test-slave-7vjv"
server_key: "3b5d840e3744f466344320ef99741923"
server_key_iv: "ab17e4bdbf8c6b0a9084308c4c5126d0"
server_key_version: "encryptionkey@0"
I20260811 17:08:49.321473 15472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:49.332401 15472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:49.336058 15472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:49.336335 15472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:49.336995 15472 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:49.337898 15472 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:49.337949 15472 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:49.337990 15472 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:49.338042 15472 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:49.348073 15472 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:36669
I20260811 17:08:49.348163 15691 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:36669 every 8 connection(s)
I20260811 17:08:49.349133 15472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:08:49.357878 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 15472
I20260811 17:08:49.358032 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:08:49.358317 4683 external_mini_cluster.cc:1428] Setting key 1177ae241d6ede4c1e690ac5b35e3309
Aug 11 17:08:49 dist-test-slave-7vjv krb5kdc[14792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468129, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:08:49.364698 14944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:49.351396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:49369 (local address 127.4.146.254:42905)
0811 17:08:49.351612 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:49.351618 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:49.352560 (+ 942us) server_negotiation.cc:407] Connection header received
0811 17:08:49.353988 (+ 1428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:49.353991 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:49.354042 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:49.354154 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:49.355438 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:49.356022 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:49.357440 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:49.357796 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:49.357925 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:49.361124 (+ 3199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:49.361127 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:49.361129 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:49.361165 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:49.362439 (+ 1274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:49.363000 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:49.363004 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:49.363005 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:49.363099 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:49.363470 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:49.363473 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:49.363474 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:49.363692 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:49.363785 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:49.364412 (+ 627us) server_negotiation.cc:299] Negotiation successful
0811 17:08:49.364567 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 17:08:49.365644 15695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:49.351805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:42905 (local address 127.4.146.195:49369)
0811 17:08:49.352378 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:49.352429 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:49.353755 (+ 1326us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:49.354331 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:49.354338 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:49.354755 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:49.355267 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:49.355280 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:49.356285 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:49.356288 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:49.357205 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:49.357215 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:49.358024 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:49.358030 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:49.358247 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:49.358941 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:49.358964 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:49.360910 (+ 1946us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:49.362557 (+ 1647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:49.362563 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:49.362579 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:49.362881 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:49.363194 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:49.363197 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:49.363198 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:49.363344 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:49.363802 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:49.363809 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:49.364076 (+ 267us) client_negotiation.cc:769] Sending connection context
0811 17:08:49.364340 (+ 264us) client_negotiation.cc:240] Negotiation successful
0811 17:08:49.364641 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":138,"threads_started":1}
I20260811 17:08:49.366928 15692 heartbeater.cc:347] Connected to a master server at 127.4.146.254:42905
I20260811 17:08:49.367233 15692 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:49.367765 15692 heartbeater.cc:511] Master 127.4.146.254:42905 requested a full tablet report, sending...
I20260811 17:08:49.369012 14866 ts_manager.cc:194] Registered new tserver with Master: a70211f964ff44a1bae8c7f0c4ab24e8 (127.4.146.195:36669)
I20260811 17:08:49.369660 14866 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.195@KRBTEST.COM'} at 127.4.146.195:49369
I20260811 17:08:49.373124 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/test-admin.keytab.
Aug 11 17:08:49 dist-test-slave-7vjv krb5kdc[14792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:49.393745 4683 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 17:08:49.396817 15702 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:08:49.395299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42344 (local address 127.4.146.193:45881)
0811 17:08:49.395633 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:49.395640 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:49.395666 (+ 26us) server_negotiation.cc:407] Connection header received
0811 17:08:49.395751 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:49.395756 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:49.395951 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:49.396178 (+ 227us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:49.396646 (+ 468us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42344: BlockingRecv error: recv got EOF from 127.0.0.1:42344 (error 108)
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":112,"threads_started":1}
W20260811 17:08:49.396932 4683 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/krb5cc' of type FILE
Aug 11 17:08:49 dist-test-slave-7vjv krb5kdc[14792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:49.398075 4683 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 17:08:49 dist-test-slave-7vjv krb5kdc[14792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:49.399053 4683 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 17:08:49 dist-test-slave-7vjv krb5kdc[14792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.193@KRBTEST.COM
I20260811 17:08:49.410004 15702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:49.400088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42358 (local address 127.4.146.193:45881)
0811 17:08:49.400262 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:49.400267 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:49.400398 (+ 131us) server_negotiation.cc:407] Connection header received
0811 17:08:49.400585 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:49.400589 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:49.400642 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:49.400736 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:49.401349 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:49.402201 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:49.403149 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:49.403571 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:49.403700 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:49.406334 (+ 2634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:49.406346 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:49.406370 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:49.406396 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:49.408030 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:49.408547 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:49.408559 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:49.408560 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:49.408647 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:49.408958 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:49.408961 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:49.408963 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:49.409241 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:49.409507 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:49.409683 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 17:08:49.409860 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260811 17:08:49.414026 15702 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:08:49.413081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42360 (local address 127.4.146.193:45881)
0811 17:08:49.413224 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:49.413228 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:49.413261 (+ 33us) server_negotiation.cc:407] Connection header received
0811 17:08:49.413379 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:49.413381 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:49.413417 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:49.413480 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:49.413927 (+ 447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42360: BlockingRecv error: recv got EOF from 127.0.0.1:42360 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260811 17:08:49.414170 4683 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/krb5cc' of type FILE
Aug 11 17:08:49 dist-test-slave-7vjv krb5kdc[14792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:49.415315 4683 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 17:08:49 dist-test-slave-7vjv krb5kdc[14792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:49.416339 4683 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 17:08:49 dist-test-slave-7vjv krb5kdc[14792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.193@KRBTEST.COM
I20260811 17:08:49.425454 15702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:49.417341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42374 (local address 127.4.146.193:45881)
0811 17:08:49.417487 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:49.417492 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:49.417621 (+ 129us) server_negotiation.cc:407] Connection header received
0811 17:08:49.417761 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:49.417764 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:49.417806 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:49.417895 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:49.418415 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:49.418932 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:49.419763 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:49.420022 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:49.420152 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:49.422421 (+ 2269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:49.422425 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:49.422427 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:49.422461 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:49.423721 (+ 1260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:49.424187 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:49.424190 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:49.424192 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:49.424275 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:49.424549 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:49.424552 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:49.424554 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:49.424738 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:49.424909 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:49.425127 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 17:08:49.425241 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260811 17:08:49.428486 15702 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:08:49.427366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42380 (local address 127.4.146.193:45881)
0811 17:08:49.427494 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:49.427498 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:49.427608 (+ 110us) server_negotiation.cc:407] Connection header received
0811 17:08:49.427751 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:49.427754 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:49.427793 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:49.427884 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:49.428358 (+ 474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42380: BlockingRecv error: recv got EOF from 127.0.0.1:42380 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260811 17:08:49.428640 4683 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786468091870818-4683-0/krb5kdc/krb5cc' of type FILE
Aug 11 17:08:49 dist-test-slave-7vjv krb5kdc[14792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:49.429700 4683 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 17:08:49 dist-test-slave-7vjv krb5kdc[14792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:49.430565 4683 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 17:08:49 dist-test-slave-7vjv krb5kdc[14792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.193@KRBTEST.COM
I20260811 17:08:49.439613 15702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:49.431363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42396 (local address 127.4.146.193:45881)
0811 17:08:49.431484 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:49.431490 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:49.431633 (+ 143us) server_negotiation.cc:407] Connection header received
0811 17:08:49.431681 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:49.431684 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:49.431725 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:49.431795 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:49.432352 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:49.432865 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:49.433707 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:49.433945 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:49.434045 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:49.436480 (+ 2435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:49.436484 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:49.436486 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:49.436528 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:49.437987 (+ 1459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:49.438394 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:49.438397 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:49.438398 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:49.438483 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:49.438750 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:49.438752 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:49.438754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:49.438921 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:49.439068 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:49.439283 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 17:08:49.439398 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 17:08:49.440841 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 14979
I20260811 17:08:49.474915 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 15225
I20260811 17:08:49.486078 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 15472
I20260811 17:08:49.495440 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 14812
2026-08-11T17:08:49Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2619 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:08:49 dist-test-slave-7vjv krb5kdc[15729](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:08:49 dist-test-slave-7vjv krb5kdc[15729](info): set up 2 sockets
Aug 11 17:08:49 dist-test-slave-7vjv krb5kdc[15729](info): commencing operation
krb5kdc: starting...
W20260811 17:08:50.847117 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.312s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:08:50 dist-test-slave-7vjv krb5kdc[15729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468130, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:08:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:08:50Z Disabled control of system clock
WARNING: no policy specified for oryx/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.254.keytab.
Entry for principal oryx/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.254.keytab.
I20260811 17:08:50.991636 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:33377
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.254.keytab
--principal=oryx/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:38843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:33377
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:51.117252 15747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:51.117622 15747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:51.117719 15747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:51.122416 15747 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:08:51.122545 15747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:51.122589 15747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:51.122656 15747 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:08:51.122699 15747 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:08:51.129123 15747 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:38843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:33377
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.254.keytab
--principal=oryx/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:33377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15747
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:51.130421 15747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:51.131644 15747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:51.142592 15753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:51.142645 15765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:51.142645 15755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:51.143060 15747 server_base.cc:1034] running on GCE node
I20260811 17:08:51.143748 15747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:51.145110 15747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:51.146323 15747 hybrid_clock.cc:648] HybridClock initialized: now 1786468131146303 us; error 39 us; skew 500 ppm
Aug 11 17:08:51 dist-test-slave-7vjv krb5kdc[15729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468131, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:51.153898 15747 init.cc:377] Logged in from keytab as oryx/127.4.146.254@KRBTEST.COM (short username oryx)
I20260811 17:08:51.155057 15747 webserver.cc:460] Webserver started at http://127.4.146.254:46253/ using document root <none> and password file <none>
I20260811 17:08:51.155709 15747 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:51.155814 15747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:51.156075 15747 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:51.158504 15747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "4f5901df9ec846ffb312adf8fe316c86"
format_stamp: "Formatted at 2026-08-11 17:08:51 on dist-test-slave-7vjv"
server_key: "9c5d8d8e540e344613f9f48282c5733d"
server_key_iv: "4e47a352e38220afcd4c632f6c6ed6dc"
server_key_version: "encryptionkey@0"
I20260811 17:08:51.159231 15747 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "4f5901df9ec846ffb312adf8fe316c86"
format_stamp: "Formatted at 2026-08-11 17:08:51 on dist-test-slave-7vjv"
server_key: "9c5d8d8e540e344613f9f48282c5733d"
server_key_iv: "4e47a352e38220afcd4c632f6c6ed6dc"
server_key_version: "encryptionkey@0"
I20260811 17:08:51.163565 15747 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 17:08:51.166394 15779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:51.167902 15747 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 17:08:51.168195 15747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "4f5901df9ec846ffb312adf8fe316c86"
format_stamp: "Formatted at 2026-08-11 17:08:51 on dist-test-slave-7vjv"
server_key: "9c5d8d8e540e344613f9f48282c5733d"
server_key_iv: "4e47a352e38220afcd4c632f6c6ed6dc"
server_key_version: "encryptionkey@0"
I20260811 17:08:51.168359 15747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:51.181202 15747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:51.184953 15747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:51.185290 15747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:51.193749 15747 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:33377
I20260811 17:08:51.194123 15863 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:33377 every 8 connection(s)
I20260811 17:08:51.194900 15747 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:08:51.198072 15866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:51.200392 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 15747
I20260811 17:08:51.200603 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:08:51.200915 4683 external_mini_cluster.cc:1428] Setting key b677a7a47e241e6c39d3dea8a8ef5917
I20260811 17:08:51.205654 15866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86: Bootstrap starting.
I20260811 17:08:51.208446 15866 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:51.209415 15866 log.cc:824] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86: Log is configured to *not* fsync() on all Append() calls
Aug 11 17:08:51 dist-test-slave-7vjv krb5kdc[15729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468130, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM
I20260811 17:08:51.211812 15866 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86: No bootstrap required, opened a new log
I20260811 17:08:51.215502 15866 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } }
I20260811 17:08:51.215791 15866 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:51.215871 15866 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f5901df9ec846ffb312adf8fe316c86, State: Initialized, Role: FOLLOWER
I20260811 17:08:51.216406 15866 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } }
I20260811 17:08:51.216591 15866 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:08:51.216682 15866 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:08:51.216815 15866 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:51.217092 15876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:51.203201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57592 (local address 127.4.146.254:33377)
0811 17:08:51.203702 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:51.203720 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:51.203758 (+ 38us) server_negotiation.cc:407] Connection header received
0811 17:08:51.204494 (+ 736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:51.204513 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:51.204875 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:51.205170 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:51.206164 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:51.207144 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:51.208313 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:51.208850 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:51.208972 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:51.211953 (+ 2981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:51.211958 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:51.211972 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:51.211999 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:51.213880 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:51.214365 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:51.214370 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:51.214375 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:51.214494 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:51.214798 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:51.214802 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:51.214804 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:51.215234 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:51.215478 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:51.215723 (+ 245us) server_negotiation.cc:299] Negotiation successful
0811 17:08:51.216044 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":168,"threads_started":1}
I20260811 17:08:51.218036 15866 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } }
I20260811 17:08:51.218447 15866 leader_election.cc:302] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f5901df9ec846ffb312adf8fe316c86; no voters:
I20260811 17:08:51.218859 15866 leader_election.cc:288] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:08:51.218950 15880 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:51.219213 15880 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [term 1 LEADER]: Becoming Leader. State: Replica: 4f5901df9ec846ffb312adf8fe316c86, State: Running, Role: LEADER
I20260811 17:08:51.219597 15880 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } }
I20260811 17:08:51.220337 15866 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:08:51.221005 15883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f5901df9ec846ffb312adf8fe316c86. Latest consensus state: current_term: 1 leader_uuid: "4f5901df9ec846ffb312adf8fe316c86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } }
I20260811 17:08:51.221192 15883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:51.221539 15881 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f5901df9ec846ffb312adf8fe316c86" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } }
I20260811 17:08:51.221648 15881 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:51.221925 15889 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:08:51.225507 15889 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:08:51.232028 15889 catalog_manager.cc:1347] Generated new cluster ID: 0b854d920aeb454e8a583d46de21771c
I20260811 17:08:51.232164 15889 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:08:51.252805 15889 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:08:51.254379 15889 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:08:51.272977 15889 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86: Generated new TSK 0
I20260811 17:08:51.273980 15889 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.4.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.193.keytab.
Entry for principal oryx/127.4.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.193.keytab.
I20260811 17:08:51.321311 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:33377
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.193.keytab
--principal=oryx/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:38843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:51.450331 15909 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:51.450640 15909 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:51.450685 15909 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:51.455221 15909 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:51.455296 15909 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:51.455389 15909 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:08:51.461114 15909 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:38843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.193.keytab
--principal=oryx/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:33377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15909
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:51.462293 15909 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:51.463371 15909 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:51.473659 15921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:51.473737 15914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:51.473771 15909 server_base.cc:1034] running on GCE node
W20260811 17:08:51.473659 15916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:51.474364 15909 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:51.475075 15909 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:51.476258 15909 hybrid_clock.cc:648] HybridClock initialized: now 1786468131476244 us; error 25 us; skew 500 ppm
Aug 11 17:08:51 dist-test-slave-7vjv krb5kdc[15729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468131, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:51.479162 15909 init.cc:377] Logged in from keytab as oryx/127.4.146.193@KRBTEST.COM (short username oryx)
I20260811 17:08:51.480182 15909 webserver.cc:460] Webserver started at http://127.4.146.193:42649/ using document root <none> and password file <none>
I20260811 17:08:51.480787 15909 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:51.480888 15909 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:51.481146 15909 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:51.483369 15909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "d2b5f5df53eb4066bb755b3b8b565a35"
format_stamp: "Formatted at 2026-08-11 17:08:51 on dist-test-slave-7vjv"
server_key: "d7192cbd805dcae832d44e895d5a3e60"
server_key_iv: "8b54ebc7dc3ef5369e5295294a5e5b87"
server_key_version: "encryptionkey@0"
I20260811 17:08:51.483992 15909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "d2b5f5df53eb4066bb755b3b8b565a35"
format_stamp: "Formatted at 2026-08-11 17:08:51 on dist-test-slave-7vjv"
server_key: "d7192cbd805dcae832d44e895d5a3e60"
server_key_iv: "8b54ebc7dc3ef5369e5295294a5e5b87"
server_key_version: "encryptionkey@0"
I20260811 17:08:51.488077 15909 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 17:08:51.490821 15930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:51.492192 15909 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 17:08:51.492341 15909 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "d2b5f5df53eb4066bb755b3b8b565a35"
format_stamp: "Formatted at 2026-08-11 17:08:51 on dist-test-slave-7vjv"
server_key: "d7192cbd805dcae832d44e895d5a3e60"
server_key_iv: "8b54ebc7dc3ef5369e5295294a5e5b87"
server_key_version: "encryptionkey@0"
I20260811 17:08:51.492465 15909 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:51.502380 15909 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:51.505515 15909 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:51.505745 15909 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:51.506378 15909 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:51.507288 15909 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:51.507364 15909 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:51.507439 15909 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:51.507484 15909 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:51.517228 15909 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:40803
I20260811 17:08:51.517282 16148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:40803 every 8 connection(s)
I20260811 17:08:51.518265 15909 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:08:51.523728 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 15909
I20260811 17:08:51.523842 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
I20260811 17:08:51.524212 4683 external_mini_cluster.cc:1428] Setting key fd330697aa77e0c218fe64a37770144a
Aug 11 17:08:51 dist-test-slave-7vjv krb5kdc[15729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468131, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM
WARNING: no policy specified for oryx/127.4.146.194@KRBTEST.COM; defaulting to no policy
I20260811 17:08:51.534778 15876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:51.520333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:46299 (local address 127.4.146.254:33377)
0811 17:08:51.520567 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:51.520571 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:51.521534 (+ 963us) server_negotiation.cc:407] Connection header received
0811 17:08:51.523147 (+ 1613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:51.523150 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:51.523199 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:51.523267 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:51.524973 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:51.525589 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:51.526930 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:51.527339 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:51.527467 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:51.530410 (+ 2943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:51.530416 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:51.530424 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:51.530452 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:51.532215 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:51.532849 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:51.532855 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:51.532857 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:51.532951 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:51.533367 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:51.533370 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:51.533373 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:51.533604 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:51.533728 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:51.534405 (+ 677us) server_negotiation.cc:299] Negotiation successful
0811 17:08:51.534577 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260811 17:08:51.535778 16151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:51.520763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.193:46299)
0811 17:08:51.521353 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:51.521405 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:51.522889 (+ 1484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:51.523472 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:51.523479 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:51.524031 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:51.524820 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:51.524852 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:51.525744 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:51.525748 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:51.526794 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:51.526806 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:51.527513 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:51.527516 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:51.527677 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:51.528502 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:51.528522 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:51.530208 (+ 1686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:51.532369 (+ 2161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:51.532377 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:51.532397 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:51.532716 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:51.533063 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:51.533067 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:51.533069 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:51.533245 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:51.533730 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:51.533740 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:51.534117 (+ 377us) client_negotiation.cc:769] Sending connection context
0811 17:08:51.534339 (+ 222us) client_negotiation.cc:240] Negotiation successful
0811 17:08:51.534738 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":120,"threads_started":1}
I20260811 17:08:51.537380 16149 heartbeater.cc:347] Connected to a master server at 127.4.146.254:33377
I20260811 17:08:51.537698 16149 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.146.194@KRBTEST.COM" created.
I20260811 17:08:51.538378 16149 heartbeater.cc:511] Master 127.4.146.254:33377 requested a full tablet report, sending...
I20260811 17:08:51.540174 15802 ts_manager.cc:194] Registered new tserver with Master: d2b5f5df53eb4066bb755b3b8b565a35 (127.4.146.193:40803)
I20260811 17:08:51.541540 15802 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.146.193@KRBTEST.COM'} at 127.4.146.193:46299
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.194.keytab.
Entry for principal oryx/127.4.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.194.keytab.
I20260811 17:08:51.555959 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:33377
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.194.keytab
--principal=oryx/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:38843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:51.674996 16155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:51.675282 16155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:51.675328 16155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:51.679538 16155 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:51.679620 16155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:51.679701 16155 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:08:51.685111 16155 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:38843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.194.keytab
--principal=oryx/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:33377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16155
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:51.686206 16155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:51.687222 16155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:51.698024 16175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:51.698004 16163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:51.698091 16155 server_base.cc:1034] running on GCE node
W20260811 17:08:51.698041 16165 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:51.698688 16155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:51.699397 16155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:51.700593 16155 hybrid_clock.cc:648] HybridClock initialized: now 1786468131700558 us; error 56 us; skew 500 ppm
Aug 11 17:08:51 dist-test-slave-7vjv krb5kdc[15729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468131, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:51.703560 16155 init.cc:377] Logged in from keytab as oryx/127.4.146.194@KRBTEST.COM (short username oryx)
I20260811 17:08:51.704581 16155 webserver.cc:460] Webserver started at http://127.4.146.194:43865/ using document root <none> and password file <none>
I20260811 17:08:51.705188 16155 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:51.705286 16155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:51.705534 16155 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:51.707695 16155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "49d7274ea3144adea1f4e9e5e05b7b5d"
format_stamp: "Formatted at 2026-08-11 17:08:51 on dist-test-slave-7vjv"
server_key: "f527ca0de720e81fb0a2fd7c7c056f1e"
server_key_iv: "981c24c1700b55d0a3233e0e6a9e3f2c"
server_key_version: "encryptionkey@0"
I20260811 17:08:51.708352 16155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "49d7274ea3144adea1f4e9e5e05b7b5d"
format_stamp: "Formatted at 2026-08-11 17:08:51 on dist-test-slave-7vjv"
server_key: "f527ca0de720e81fb0a2fd7c7c056f1e"
server_key_iv: "981c24c1700b55d0a3233e0e6a9e3f2c"
server_key_version: "encryptionkey@0"
I20260811 17:08:51.712325 16155 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 17:08:51.715377 16189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:51.716965 16155 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:08:51.717111 16155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "49d7274ea3144adea1f4e9e5e05b7b5d"
format_stamp: "Formatted at 2026-08-11 17:08:51 on dist-test-slave-7vjv"
server_key: "f527ca0de720e81fb0a2fd7c7c056f1e"
server_key_iv: "981c24c1700b55d0a3233e0e6a9e3f2c"
server_key_version: "encryptionkey@0"
I20260811 17:08:51.717242 16155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:51.730242 16155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:51.733582 16155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:51.733836 16155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:51.734529 16155 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:51.735466 16155 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:51.735546 16155 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:51.735622 16155 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:51.735674 16155 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:51.744864 16155 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:33863
I20260811 17:08:51.744936 16382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:33863 every 8 connection(s)
I20260811 17:08:51.745900 16155 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:08:51.754385 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 16155
I20260811 17:08:51.754522 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:08:51.754891 4683 external_mini_cluster.cc:1428] Setting key df0de027cd0ac2359a88d756562f4534
Aug 11 17:08:51 dist-test-slave-7vjv krb5kdc[15729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468131, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM
I20260811 17:08:51.760641 15876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:51.747901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:56113 (local address 127.4.146.254:33377)
0811 17:08:51.748038 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:51.748042 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:51.748984 (+ 942us) server_negotiation.cc:407] Connection header received
0811 17:08:51.750356 (+ 1372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:51.750360 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:51.750417 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:51.750526 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:51.751751 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:51.752368 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:51.753536 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:51.753767 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:51.753875 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:51.756762 (+ 2887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:51.756765 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:51.756767 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:51.756790 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:51.758221 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:51.758870 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:51.758873 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:51.758874 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:51.758959 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:51.759382 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:51.759385 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:51.759387 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:51.759580 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:51.759664 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:51.760393 (+ 729us) server_negotiation.cc:299] Negotiation successful
0811 17:08:51.760512 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 17:08:51.761935 16389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:51.748364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.194:56113)
0811 17:08:51.748826 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:51.748870 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:51.750129 (+ 1259us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:51.750717 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:51.750724 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:51.751098 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:51.751595 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:51.751608 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:51.752509 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:51.752512 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:51.753396 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:51.753406 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:51.753932 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:51.753936 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:51.754108 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:51.754811 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:51.754830 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:51.756580 (+ 1750us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:51.758354 (+ 1774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:51.758360 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:51.758376 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:51.758722 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:51.759055 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:51.759060 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:51.759063 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:51.759272 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:51.759700 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:51.759709 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:51.760081 (+ 372us) client_negotiation.cc:769] Sending connection context
0811 17:08:51.760354 (+ 273us) client_negotiation.cc:240] Negotiation successful
0811 17:08:51.760763 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":102,"threads_started":1}
I20260811 17:08:51.763554 16386 heartbeater.cc:347] Connected to a master server at 127.4.146.254:33377
I20260811 17:08:51.763885 16386 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:51.764635 16386 heartbeater.cc:511] Master 127.4.146.254:33377 requested a full tablet report, sending...
I20260811 17:08:51.765992 15802 ts_manager.cc:194] Registered new tserver with Master: 49d7274ea3144adea1f4e9e5e05b7b5d (127.4.146.194:33863)
I20260811 17:08:51.766913 15802 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.146.194@KRBTEST.COM'} at 127.4.146.194:56113
WARNING: no policy specified for oryx/127.4.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.195.keytab.
Entry for principal oryx/127.4.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.195.keytab.
I20260811 17:08:51.788779 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:33377
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.195.keytab
--principal=oryx/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:38843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:51.904898 16393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:51.905171 16393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:51.905264 16393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:51.909305 16393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:51.909375 16393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:51.909477 16393 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:08:51.914860 16393 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:38843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.195.keytab
--principal=oryx/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:33377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16393
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:51.915972 16393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:51.917065 16393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:51.927497 16409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:51.927575 16404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:51.927600 16406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:51.927947 16393 server_base.cc:1034] running on GCE node
I20260811 17:08:51.928440 16393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:51.929091 16393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:51.930280 16393 hybrid_clock.cc:648] HybridClock initialized: now 1786468131930248 us; error 46 us; skew 500 ppm
Aug 11 17:08:51 dist-test-slave-7vjv krb5kdc[15729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468131, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:51.933208 16393 init.cc:377] Logged in from keytab as oryx/127.4.146.195@KRBTEST.COM (short username oryx)
I20260811 17:08:51.934110 16393 webserver.cc:460] Webserver started at http://127.4.146.195:37611/ using document root <none> and password file <none>
I20260811 17:08:51.934702 16393 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:51.934796 16393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:51.935051 16393 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:51.937561 16393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d"
format_stamp: "Formatted at 2026-08-11 17:08:51 on dist-test-slave-7vjv"
server_key: "a4460d721d13b8308c5a08407e7ee24b"
server_key_iv: "a5724671e1219e15b02f66c1aba10308"
server_key_version: "encryptionkey@0"
I20260811 17:08:51.938215 16393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d"
format_stamp: "Formatted at 2026-08-11 17:08:51 on dist-test-slave-7vjv"
server_key: "a4460d721d13b8308c5a08407e7ee24b"
server_key_iv: "a5724671e1219e15b02f66c1aba10308"
server_key_version: "encryptionkey@0"
I20260811 17:08:51.942049 16393 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 17:08:51.944497 16422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:51.945816 16393 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 17:08:51.945932 16393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d"
format_stamp: "Formatted at 2026-08-11 17:08:51 on dist-test-slave-7vjv"
server_key: "a4460d721d13b8308c5a08407e7ee24b"
server_key_iv: "a5724671e1219e15b02f66c1aba10308"
server_key_version: "encryptionkey@0"
I20260811 17:08:51.946064 16393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:51.959612 16393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:51.962808 16393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:51.963028 16393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:51.963680 16393 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:51.964619 16393 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:51.964668 16393 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:51.964733 16393 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:51.964767 16393 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:51.974197 16393 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:38683
I20260811 17:08:51.974217 16613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:38683 every 8 connection(s)
I20260811 17:08:51.975221 16393 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:08:51.976713 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 16393
I20260811 17:08:51.976845 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:08:51.977169 4683 external_mini_cluster.cc:1428] Setting key 8e6c27583739921aa670226a5454c861
Aug 11 17:08:51 dist-test-slave-7vjv krb5kdc[15729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468131, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM
I20260811 17:08:51.991202 15876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:51.977512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:56553 (local address 127.4.146.254:33377)
0811 17:08:51.977678 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:51.977682 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:51.978810 (+ 1128us) server_negotiation.cc:407] Connection header received
0811 17:08:51.980392 (+ 1582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:51.980394 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:51.980444 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:51.980517 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:51.981730 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:51.982327 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:51.983573 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:51.983831 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:51.983933 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:51.986964 (+ 3031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:51.986967 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:51.986970 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:51.986998 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:51.988572 (+ 1574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:51.989160 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:51.989163 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:51.989164 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:51.989264 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:51.989741 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:51.989744 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:51.989745 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:51.989983 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:51.990075 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:51.990853 (+ 778us) server_negotiation.cc:299] Negotiation successful
0811 17:08:51.991039 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 17:08:51.992338 16621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:51.978029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.195:56553)
0811 17:08:51.978645 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:51.978714 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:51.980183 (+ 1469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:51.980663 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:51.980670 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:51.981053 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:51.981568 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:51.981583 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:51.982460 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:51.982463 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:51.983416 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:51.983425 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:51.984027 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:51.984031 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:51.984300 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:51.984930 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:51.984948 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:51.986753 (+ 1805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:51.988702 (+ 1949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:51.988708 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:51.988724 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:51.989024 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:51.989416 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:51.989419 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:51.989421 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:51.989620 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:51.990135 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:51.990148 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:51.990519 (+ 371us) client_negotiation.cc:769] Sending connection context
0811 17:08:51.990779 (+ 260us) client_negotiation.cc:240] Negotiation successful
0811 17:08:51.991256 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":194,"threads_started":1}
I20260811 17:08:51.993569 16615 heartbeater.cc:347] Connected to a master server at 127.4.146.254:33377
I20260811 17:08:51.993861 16615 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:51.994499 16615 heartbeater.cc:511] Master 127.4.146.254:33377 requested a full tablet report, sending...
I20260811 17:08:51.995803 15802 ts_manager.cc:194] Registered new tserver with Master: 2ed2b3fcda594ac59a3c9a7f15f70a5d (127.4.146.195:38683)
I20260811 17:08:51.996483 15802 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.146.195@KRBTEST.COM'} at 127.4.146.195:56553
I20260811 17:08:52.004248 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.4.146.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.146.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.146.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.253.keytab.
Entry for principal oryx/127.4.146.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.253.keytab.
I20260811 17:08:52.037609 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.253:38667
--webserver_interface=127.4.146.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.253.keytab
--principal=oryx/127.4.146.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:38843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:33377,127.4.146.253:38667
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:52.157125 16624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:52.157424 16624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:52.157497 16624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:52.161832 16624 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:08:52.161913 16624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:52.161933 16624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:52.161950 16624 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:08:52.161966 16624 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:08:52.167532 16624 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:38843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:33377,127.4.146.253:38667
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.253.keytab
--principal=oryx/127.4.146.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.253:38667
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.4.146.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16624
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
W20260811 17:08:52.167815 16624 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.4.146.254:33377,127.4.146.253:38667'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 17:08:52.168912 16624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:52.170022 16624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:52.179883 16639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:52.179811 16634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:52.179811 16635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:52.180007 16624 server_base.cc:1034] running on GCE node
I20260811 17:08:52.180816 16624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:52.182040 16624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:52.183247 16624 hybrid_clock.cc:648] HybridClock initialized: now 1786468132183232 us; error 27 us; skew 500 ppm
Aug 11 17:08:52 dist-test-slave-7vjv krb5kdc[15729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468132, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:52.186290 16624 init.cc:377] Logged in from keytab as oryx/127.4.146.253@KRBTEST.COM (short username oryx)
I20260811 17:08:52.187253 16624 webserver.cc:460] Webserver started at http://127.4.146.253:40759/ using document root <none> and password file <none>
I20260811 17:08:52.187848 16624 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:52.187945 16624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:52.188288 16624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:52.190533 16624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/data/instance:
uuid: "70769ce76ba048bcabf0a1333d2f2f38"
format_stamp: "Formatted at 2026-08-11 17:08:52 on dist-test-slave-7vjv"
server_key: "057b9bd8837f9082a8e18444b585b5e5"
server_key_iv: "59f14f0dacb837ef36a762bf10245338"
server_key_version: "encryptionkey@0"
I20260811 17:08:52.191154 16624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/wal/instance:
uuid: "70769ce76ba048bcabf0a1333d2f2f38"
format_stamp: "Formatted at 2026-08-11 17:08:52 on dist-test-slave-7vjv"
server_key: "057b9bd8837f9082a8e18444b585b5e5"
server_key_iv: "59f14f0dacb837ef36a762bf10245338"
server_key_version: "encryptionkey@0"
I20260811 17:08:52.195300 16624 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 17:08:52.198135 16651 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:52.199503 16624 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260811 17:08:52.199662 16624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/wal
uuid: "70769ce76ba048bcabf0a1333d2f2f38"
format_stamp: "Formatted at 2026-08-11 17:08:52 on dist-test-slave-7vjv"
server_key: "057b9bd8837f9082a8e18444b585b5e5"
server_key_iv: "59f14f0dacb837ef36a762bf10245338"
server_key_version: "encryptionkey@0"
I20260811 17:08:52.199803 16624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:52.212184 16624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:52.216271 16624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:52.216511 16624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:52.225410 16624 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.253:38667
I20260811 17:08:52.225725 16750 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.253:38667 every 8 connection(s)
I20260811 17:08:52.226742 16624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/data/info.pb
I20260811 17:08:52.230052 16752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:52.234426 16752 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } has no permanent_uuid. Determining permanent_uuid...
I20260811 17:08:52.236025 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 16624
Aug 11 17:08:52 dist-test-slave-7vjv krb5kdc[15729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468132, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.253@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM
Aug 11 17:08:52 dist-test-slave-7vjv krb5kdc[15729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468130, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.146.253@KRBTEST.COM
I20260811 17:08:52.250072 15876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.236691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57604 (local address 127.4.146.254:33377)
0811 17:08:52.236868 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:52.236873 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:52.237944 (+ 1071us) server_negotiation.cc:407] Connection header received
0811 17:08:52.239117 (+ 1173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:52.239120 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:52.239174 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:52.239251 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:52.240333 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.240882 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.242022 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.242272 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.242352 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.245546 (+ 3194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:52.245553 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:52.245559 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:52.245601 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:52.247461 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.248216 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.248219 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.248220 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.248297 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.248697 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.248703 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.248708 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.249023 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:52.249135 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:52.249763 (+ 628us) server_negotiation.cc:299] Negotiation successful
0811 17:08:52.249897 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 17:08:52.251278 16757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.238054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58438 (local address 127.4.146.253:38667)
0811 17:08:52.238343 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:52.238359 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:52.238401 (+ 42us) server_negotiation.cc:407] Connection header received
0811 17:08:52.238868 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:52.238894 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:52.239145 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:52.239353 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:52.240184 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.241211 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.242130 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.242682 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.242808 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.246019 (+ 3211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:52.246028 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:52.246046 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:52.246076 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:52.248301 (+ 2225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.248762 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.248767 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.248768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.248844 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.249140 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.249166 (+ 26us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.249168 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.249555 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:52.249846 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:52.250000 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 17:08:52.250141 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":192,"spinlock_wait_cycles":12544,"thread_start_us":87,"threads_started":1}
I20260811 17:08:52.251278 16756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.237206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.0.0.1:57604)
0811 17:08:52.237783 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:52.237830 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:52.238868 (+ 1038us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:52.239329 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:52.239334 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:52.239820 (+ 486us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:52.240162 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.240183 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.241022 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.241026 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.241891 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.241900 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.242465 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.242470 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.242656 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.243457 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:52.243485 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:52.245309 (+ 1824us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:52.247593 (+ 2284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.247604 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.247616 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.248018 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.248403 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.248408 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.248412 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.248577 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.249150 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:52.249157 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:52.249502 (+ 345us) client_negotiation.cc:769] Sending connection context
0811 17:08:52.249685 (+ 183us) client_negotiation.cc:240] Negotiation successful
0811 17:08:52.250060 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":123,"threads_started":1}
I20260811 17:08:52.253603 16752 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 17:08:52 dist-test-slave-7vjv krb5kdc[15729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468132, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.253@KRBTEST.COM for oryx/127.4.146.253@KRBTEST.COM
I20260811 17:08:52.262184 16756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.254232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:38667 (local address 127.0.0.1:58444)
0811 17:08:52.254354 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:52.254367 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:52.254432 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:52.254680 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:52.254682 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:52.254822 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:52.254913 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.254917 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.255699 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.255701 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.256400 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.256409 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.256849 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.256851 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.256928 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.257379 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:52.257390 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:52.258696 (+ 1306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:52.260760 (+ 2064us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.260763 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.260765 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.260951 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.261217 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.261219 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.261220 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.261362 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.261781 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:52.261784 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:52.261866 (+ 82us) client_negotiation.cc:769] Sending connection context
0811 17:08:52.261951 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 17:08:52.262053 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 17:08:52.262334 16757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.254363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58444 (local address 127.4.146.253:38667)
0811 17:08:52.254495 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:52.254498 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:52.254513 (+ 15us) server_negotiation.cc:407] Connection header received
0811 17:08:52.254546 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:52.254548 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:52.254583 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:52.254655 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:52.255021 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.255593 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.256512 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.256751 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.256840 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.258830 (+ 1990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:52.258833 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:52.258835 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:52.258858 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:52.260657 (+ 1799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.261045 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.261048 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.261049 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.261130 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.261483 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.261486 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.261487 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.261681 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:52.261772 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:52.262021 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 17:08:52.262166 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":43}
I20260811 17:08:52.265930 16752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38: Bootstrap starting.
I20260811 17:08:52.268498 16752 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:52.269282 16752 log.cc:824] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:52.271344 16752 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38: No bootstrap required, opened a new log
I20260811 17:08:52.274528 16752 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } }
I20260811 17:08:52.274741 16752 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:52.274812 16752 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70769ce76ba048bcabf0a1333d2f2f38, State: Initialized, Role: FOLLOWER
I20260811 17:08:52.275230 16752 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } }
I20260811 17:08:52.275720 16759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } } }
I20260811 17:08:52.275837 16759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:08:52.276605 16752 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 17:08:52.281426 16777 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 17:08:52.281518 16777 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 17:08:52.283453 16624 master_runner.cc:428] Detected that this master 70769ce76ba048bcabf0a1333d2f2f38 is joining an existing cluster
I20260811 17:08:52.283527 16624 master_runner.cc:432] Initiating AddMaster RPC to add 127.4.146.253:38667
I20260811 17:08:52.295455 16757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.286318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58446 (local address 127.4.146.253:38667)
0811 17:08:52.286423 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:52.286426 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:52.286628 (+ 202us) server_negotiation.cc:407] Connection header received
0811 17:08:52.286766 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:52.286772 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:52.286810 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:52.286904 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:52.287386 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.288200 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.289422 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.289750 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.289828 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.291551 (+ 1723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:52.291557 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:52.291561 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:52.291593 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:52.293598 (+ 2005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.294225 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.294229 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.294231 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.294316 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.294581 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.294583 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.294594 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.294801 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:52.294867 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:52.295144 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 17:08:52.295275 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":39,"spinlock_wait_cycles":2304}
I20260811 17:08:52.295907 16787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.286166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:38667 (local address 127.0.0.1:58446)
0811 17:08:52.286539 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:52.286549 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:52.286674 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:52.286944 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:52.286947 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:52.287162 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:52.287269 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.287275 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.288316 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.288320 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.289297 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.289308 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.289988 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.289992 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.290079 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.290833 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:52.290849 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:52.291388 (+ 539us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:52.293750 (+ 2362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.293756 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.293758 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.294111 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.294414 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.294417 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.294419 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.294495 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.294926 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:52.294929 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:52.295001 (+ 72us) client_negotiation.cc:769] Sending connection context
0811 17:08:52.295622 (+ 621us) client_negotiation.cc:240] Negotiation successful
0811 17:08:52.295748 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"mutex_wait_us":28,"thread_start_us":122,"threads_started":1}
I20260811 17:08:52.296376 15876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.285837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57620 (local address 127.4.146.254:33377)
0811 17:08:52.285971 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:52.285976 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:52.286214 (+ 238us) server_negotiation.cc:407] Connection header received
0811 17:08:52.286407 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:52.286410 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:52.286462 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:52.286519 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:52.287449 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.288280 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.289402 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.289656 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.289803 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.291852 (+ 2049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:52.291855 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:52.291858 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:52.291884 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:52.293810 (+ 1926us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.294381 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.294387 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.294389 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.294535 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.294917 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.294923 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.294934 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.295151 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:52.295320 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:52.295877 (+ 557us) server_negotiation.cc:299] Negotiation successful
0811 17:08:52.296058 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 17:08:52.296957 16786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.285682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.0.0.1:57620)
0811 17:08:52.286125 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:52.286140 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:52.286292 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:52.286697 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:52.286700 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:52.287093 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:52.287279 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.287289 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.288507 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.288514 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.289254 (+ 740us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.289265 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.289822 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.289827 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.289979 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.291136 (+ 1157us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:52.291151 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:52.291690 (+ 539us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:52.293924 (+ 2234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.293937 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.293942 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.294254 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.294679 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.294683 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.294685 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.294791 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.295369 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:52.295372 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:52.295531 (+ 159us) client_negotiation.cc:769] Sending connection context
0811 17:08:52.296626 (+ 1095us) client_negotiation.cc:240] Negotiation successful
0811 17:08:52.296801 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"mutex_wait_us":52,"thread_start_us":117,"threads_started":1}
Aug 11 17:08:52 dist-test-slave-7vjv krb5kdc[15729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468131, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.254@KRBTEST.COM for oryx/127.4.146.253@KRBTEST.COM
I20260811 17:08:52.313963 16788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.302321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:38667 (local address 127.0.0.1:58452)
0811 17:08:52.302803 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:52.302866 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:52.303007 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:52.303340 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:52.303346 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:52.303847 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:52.303994 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.304002 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.305089 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.305093 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.305878 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.305889 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.306410 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.306414 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.306561 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.307226 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:52.307253 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:52.309321 (+ 2068us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:52.311722 (+ 2401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.311734 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.311741 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.312071 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.312486 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.312490 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.312492 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.312602 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.313204 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:52.313212 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:52.313363 (+ 151us) client_negotiation.cc:769] Sending connection context
0811 17:08:52.313530 (+ 167us) client_negotiation.cc:240] Negotiation successful
0811 17:08:52.313766 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":133,"threads_started":1}
I20260811 17:08:52.314000 16757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.302361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58452 (local address 127.4.146.253:38667)
0811 17:08:52.302524 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:52.302529 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:52.302952 (+ 423us) server_negotiation.cc:407] Connection header received
0811 17:08:52.303152 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:52.303155 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:52.303204 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:52.303281 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:52.304137 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.304962 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.306029 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.306281 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.306404 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.309489 (+ 3085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:52.309496 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:52.309503 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:52.309540 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:52.311578 (+ 2038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.312217 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.312224 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.312230 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.312354 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.312728 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.312735 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.312740 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.313070 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:52.313204 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:52.313626 (+ 422us) server_negotiation.cc:299] Negotiation successful
0811 17:08:52.313778 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 17:08:52.315892 15802 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.4.146.253:38667: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38"
member_type: NON_VOTER
last_known_addr {
host: "127.4.146.253"
port: 38667
}
attrs {
promote: true
}
}
dest_uuid: "4f5901df9ec846ffb312adf8fe316c86"
cas_config_opid_index: -1
I20260811 17:08:52.316931 15802 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: NON_VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: true } }
WARNING: no policy specified for oryx/127.4.146.252@KRBTEST.COM; defaulting to no policy
I20260811 17:08:52.319191 16794 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 70769ce76ba048bcabf0a1333d2f2f38 (127.4.146.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: NON_VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: true } } }
I20260811 17:08:52.320073 16706 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 0 FOLLOWER]: Advancing to term 1
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.146.252@KRBTEST.COM" created.
I20260811 17:08:52.321528 16794 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.4.146.253:38667
I20260811 17:08:52.321861 16706 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 1 FOLLOWER]: Refusing update from remote peer 4f5901df9ec846ffb312adf8fe316c86: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 17:08:52.321943 16794 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "4f5901df9ec846ffb312adf8fe316c86" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: NON_VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: true } } }
I20260811 17:08:52.322072 16794 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:52.322494 16624 master.cc:537] Master@127.4.146.253:38667 shutting down...
I20260811 17:08:52.323813 16793 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: NON_VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:08:52.324822 16759 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:08:52.325030 16759 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } }
I20260811 17:08:52.325989 16759 leader_election.cc:288] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f5901df9ec846ffb312adf8fe316c86 (127.4.146.254:33377)
I20260811 17:08:52.326618 15817 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "70769ce76ba048bcabf0a1333d2f2f38" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f5901df9ec846ffb312adf8fe316c86" is_pre_election: true
W20260811 17:08:52.327080 15783 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260811 17:08:52.327283 16655 leader_election.cc:302] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 70769ce76ba048bcabf0a1333d2f2f38; no voters: 4f5901df9ec846ffb312adf8fe316c86
I20260811 17:08:52.327709 16759 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260811 17:08:52.328784 15783 consensus_peers.cc:487] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 -> Peer 70769ce76ba048bcabf0a1333d2f2f38 (127.4.146.253:38667): Couldn't send request to peer 70769ce76ba048bcabf0a1333d2f2f38. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 17:08:52.330698 16624 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:08:52.331043 16624 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:52.331177 16624 tablet_replica.cc:330] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38: stopping tablet replica
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.146.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.252.keytab.
Entry for principal oryx/127.4.146.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.252.keytab.
I20260811 17:08:52.345147 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.252:41983
--webserver_interface=127.4.146.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.252.keytab
--principal=oryx/127.4.146.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:38843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:33377,127.4.146.253:38667,127.4.146.252:41983
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 17:08:52.346961 16624 master.cc:552] Master@127.4.146.253:38667 shutdown complete.
I20260811 17:08:52.347035 16624 master_runner.cc:305] Clearing existing system tablet
I20260811 17:08:52.347344 16624 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:52.347414 16624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:52.348920 16624 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 17:08:52.349897 16809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:52.350217 16624 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:52.350353 16624 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 17:08:52.350386 16624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/wal
uuid: "70769ce76ba048bcabf0a1333d2f2f38"
format_stamp: "Formatted at 2026-08-11 17:08:52 on dist-test-slave-7vjv"
server_key: "057b9bd8837f9082a8e18444b585b5e5"
server_key_iv: "59f14f0dacb837ef36a762bf10245338"
server_key_version: "encryptionkey@0"
I20260811 17:08:52.352793 16624 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:52.355264 16624 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 17:08:52.355361 16624 log.cc:1196] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 17:08:52.355629 16624 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38: Deleting consensus metadata
I20260811 17:08:52.355798 16624 master_runner.cc:315] Copying system tablet from 127.4.146.254:33377
I20260811 17:08:52.357084 16624 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38: tablet copy: Beginning tablet copy session from remote peer at address 127.4.146.254:33377
I20260811 17:08:52.366771 15876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.357958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57626 (local address 127.4.146.254:33377)
0811 17:08:52.358137 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:52.358144 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:52.358233 (+ 89us) server_negotiation.cc:407] Connection header received
0811 17:08:52.358397 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:52.358403 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:52.358466 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:52.358571 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:52.359108 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.359969 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.361246 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.361618 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.361733 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.363106 (+ 1373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:52.363110 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:52.363113 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:52.363143 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:52.364928 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.365446 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.365450 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.365452 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.365546 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.365842 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.365847 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.365851 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.366074 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:52.366182 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:52.366477 (+ 295us) server_negotiation.cc:299] Negotiation successful
0811 17:08:52.366605 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 17:08:52.366786 16819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.357798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.0.0.1:57626)
0811 17:08:52.358148 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:52.358162 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:52.358282 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:52.358614 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:52.358617 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:52.358836 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:52.358970 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.358977 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.360123 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.360128 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.361096 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.361108 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.361758 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.361762 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.361866 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.362477 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:52.362493 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:52.362944 (+ 451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:52.365053 (+ 2109us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.365056 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.365059 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.365332 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.365647 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.365650 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.365652 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.365747 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.366184 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:52.366187 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:52.366296 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 17:08:52.366406 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 17:08:52.366558 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":97,"threads_started":1}
I20260811 17:08:52.368324 15836 tablet_copy_service.cc:140] P 4f5901df9ec846ffb312adf8fe316c86: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 70769ce76ba048bcabf0a1333d2f2f38 ({username='oryx', principal='oryx/127.4.146.253@KRBTEST.COM'} at 127.0.0.1:57626)
I20260811 17:08:52.368513 15836 tablet_copy_service.cc:161] P 4f5901df9ec846ffb312adf8fe316c86: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 70769ce76ba048bcabf0a1333d2f2f38 at {username='oryx', principal='oryx/127.4.146.253@KRBTEST.COM'} at 127.0.0.1:57626: session id = 70769ce76ba048bcabf0a1333d2f2f38-00000000000000000000000000000000
I20260811 17:08:52.370556 15836 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 17:08:52.372614 16624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 17:08:52.375240 16624 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38: tablet copy: Starting download of 0 data blocks...
I20260811 17:08:52.375445 16624 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38: tablet copy: Starting download of 1 WAL segments...
I20260811 17:08:52.377477 16624 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 17:08:52.379720 15836 tablet_copy_service.cc:342] P 4f5901df9ec846ffb312adf8fe316c86: Request end of tablet copy session 70769ce76ba048bcabf0a1333d2f2f38-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.4.146.253@KRBTEST.COM'} at 127.0.0.1:57626
I20260811 17:08:52.379838 15836 tablet_copy_service.cc:433] P 4f5901df9ec846ffb312adf8fe316c86: ending tablet copy session 70769ce76ba048bcabf0a1333d2f2f38-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 70769ce76ba048bcabf0a1333d2f2f38
I20260811 17:08:52.388324 16624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:52.390303 16821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:52.393362 16829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:52.393347 16826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:52.395668 16624 server_base.cc:1034] running on GCE node
I20260811 17:08:52.395859 16624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:52.396224 16624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:52.397382 16624 hybrid_clock.cc:648] HybridClock initialized: now 1786468132397356 us; error 45 us; skew 500 ppm
Aug 11 17:08:52 dist-test-slave-7vjv krb5kdc[15729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468132, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:52.399145 16624 init.cc:377] Logged in from keytab as oryx/127.4.146.253@KRBTEST.COM (short username oryx)
I20260811 17:08:52.399657 16624 webserver.cc:460] Webserver started at http://127.4.146.253:40591/ using document root <none> and password file <none>
I20260811 17:08:52.399866 16624 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:52.399900 16624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:52.401304 16624 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 17:08:52.402338 16845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:52.402581 16624 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 17:08:52.402664 16624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/wal
uuid: "70769ce76ba048bcabf0a1333d2f2f38"
format_stamp: "Formatted at 2026-08-11 17:08:52 on dist-test-slave-7vjv"
server_key: "057b9bd8837f9082a8e18444b585b5e5"
server_key_iv: "59f14f0dacb837ef36a762bf10245338"
server_key_version: "encryptionkey@0"
I20260811 17:08:52.402738 16624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:52.421356 16624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:52.424147 16624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:52.429852 16624 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.253:38667
I20260811 17:08:52.429898 16944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.253:38667 every 8 connection(s)
I20260811 17:08:52.430490 16624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-1/data/info.pb
I20260811 17:08:52.432484 16945 sys_catalog.cc:263] Verifying existing consensus state
I20260811 17:08:52.433681 16945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38: Bootstrap starting.
I20260811 17:08:52.444357 16945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 17:08:52.444684 16945 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38: Bootstrap complete.
I20260811 17:08:52.445307 16945 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: NON_VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: true } }
I20260811 17:08:52.445448 16945 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 70769ce76ba048bcabf0a1333d2f2f38, State: Initialized, Role: LEARNER
I20260811 17:08:52.445546 16945 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: NON_VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: true } }
I20260811 17:08:52.445912 16951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: NON_VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: true } } }
I20260811 17:08:52.446034 16945 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:08:52.446141 16951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [sys.catalog]: This master's current role is: LEARNER
I20260811 17:08:52.449327 16973 catalog_manager.cc:1259] Loaded cluster ID: 0b854d920aeb454e8a583d46de21771c
I20260811 17:08:52.449489 16973 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38: loading cluster ID for follower catalog manager: success
I20260811 17:08:52.451897 16973 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38: acquiring CA information for follower catalog manager: success
I20260811 17:08:52.453645 16973 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 17:08:52.491605 16803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:52.491917 16803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:52.491961 16803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:52.496340 16803 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:08:52.496403 16803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:52.496423 16803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:52.496441 16803 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:08:52.496486 16803 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:08:52.502069 16803 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:38843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:33377,127.4.146.253:38667,127.4.146.252:41983
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.252.keytab
--principal=oryx/127.4.146.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.252:41983
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.4.146.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16803
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:52.503247 16803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:52.504413 16803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:52.513428 16982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:52.513512 16985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:52.513482 16983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:52.513851 16803 server_base.cc:1034] running on GCE node
I20260811 17:08:52.514551 16803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:52.515816 16803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:52.517076 16803 hybrid_clock.cc:648] HybridClock initialized: now 1786468132517044 us; error 53 us; skew 500 ppm
Aug 11 17:08:52 dist-test-slave-7vjv krb5kdc[15729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468132, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:52.520417 16803 init.cc:377] Logged in from keytab as oryx/127.4.146.252@KRBTEST.COM (short username oryx)
I20260811 17:08:52.521528 16803 webserver.cc:460] Webserver started at http://127.4.146.252:34817/ using document root <none> and password file <none>
I20260811 17:08:52.522212 16803 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:52.522310 16803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:52.522532 16803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:52.524791 16803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/data/instance:
uuid: "fc10f7924b6d409487c977b1c274d7ff"
format_stamp: "Formatted at 2026-08-11 17:08:52 on dist-test-slave-7vjv"
server_key: "26d4f04b05fe762440e512afca9d02d5"
server_key_iv: "8d9a69ac95fab4ee3ef5c3919eaeb62a"
server_key_version: "encryptionkey@0"
I20260811 17:08:52.525388 16803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/wal/instance:
uuid: "fc10f7924b6d409487c977b1c274d7ff"
format_stamp: "Formatted at 2026-08-11 17:08:52 on dist-test-slave-7vjv"
server_key: "26d4f04b05fe762440e512afca9d02d5"
server_key_iv: "8d9a69ac95fab4ee3ef5c3919eaeb62a"
server_key_version: "encryptionkey@0"
I20260811 17:08:52.529402 16803 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 17:08:52.531867 16996 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:52.533227 16803 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260811 17:08:52.533381 16803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/wal
uuid: "fc10f7924b6d409487c977b1c274d7ff"
format_stamp: "Formatted at 2026-08-11 17:08:52 on dist-test-slave-7vjv"
server_key: "26d4f04b05fe762440e512afca9d02d5"
server_key_iv: "8d9a69ac95fab4ee3ef5c3919eaeb62a"
server_key_version: "encryptionkey@0"
I20260811 17:08:52.533505 16803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:52.544203 16149 heartbeater.cc:503] Master 127.4.146.254:33377 was elected leader, sending a full tablet report...
I20260811 17:08:52.553728 16803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:52.557534 16803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:52.557729 16803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:52.566644 16803 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.252:41983
I20260811 17:08:52.566941 17092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.252:41983 every 8 connection(s)
I20260811 17:08:52.567737 16803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/data/info.pb
I20260811 17:08:52.570802 17093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:52.575122 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 16803
I20260811 17:08:52.574985 17093 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 17:08:52 dist-test-slave-7vjv krb5kdc[15729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468132, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.252@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM
Aug 11 17:08:52 dist-test-slave-7vjv krb5kdc[15729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468130, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.146.252@KRBTEST.COM
I20260811 17:08:52.588439 15876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.577315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57636 (local address 127.4.146.254:33377)
0811 17:08:52.577435 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:52.577440 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:52.577616 (+ 176us) server_negotiation.cc:407] Connection header received
0811 17:08:52.578283 (+ 667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:52.578287 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:52.578348 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:52.578440 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:52.579268 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.579815 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.581185 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.581413 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.581544 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.584341 (+ 2797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:52.584348 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:52.584351 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:52.584380 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:52.586086 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.586720 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.586723 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.586724 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.586797 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.587209 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.587213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.587215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.587458 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:52.587533 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:52.588082 (+ 549us) server_negotiation.cc:299] Negotiation successful
0811 17:08:52.588270 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 17:08:52.589308 17097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.576740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51198 (local address 127.4.146.252:41983)
0811 17:08:52.577219 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:52.577238 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:52.577278 (+ 40us) server_negotiation.cc:407] Connection header received
0811 17:08:52.578050 (+ 772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:52.578068 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:52.578263 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:52.578454 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:52.579308 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.580267 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.581286 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.581696 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.581819 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.584845 (+ 3026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:52.584851 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:52.584861 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:52.584882 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:52.586684 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.587199 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.587205 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.587207 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.587297 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.587606 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.587610 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.587612 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.587853 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:52.588050 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:52.588301 (+ 251us) server_negotiation.cc:299] Negotiation successful
0811 17:08:52.588482 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":322,"thread_start_us":152,"threads_started":1}
I20260811 17:08:52.589308 17099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.577018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.0.0.1:57636)
0811 17:08:52.577474 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:52.577525 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:52.578061 (+ 536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:52.578493 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:52.578498 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:52.578863 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:52.579125 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.579138 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.579945 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.579949 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.581027 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.581037 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.581598 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.581602 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.581781 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.582391 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:52.582408 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:52.584183 (+ 1775us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:52.586209 (+ 2026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.586217 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.586227 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.586617 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.586889 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.586893 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.586895 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.587074 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.587564 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:52.587572 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:52.587825 (+ 253us) client_negotiation.cc:769] Sending connection context
0811 17:08:52.588008 (+ 183us) client_negotiation.cc:240] Negotiation successful
0811 17:08:52.588414 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"mutex_wait_us":44,"thread_start_us":147,"threads_started":1}
I20260811 17:08:52.590580 17093 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 17:08:52 dist-test-slave-7vjv krb5kdc[15729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468132, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.252@KRBTEST.COM for oryx/127.4.146.253@KRBTEST.COM
I20260811 17:08:52.598963 17099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.591114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:38667 (local address 127.0.0.1:58468)
0811 17:08:52.591222 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:52.591237 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:52.591314 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:52.591747 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:52.591751 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:52.591941 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:52.592030 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.592036 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.592957 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.592962 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.593497 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.593505 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.593969 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.593972 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.594070 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.594536 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:52.594551 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:52.595786 (+ 1235us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:52.597633 (+ 1847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.597636 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.597637 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.597856 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.598113 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.598121 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.598122 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.598212 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.598553 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:52.598555 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:52.598638 (+ 83us) client_negotiation.cc:769] Sending connection context
0811 17:08:52.598729 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 17:08:52.598838 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 17:08:52.599018 17100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.591232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58468 (local address 127.4.146.253:38667)
0811 17:08:52.591518 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:52.591522 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:52.591533 (+ 11us) server_negotiation.cc:407] Connection header received
0811 17:08:52.591568 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:52.591570 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:52.591609 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:52.591727 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:52.592173 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.592846 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.593615 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.593857 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.593971 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.595957 (+ 1986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:52.595961 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:52.595962 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:52.595988 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:52.597510 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.597949 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.597951 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.597952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.598028 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.598294 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.598295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.598297 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.598470 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:52.598544 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:52.598784 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 17:08:52.598886 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":119,"threads_started":1}
I20260811 17:08:52.599844 17093 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41983 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 17:08:52 dist-test-slave-7vjv krb5kdc[15729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468132, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.252@KRBTEST.COM for oryx/127.4.146.252@KRBTEST.COM
I20260811 17:08:52.607758 17097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.600537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51206 (local address 127.4.146.252:41983)
0811 17:08:52.600661 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:52.600665 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:52.600678 (+ 13us) server_negotiation.cc:407] Connection header received
0811 17:08:52.600791 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:52.600794 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:52.600837 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:52.600920 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:52.601271 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.601770 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.602473 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.602705 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.602814 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.604952 (+ 2138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:52.604956 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:52.604958 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:52.604980 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:52.606190 (+ 1210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.606588 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.606592 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.606597 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.606675 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.606941 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.606944 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.606945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.607127 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:52.607232 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:52.607475 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 17:08:52.607618 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":53}
I20260811 17:08:52.607758 17099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.600418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:41983 (local address 127.0.0.1:51206)
0811 17:08:52.600546 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:52.600604 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:52.600686 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:52.600930 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:52.600933 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:52.601092 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:52.601161 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.601166 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.601878 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.601883 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.602360 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.602367 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.602826 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.602829 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.602910 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.603466 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:52.603486 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:52.604828 (+ 1342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:52.606308 (+ 1480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.606311 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.606313 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.606495 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.606763 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.606767 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.606769 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.606849 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.607221 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:52.607223 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:52.607306 (+ 83us) client_negotiation.cc:769] Sending connection context
0811 17:08:52.607419 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 17:08:52.607563 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260811 17:08:52.611322 17093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff: Bootstrap starting.
I20260811 17:08:52.613862 17093 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:52.614604 17093 log.cc:824] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:52.616894 17093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff: No bootstrap required, opened a new log
I20260811 17:08:52.620041 17093 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41983 } }
I20260811 17:08:52.620332 17093 raft_consensus.cc:374] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:52.620381 17093 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc10f7924b6d409487c977b1c274d7ff, State: Initialized, Role: FOLLOWER
I20260811 17:08:52.620859 17093 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41983 } }
I20260811 17:08:52.621507 17104 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41983 } } }
I20260811 17:08:52.621665 17104 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:08:52.622309 17093 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [sys.catalog]: configured and running, proceeding with master startup.
W20260811 17:08:52.627578 17124 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 17:08:52.627681 17124 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 17:08:52.631273 16803 master_runner.cc:428] Detected that this master fc10f7924b6d409487c977b1c274d7ff is joining an existing cluster
I20260811 17:08:52.631358 16803 master_runner.cc:432] Initiating AddMaster RPC to add 127.4.146.252:41983
I20260811 17:08:52.643318 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 15909
I20260811 17:08:52.659957 15876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.634156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57650 (local address 127.4.146.254:33377)
0811 17:08:52.634305 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:52.634311 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:52.634466 (+ 155us) server_negotiation.cc:407] Connection header received
0811 17:08:52.634577 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:52.634580 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:52.634638 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:52.634735 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:52.635667 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.636657 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.638392 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.638752 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.638844 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.640593 (+ 1749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:52.640599 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:52.640603 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:52.640642 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:52.642558 (+ 1916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.658037 (+ 15479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.658042 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.658044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.658194 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.658549 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.658553 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.658554 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.658809 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:52.658889 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:52.659602 (+ 713us) server_negotiation.cc:299] Negotiation successful
0811 17:08:52.659775 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 17:08:52.660653 17135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.634046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.0.0.1:57650)
0811 17:08:52.634352 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:52.634369 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:52.634483 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:52.635038 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:52.635042 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:52.635330 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:52.635498 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.635507 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.636890 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.636894 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.638231 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.638242 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.639040 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.639043 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.639150 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.639831 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:52.639847 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:52.640433 (+ 586us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:52.643058 (+ 2625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.643066 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.643070 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.657841 (+ 14771us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.658339 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.658342 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.658345 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.658442 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.658969 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:52.658972 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:52.659076 (+ 104us) client_negotiation.cc:769] Sending connection context
0811 17:08:52.660260 (+ 1184us) client_negotiation.cc:240] Negotiation successful
0811 17:08:52.660432 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"mutex_wait_us":26,"thread_start_us":122,"threads_started":1}
I20260811 17:08:52.662015 17097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.635151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51210 (local address 127.4.146.252:41983)
0811 17:08:52.635263 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:52.635267 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:52.635782 (+ 515us) server_negotiation.cc:407] Connection header received
0811 17:08:52.635928 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:52.635934 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:52.635970 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:52.636017 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:52.636638 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.637488 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.640341 (+ 2853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.640574 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.640680 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.642041 (+ 1361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:52.642045 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:52.642048 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:52.642070 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:52.643798 (+ 1728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.660843 (+ 17045us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.660847 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.660849 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.660936 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.661206 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.661209 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.661211 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.661407 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:52.661481 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:52.661758 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 17:08:52.661872 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":49}
I20260811 17:08:52.662436 17143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.634866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:41983 (local address 127.0.0.1:51210)
0811 17:08:52.635701 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:52.635715 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:52.635836 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:52.636188 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:52.636190 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:52.636386 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:52.636530 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.636537 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.637839 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.637842 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.640181 (+ 2339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.640192 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.640697 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.640701 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.640846 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.641460 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:52.641475 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:52.641895 (+ 420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:52.646596 (+ 4701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.646600 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.646602 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.659438 (+ 12836us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.661035 (+ 1597us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.661038 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.661040 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.661124 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.661522 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:52.661524 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:52.661596 (+ 72us) client_negotiation.cc:769] Sending connection context
0811 17:08:52.662154 (+ 558us) client_negotiation.cc:240] Negotiation successful
0811 17:08:52.662286 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":767,"mutex_wait_us":59,"thread_start_us":84,"threads_started":1}
I20260811 17:08:52.666947 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:40803
--local_ip_for_outbound_sockets=127.4.146.193
--tserver_master_addrs=127.4.146.254:33377
--webserver_port=42649
--webserver_interface=127.4.146.193
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.193.keytab
--principal=oryx/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:38843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.4.146.254:33377,127.4.146.253:38667
--tserver_master_addrs=127.4.146.254:33377,127.4.146.253:38667,127.4.146.252:41983 with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 17:08:52.668187 17100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.634910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58474 (local address 127.4.146.253:38667)
0811 17:08:52.635304 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:52.635308 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:52.635320 (+ 12us) server_negotiation.cc:407] Connection header received
0811 17:08:52.635364 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:52.635366 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:52.635403 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:52.635491 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:52.636133 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.636928 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.638751 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.639204 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.639289 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.658951 (+ 19662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:52.658958 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:52.658964 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:52.659005 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:52.661440 (+ 2435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.665788 (+ 4348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.665796 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.665800 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.665913 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.666777 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.666782 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.666785 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.667044 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:52.667131 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:52.667843 (+ 712us) server_negotiation.cc:299] Negotiation successful
0811 17:08:52.667994 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306}
I20260811 17:08:52.668949 17137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.634511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:38667 (local address 127.0.0.1:58474)
0811 17:08:52.634893 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:52.634910 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:52.634999 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:52.635511 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:52.635514 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:52.635818 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:52.635970 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.635977 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.637061 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.637064 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.638521 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.638534 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.639466 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.639471 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.639571 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.658085 (+ 18514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:52.658107 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:52.658702 (+ 595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:52.665118 (+ 6416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.665125 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.665130 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.665646 (+ 516us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.666170 (+ 524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.666176 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.666181 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.666654 (+ 473us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.667529 (+ 875us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:52.667531 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:52.667648 (+ 117us) client_negotiation.cc:769] Sending connection context
0811 17:08:52.668624 (+ 976us) client_negotiation.cc:240] Negotiation successful
0811 17:08:52.668777 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":98,"threads_started":1}
Aug 11 17:08:52 dist-test-slave-7vjv krb5kdc[15729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468131, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.254@KRBTEST.COM for oryx/127.4.146.252@KRBTEST.COM
I20260811 17:08:52.678037 16788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.666806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:41983 (local address 127.0.0.1:51224)
0811 17:08:52.667053 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:52.667069 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:52.667157 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:52.667775 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:52.667778 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:52.667988 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:52.668171 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.668180 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.669181 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.669185 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.670107 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.670122 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.670859 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.670864 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.670985 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.671548 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:52.671564 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:52.673351 (+ 1787us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:52.676364 (+ 3013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.676367 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.676369 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.676624 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.676921 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.676925 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.676927 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.677012 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.677486 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:52.677489 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:52.677592 (+ 103us) client_negotiation.cc:769] Sending connection context
0811 17:08:52.677698 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 17:08:52.677854 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170}
I20260811 17:08:52.678668 17097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.667315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51224 (local address 127.4.146.252:41983)
0811 17:08:52.667426 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:52.667430 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:52.667440 (+ 10us) server_negotiation.cc:407] Connection header received
0811 17:08:52.667514 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:52.667517 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:52.667570 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:52.667641 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:52.668310 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.669036 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.670265 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.670607 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.670722 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.673521 (+ 2799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:52.673525 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:52.673529 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:52.673555 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:52.676228 (+ 2673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.676735 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.676738 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.676741 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.676822 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.677122 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.677126 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.677128 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.677349 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:52.677439 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:52.678393 (+ 954us) server_negotiation.cc:299] Negotiation successful
0811 17:08:52.678512 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 17:08:52.680373 15802 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.4.146.252:41983: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff"
member_type: NON_VOTER
last_known_addr {
host: "127.4.146.252"
port: 41983
}
attrs {
promote: true
}
}
dest_uuid: "4f5901df9ec846ffb312adf8fe316c86"
cas_config_opid_index: 5
I20260811 17:08:52.681134 15802 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: NON_VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: true } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: NON_VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: true } }
I20260811 17:08:52.682240 16793 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER fc10f7924b6d409487c977b1c274d7ff (127.4.146.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: NON_VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: true } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: NON_VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: true } } }
I20260811 17:08:52.683799 16793 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.4.146.252:41983
I20260811 17:08:52.683987 16793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "4f5901df9ec846ffb312adf8fe316c86" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: NON_VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: true } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: NON_VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: true } } }
I20260811 17:08:52.684085 16793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:52.684496 16803 master.cc:537] Master@127.4.146.252:41983 shutting down...
W20260811 17:08:52.686295 15783 consensus_peers.cc:487] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 -> Peer fc10f7924b6d409487c977b1c274d7ff (127.4.146.252:41983): Couldn't send request to peer fc10f7924b6d409487c977b1c274d7ff. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 17:08:52.693732 17100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.685050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58478 (local address 127.4.146.253:38667)
0811 17:08:52.685226 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:52.685232 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:52.688390 (+ 3158us) server_negotiation.cc:407] Connection header received
0811 17:08:52.688597 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:52.688600 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:52.688666 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:52.688737 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:52.689150 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.689955 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.691547 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.692552 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.692660 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.692881 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:52.693439 (+ 558us) server_negotiation.cc:299] Negotiation successful
0811 17:08:52.693565 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 17:08:52.693758 16803 raft_consensus.cc:2229] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 0 FOLLOWER]: Raft consensus shutting down.
I20260811 17:08:52.694105 16803 raft_consensus.cc:2258] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 0 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:52.694232 16803 tablet_replica.cc:330] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff: stopping tablet replica
I20260811 17:08:52.694597 16788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.684596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:38667 (local address 127.0.0.1:58478)
0811 17:08:52.688301 (+ 3705us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:52.688318 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:52.688473 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:52.688906 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:52.688910 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:52.688926 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:52.689017 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.689023 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.690115 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.690118 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.691394 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.691406 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.693107 (+ 1701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.693114 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.693229 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.693295 (+ 66us) client_negotiation.cc:769] Sending connection context
0811 17:08:52.694376 (+ 1081us) client_negotiation.cc:240] Negotiation successful
0811 17:08:52.694472 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3611}
I20260811 17:08:52.695396 16892 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 1 LEARNER]: Refusing update from remote peer 4f5901df9ec846ffb312adf8fe316c86: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 17:08:52.695973 16793 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: NON_VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 17:08:52.698378 16892 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER fc10f7924b6d409487c977b1c274d7ff (127.4.146.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: NON_VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: true } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: NON_VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: true } } }
I20260811 17:08:52.700706 16803 master.cc:552] Master@127.4.146.252:41983 shutdown complete.
I20260811 17:08:52.700760 16803 master_runner.cc:305] Clearing existing system tablet
I20260811 17:08:52.701054 16803 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:52.701112 16803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:52.701254 16951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f5901df9ec846ffb312adf8fe316c86. Latest consensus state: current_term: 1 leader_uuid: "4f5901df9ec846ffb312adf8fe316c86" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: NON_VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: true } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: NON_VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: true } } }
I20260811 17:08:52.701370 16951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [sys.catalog]: This master's current role is: LEARNER
I20260811 17:08:52.701467 16951 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4f5901df9ec846ffb312adf8fe316c86" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: NON_VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: true } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: NON_VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: true } } }
I20260811 17:08:52.701542 16951 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [sys.catalog]: This master's current role is: LEARNER
I20260811 17:08:52.702456 16803 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 17:08:52.703347 17149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:52.703583 16803 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:52.703742 16803 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 17:08:52.703779 16803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/wal
uuid: "fc10f7924b6d409487c977b1c274d7ff"
format_stamp: "Formatted at 2026-08-11 17:08:52 on dist-test-slave-7vjv"
server_key: "26d4f04b05fe762440e512afca9d02d5"
server_key_iv: "8d9a69ac95fab4ee3ef5c3919eaeb62a"
server_key_version: "encryptionkey@0"
I20260811 17:08:52.705614 16803 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:52.707561 16803 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 17:08:52.707682 16803 log.cc:1196] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 17:08:52.707955 16803 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff: Deleting consensus metadata
I20260811 17:08:52.708200 16803 master_runner.cc:315] Copying system tablet from 127.4.146.254:33377
I20260811 17:08:52.709180 16793 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86: attempting to promote NON_VOTER 70769ce76ba048bcabf0a1333d2f2f38 to VOTER
I20260811 17:08:52.709697 16803 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff: tablet copy: Beginning tablet copy session from remote peer at address 127.4.146.254:33377
I20260811 17:08:52.709699 16793 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: NON_VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: true } }
I20260811 17:08:52.712296 16788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.711881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:41983 (local address 127.0.0.1:51238)
0811 17:08:52.711983 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:52.712069 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:41983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 17:08:52.712658 16892 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 1 LEARNER]: Refusing update from remote peer 4f5901df9ec846ffb312adf8fe316c86: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 17:08:52.713090 16788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.712831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:41983 (local address 127.0.0.1:51248)
0811 17:08:52.712965 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:52.713013 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:41983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260811 17:08:52.713191 15783 consensus_peers.cc:487] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 -> Peer fc10f7924b6d409487c977b1c274d7ff (127.4.146.252:41983): Couldn't send request to peer fc10f7924b6d409487c977b1c274d7ff. Status: Network error: Client connection negotiation failed: client connection to 127.4.146.252:41983: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 17:08:52.713795 17161 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 17:08:52.715837 16794 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 70769ce76ba048bcabf0a1333d2f2f38 (127.4.146.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: NON_VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: true } } }
I20260811 17:08:52.716380 16892 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 70769ce76ba048bcabf0a1333d2f2f38 (127.4.146.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: NON_VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: true } } }
I20260811 17:08:52.717584 16794 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "4f5901df9ec846ffb312adf8fe316c86" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: NON_VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: true } } }
I20260811 17:08:52.717718 16794 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:52.717857 16794 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4f5901df9ec846ffb312adf8fe316c86" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: NON_VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: true } } }
I20260811 17:08:52.717938 16794 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:52.718353 17147 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4f5901df9ec846ffb312adf8fe316c86" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: NON_VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: true } } }
I20260811 17:08:52.718477 17147 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:08:52.722985 15876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.710408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57652 (local address 127.4.146.254:33377)
0811 17:08:52.710534 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:52.710538 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:52.711216 (+ 678us) server_negotiation.cc:407] Connection header received
0811 17:08:52.711420 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:52.711423 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:52.711477 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:52.711532 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:52.713018 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.713686 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.715197 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.715509 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.715593 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.719570 (+ 3977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:52.719574 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:52.719577 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:52.719617 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:52.721241 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.721698 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.721702 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.721704 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.721789 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.722079 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.722083 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.722085 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.722334 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:52.722435 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:52.722709 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 17:08:52.722821 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 17:08:52.723016 17164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.710665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.0.0.1:57652)
0811 17:08:52.711116 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:52.711132 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:52.711301 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:52.711709 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:52.711715 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:52.712715 (+ 1000us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:52.712865 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.712876 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.714213 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.714220 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.715049 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.715063 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.718344 (+ 3281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.718347 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.718459 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.719053 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:52.719065 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:52.719418 (+ 353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:52.721367 (+ 1949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.721370 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.721372 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.721591 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.721887 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.721890 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.721893 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.721985 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.722425 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:52.722428 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:52.722539 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 17:08:52.722651 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 17:08:52.722817 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":111,"threads_started":1}
I20260811 17:08:52.723767 15836 tablet_copy_service.cc:140] P 4f5901df9ec846ffb312adf8fe316c86: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer fc10f7924b6d409487c977b1c274d7ff ({username='oryx', principal='oryx/127.4.146.252@KRBTEST.COM'} at 127.0.0.1:57652)
I20260811 17:08:52.723870 15836 tablet_copy_service.cc:161] P 4f5901df9ec846ffb312adf8fe316c86: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer fc10f7924b6d409487c977b1c274d7ff at {username='oryx', principal='oryx/127.4.146.252@KRBTEST.COM'} at 127.0.0.1:57652: session id = fc10f7924b6d409487c977b1c274d7ff-00000000000000000000000000000000
I20260811 17:08:52.724925 15836 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 17:08:52.726158 16803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 17:08:52.728230 16803 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff: tablet copy: Starting download of 0 data blocks...
I20260811 17:08:52.728437 16803 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff: tablet copy: Starting download of 1 WAL segments...
I20260811 17:08:52.729847 16803 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 17:08:52.731459 15836 tablet_copy_service.cc:342] P 4f5901df9ec846ffb312adf8fe316c86: Request end of tablet copy session fc10f7924b6d409487c977b1c274d7ff-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.4.146.252@KRBTEST.COM'} at 127.0.0.1:57652
I20260811 17:08:52.731561 15836 tablet_copy_service.cc:433] P 4f5901df9ec846ffb312adf8fe316c86: ending tablet copy session fc10f7924b6d409487c977b1c274d7ff-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer fc10f7924b6d409487c977b1c274d7ff
I20260811 17:08:52.738310 16803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:52.740168 17170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:52.740171 17166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:52.740594 16803 server_base.cc:1034] running on GCE node
W20260811 17:08:52.744239 17167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:52.744544 16803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:52.744916 16803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:52.746064 16803 hybrid_clock.cc:648] HybridClock initialized: now 1786468132746051 us; error 69 us; skew 500 ppm
Aug 11 17:08:52 dist-test-slave-7vjv krb5kdc[15729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468132, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:52.747916 16803 init.cc:377] Logged in from keytab as oryx/127.4.146.252@KRBTEST.COM (short username oryx)
I20260811 17:08:52.748517 16803 webserver.cc:460] Webserver started at http://127.4.146.252:37345/ using document root <none> and password file <none>
I20260811 17:08:52.748726 16803 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:52.748785 16803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:52.750097 16803 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 17:08:52.751237 17180 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:52.751478 16803 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 17:08:52.751555 16803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/wal
uuid: "fc10f7924b6d409487c977b1c274d7ff"
format_stamp: "Formatted at 2026-08-11 17:08:52 on dist-test-slave-7vjv"
server_key: "26d4f04b05fe762440e512afca9d02d5"
server_key_iv: "8d9a69ac95fab4ee3ef5c3919eaeb62a"
server_key_version: "encryptionkey@0"
I20260811 17:08:52.751641 16803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:52.763860 16803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:52.766227 16803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:52.769241 16386 heartbeater.cc:503] Master 127.4.146.254:33377 was elected leader, sending a full tablet report...
I20260811 17:08:52.771267 16803 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.252:41983
I20260811 17:08:52.771283 17276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.252:41983 every 8 connection(s)
I20260811 17:08:52.771845 16803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/master-2/data/info.pb
I20260811 17:08:52.773867 17279 sys_catalog.cc:263] Verifying existing consensus state
I20260811 17:08:52.774777 17279 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff: Bootstrap starting.
I20260811 17:08:52.783975 17279 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 17:08:52.784319 17279 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff: Bootstrap complete.
I20260811 17:08:52.784881 17279 raft_consensus.cc:348] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: NON_VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: true } }
I20260811 17:08:52.785032 17279 raft_consensus.cc:729] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: fc10f7924b6d409487c977b1c274d7ff, State: Initialized, Role: LEARNER
I20260811 17:08:52.785153 17279 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: NON_VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: true } }
I20260811 17:08:52.785527 17285 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: NON_VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: true } } }
I20260811 17:08:52.785699 17279 sys_catalog.cc:564] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:08:52.785704 17285 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [sys.catalog]: This master's current role is: LEARNER
I20260811 17:08:52.789289 17308 catalog_manager.cc:1259] Loaded cluster ID: 0b854d920aeb454e8a583d46de21771c
I20260811 17:08:52.789371 17308 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff: loading cluster ID for follower catalog manager: success
I20260811 17:08:52.790921 17308 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff: acquiring CA information for follower catalog manager: success
I20260811 17:08:52.792073 17308 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 17:08:52.838984 17145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:52.839438 17145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:52.839538 17145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:52.845818 17145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:52.845906 17145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:52.845994 17145 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:08:52.853677 17145 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:38843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.193.keytab
--principal=oryx/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:40803
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=42649
--tserver_master_addrs=127.4.146.254:33377,127.4.146.253:38667,127.4.146.252:41983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17145
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:52.854984 17145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:52.855993 17145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:52.866451 17317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:52.866451 17324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:52.866505 17145 server_base.cc:1034] running on GCE node
W20260811 17:08:52.866443 17321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:52.867273 17145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:52.868031 17145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:52.869270 17145 hybrid_clock.cc:648] HybridClock initialized: now 1786468132869253 us; error 29 us; skew 500 ppm
Aug 11 17:08:52 dist-test-slave-7vjv krb5kdc[15729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468132, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:52.872622 17145 init.cc:377] Logged in from keytab as oryx/127.4.146.193@KRBTEST.COM (short username oryx)
I20260811 17:08:52.873801 17145 webserver.cc:460] Webserver started at http://127.4.146.193:42649/ using document root <none> and password file <none>
I20260811 17:08:52.874425 17145 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:52.874511 17145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:52.878770 17145 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 17:08:52.881232 17334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:52.882531 17145 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:08:52.882670 17145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "d2b5f5df53eb4066bb755b3b8b565a35"
format_stamp: "Formatted at 2026-08-11 17:08:51 on dist-test-slave-7vjv"
server_key: "d7192cbd805dcae832d44e895d5a3e60"
server_key_iv: "8b54ebc7dc3ef5369e5295294a5e5b87"
server_key_version: "encryptionkey@0"
I20260811 17:08:52.883291 17145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:52.893685 17145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:52.897181 17145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:52.897400 17145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:52.898052 17145 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:52.898977 17145 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:52.899026 17145 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:52.899067 17145 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:52.899123 17145 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:52.911473 17145 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:40803
I20260811 17:08:52.911495 17544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:40803 every 8 connection(s)
I20260811 17:08:52.912657 17145 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:08:52.918646 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 17145
I20260811 17:08:52.918900 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 16155
Aug 11 17:08:52 dist-test-slave-7vjv krb5kdc[15729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468132, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.253@KRBTEST.COM
Aug 11 17:08:52 dist-test-slave-7vjv krb5kdc[15729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468132, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.252@KRBTEST.COM
I20260811 17:08:52.945225 17100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.914717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:52857 (local address 127.4.146.253:38667)
0811 17:08:52.914861 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:52.914864 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:52.916203 (+ 1339us) server_negotiation.cc:407] Connection header received
0811 17:08:52.917870 (+ 1667us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:52.917873 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:52.917935 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:52.918027 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:52.932539 (+ 14512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.933307 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.935327 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.935684 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.935772 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.939612 (+ 3840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:52.939616 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:52.939619 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:52.939653 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:52.941844 (+ 2191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.942858 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.942862 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.942864 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.942951 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.943411 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.943415 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.943416 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.943677 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:52.943763 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:52.944581 (+ 818us) server_negotiation.cc:299] Negotiation successful
0811 17:08:52.945013 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 17:08:52.947633 17553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.915519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:38667 (local address 127.4.146.193:52857)
0811 17:08:52.916015 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:52.916061 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:52.917240 (+ 1179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:52.918067 (+ 827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:52.918070 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:52.918515 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:52.932257 (+ 13742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.932295 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.933594 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.933600 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.935143 (+ 1543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.935160 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.936048 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.936054 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.936349 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.937282 (+ 933us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:52.937311 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:52.939374 (+ 2063us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:52.941998 (+ 2624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.942006 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.942028 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.942728 (+ 700us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.943073 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.943078 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.943079 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.943288 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.943842 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:52.943852 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:52.944259 (+ 407us) client_negotiation.cc:769] Sending connection context
0811 17:08:52.945792 (+ 1533us) client_negotiation.cc:240] Negotiation successful
0811 17:08:52.946280 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"mutex_wait_us":91,"spinlock_wait_cycles":16512,"thread_start_us":122,"threads_started":1}
I20260811 17:08:52.949862 17550 heartbeater.cc:347] Connected to a master server at 127.4.146.253:38667
I20260811 17:08:52.950093 17555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.916509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:41983 (local address 127.4.146.193:56935)
0811 17:08:52.916801 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:52.916817 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:52.917254 (+ 437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:52.917793 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:52.917801 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:52.918523 (+ 722us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:52.938848 (+ 20325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.938864 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.940349 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.940354 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.941304 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.941319 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.942027 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.942030 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.942136 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.942620 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:52.942635 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:52.944210 (+ 1575us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:52.946406 (+ 2196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.946409 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.946411 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.946683 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.947052 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.947055 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.947057 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.947189 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.947723 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:52.947726 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:52.947819 (+ 93us) client_negotiation.cc:769] Sending connection context
0811 17:08:52.947904 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 17:08:52.949893 (+ 1989us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"mutex_wait_us":11,"thread_start_us":110,"threads_started":1}
I20260811 17:08:52.950217 17550 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:52.950663 17556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.916687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:56935 (local address 127.4.146.252:41983)
0811 17:08:52.916961 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:52.916978 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:52.916997 (+ 19us) server_negotiation.cc:407] Connection header received
0811 17:08:52.917481 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:52.917484 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:52.917548 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:52.917661 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:52.939066 (+ 21405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.940192 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.941486 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.941876 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.942394 (+ 518us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.944370 (+ 1976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:52.944374 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:52.944376 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:52.944402 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:52.946284 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.946809 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.946812 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.946814 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.946894 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.947343 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.947346 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.947347 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.947560 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:52.950292 (+ 2732us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:52.950375 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 17:08:52.950527 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":82,"threads_started":1}
I20260811 17:08:52.951036 17550 heartbeater.cc:511] Master 127.4.146.253:38667 requested a full tablet report, sending...
I20260811 17:08:52.952946 16876 ts_manager.cc:194] Registered new tserver with Master: d2b5f5df53eb4066bb755b3b8b565a35 (127.4.146.193:40803)
I20260811 17:08:52.953187 17546 heartbeater.cc:347] Connected to a master server at 127.4.146.252:41983
I20260811 17:08:52.953299 17546 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:52.953557 17546 heartbeater.cc:511] Master 127.4.146.252:41983 requested a full tablet report, sending...
I20260811 17:08:52.954694 17209 ts_manager.cc:194] Registered new tserver with Master: d2b5f5df53eb4066bb755b3b8b565a35 (127.4.146.193:40803)
Aug 11 17:08:52 dist-test-slave-7vjv krb5kdc[15729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468132, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM
I20260811 17:08:52.964232 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:33863
--local_ip_for_outbound_sockets=127.4.146.194
--tserver_master_addrs=127.4.146.254:33377
--webserver_port=43865
--webserver_interface=127.4.146.194
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.194.keytab
--principal=oryx/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:38843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.4.146.254:33377,127.4.146.253:38667
--tserver_master_addrs=127.4.146.254:33377,127.4.146.253:38667,127.4.146.252:41983 with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 17:08:52.966487 15876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.917255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:42181 (local address 127.4.146.254:33377)
0811 17:08:52.917395 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:52.917401 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:52.917418 (+ 17us) server_negotiation.cc:407] Connection header received
0811 17:08:52.917465 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:52.917468 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:52.917516 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:52.917597 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:52.957308 (+ 39711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.958264 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.959092 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.959509 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.959639 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.962837 (+ 3198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:52.962845 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:52.962851 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:52.962892 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:52.964723 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.965201 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.965205 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.965207 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.965295 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:52.965594 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:52.965598 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:52.965600 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:52.965804 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:52.965919 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:52.966198 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 17:08:52.966323 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 17:08:52.966508 17557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:52.916871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.193:42181)
0811 17:08:52.917106 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:52.917120 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:52.917240 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:52.917789 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:52.917801 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:52.918518 (+ 717us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:52.957122 (+ 38604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.957139 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.958401 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.958404 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.958954 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:52.958963 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:52.959686 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:52.959690 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:52.959762 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:52.960361 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:52.960373 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:52.962653 (+ 2280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:52.964847 (+ 2194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.964850 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.964853 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.965088 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.965396 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:52.965399 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:52.965401 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:52.965492 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:52.965906 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:52.965910 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:52.966021 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 17:08:52.966140 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 17:08:52.966311 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":109,"thread_start_us":99,"threads_started":1}
I20260811 17:08:52.967196 17548 heartbeater.cc:347] Connected to a master server at 127.4.146.254:33377
I20260811 17:08:52.967334 17548 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:52.967555 17548 heartbeater.cc:511] Master 127.4.146.254:33377 requested a full tablet report, sending...
I20260811 17:08:52.968495 15802 ts_manager.cc:194] Re-registered known tserver with Master: d2b5f5df53eb4066bb755b3b8b565a35 (127.4.146.193:40803)
I20260811 17:08:52.969105 15802 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.146.193@KRBTEST.COM'} at 127.4.146.193:42181
I20260811 17:08:52.998739 16615 heartbeater.cc:503] Master 127.4.146.254:33377 was elected leader, sending a full tablet report...
W20260811 17:08:53.084868 17563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:53.085278 17563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:53.085368 17563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:53.089982 17563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:53.090097 17563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:53.090199 17563 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:08:53.095884 17563 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:38843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.194.keytab
--principal=oryx/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:33863
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=43865
--tserver_master_addrs=127.4.146.254:33377,127.4.146.253:38667,127.4.146.252:41983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17563
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:53.097126 17563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:53.098255 17563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:53.108978 17572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:53.109055 17563 server_base.cc:1034] running on GCE node
W20260811 17:08:53.108978 17573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:53.108984 17576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:53.109748 17563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:53.110503 17563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:53.111748 17563 hybrid_clock.cc:648] HybridClock initialized: now 1786468133111708 us; error 51 us; skew 500 ppm
Aug 11 17:08:53 dist-test-slave-7vjv krb5kdc[15729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468133, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:53.115123 17563 init.cc:377] Logged in from keytab as oryx/127.4.146.194@KRBTEST.COM (short username oryx)
I20260811 17:08:53.116241 17563 webserver.cc:460] Webserver started at http://127.4.146.194:43865/ using document root <none> and password file <none>
I20260811 17:08:53.116904 17563 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:53.117030 17563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:53.121924 17563 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 17:08:53.124703 17589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:53.126226 17563 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:08:53.126394 17563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "49d7274ea3144adea1f4e9e5e05b7b5d"
format_stamp: "Formatted at 2026-08-11 17:08:51 on dist-test-slave-7vjv"
server_key: "f527ca0de720e81fb0a2fd7c7c056f1e"
server_key_iv: "981c24c1700b55d0a3233e0e6a9e3f2c"
server_key_version: "encryptionkey@0"
I20260811 17:08:53.127067 17563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:53.144788 17563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:53.148288 16788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.144028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:41983 (local address 127.0.0.1:51256)
0811 17:08:53.144235 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:53.144253 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:53.144364 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:53.144673 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:53.144675 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:53.144694 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:53.144784 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:53.144789 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.145861 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.145867 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:53.146764 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:53.146776 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.147770 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.147774 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:53.147895 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.147919 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 17:08:53.147976 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 17:08:53.148092 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102}
I20260811 17:08:53.148346 17556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.144176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51256 (local address 127.4.146.252:41983)
0811 17:08:53.144341 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:53.144347 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:53.144367 (+ 20us) server_negotiation.cc:407] Connection header received
0811 17:08:53.144454 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:53.144457 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:53.144521 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:53.144635 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:53.144915 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.145723 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.146898 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.147626 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.147781 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.147999 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:53.148041 (+ 42us) server_negotiation.cc:299] Negotiation successful
0811 17:08:53.148188 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 17:08:53.149427 17563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:53.149407 17235 raft_consensus.cc:1203] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260811 17:08:53.149641 17563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:53.149947 17285 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f5901df9ec846ffb312adf8fe316c86. Latest consensus state: current_term: 1 leader_uuid: "4f5901df9ec846ffb312adf8fe316c86" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: NON_VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: true } } }
I20260811 17:08:53.150091 17285 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [sys.catalog]: This master's current role is: LEARNER
I20260811 17:08:53.150417 17563 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:53.151580 17563 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:53.151644 17563 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:53.151705 17563 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:53.151736 17563 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:53.161664 17563 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:33863
I20260811 17:08:53.161689 17791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:33863 every 8 connection(s)
I20260811 17:08:53.162782 17563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:08:53.172953 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 17563
I20260811 17:08:53.173146 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 16393
Aug 11 17:08:53 dist-test-slave-7vjv krb5kdc[15729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468133, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.252@KRBTEST.COM
Aug 11 17:08:53 dist-test-slave-7vjv krb5kdc[15729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468133, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM
Aug 11 17:08:53 dist-test-slave-7vjv krb5kdc[15729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468133, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.253@KRBTEST.COM
I20260811 17:08:53.181231 17556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.167322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:52295 (local address 127.4.146.252:41983)
0811 17:08:53.167477 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:53.167483 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:53.167501 (+ 18us) server_negotiation.cc:407] Connection header received
0811 17:08:53.167568 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:53.167572 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:53.167630 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:53.167715 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:53.169458 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.170007 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.171240 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.171471 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.171590 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.175754 (+ 4164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:53.175759 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:53.175764 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:53.175808 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:53.178079 (+ 2271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.179055 (+ 976us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.179059 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.179061 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.179177 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.179673 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.179688 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.179690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.179934 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:53.180011 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:53.180904 (+ 893us) server_negotiation.cc:299] Negotiation successful
0811 17:08:53.181054 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 17:08:53.181231 15876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.164823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:45841 (local address 127.4.146.254:33377)
0811 17:08:53.164988 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:53.164997 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:53.166345 (+ 1348us) server_negotiation.cc:407] Connection header received
0811 17:08:53.168013 (+ 1668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:53.168017 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:53.168119 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:53.168215 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:53.169474 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.170298 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.171813 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.172259 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.172347 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.175313 (+ 2966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:53.175317 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:53.175320 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:53.175353 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:53.178098 (+ 2745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.179060 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.179064 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.179065 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.179177 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.179673 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.179688 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.179690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.179934 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:53.180016 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:53.180904 (+ 888us) server_negotiation.cc:299] Negotiation successful
0811 17:08:53.181054 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 17:08:53.181357 17100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.166703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:45615 (local address 127.4.146.253:38667)
0811 17:08:53.166828 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:53.166832 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:53.166966 (+ 134us) server_negotiation.cc:407] Connection header received
0811 17:08:53.167664 (+ 698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:53.167667 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:53.167726 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:53.167810 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:53.169474 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.170297 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.172495 (+ 2198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.172900 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.173018 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.175806 (+ 2788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:53.175813 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:53.175819 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:53.175859 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:53.178073 (+ 2214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.179117 (+ 1044us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.179124 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.179129 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.179242 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.179716 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.179723 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.179727 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.180058 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:53.180181 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:53.180926 (+ 745us) server_negotiation.cc:299] Negotiation successful
0811 17:08:53.181105 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 17:08:53.183300 17802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.165599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.194:45841)
0811 17:08:53.166158 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:53.166208 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:53.167832 (+ 1624us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:53.168247 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:53.168249 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:53.168612 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:53.169303 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:53.169312 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.170454 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.170458 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:53.171627 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:53.171639 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.172383 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.172389 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:53.172565 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.173164 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:53.173185 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:53.175085 (+ 1900us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:53.178233 (+ 3148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:53.178240 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:53.178263 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:53.178918 (+ 655us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:53.179292 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:53.179295 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:53.179297 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:53.179548 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:53.180127 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:53.180134 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:53.180586 (+ 452us) client_negotiation.cc:769] Sending connection context
0811 17:08:53.181478 (+ 892us) client_negotiation.cc:240] Negotiation successful
0811 17:08:53.182015 (+ 537us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"mutex_wait_us":332,"spinlock_wait_cycles":43904,"thread_start_us":121,"threads_started":1}
I20260811 17:08:53.183303 17804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.166560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:38667 (local address 127.4.146.194:45615)
0811 17:08:53.166871 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:53.166888 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:53.167386 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:53.167899 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:53.167912 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:53.168612 (+ 700us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:53.169303 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:53.169312 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.170454 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.170458 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:53.171630 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:53.171639 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.173189 (+ 1550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.173196 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:53.173333 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.173879 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:53.173901 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:53.175602 (+ 1701us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:53.178240 (+ 2638us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:53.178247 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:53.178265 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:53.178956 (+ 691us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:53.179383 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:53.179389 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:53.179393 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:53.179557 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:53.180272 (+ 715us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:53.180277 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:53.180590 (+ 313us) client_negotiation.cc:769] Sending connection context
0811 17:08:53.181604 (+ 1014us) client_negotiation.cc:240] Negotiation successful
0811 17:08:53.182202 (+ 598us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"mutex_wait_us":463,"spinlock_wait_cycles":119296,"thread_start_us":103,"threads_started":1}
I20260811 17:08:53.183593 17805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.166972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:41983 (local address 127.4.146.194:52295)
0811 17:08:53.167246 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:53.167260 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:53.167372 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:53.167900 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:53.167910 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:53.168607 (+ 697us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:53.169291 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:53.169307 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.170177 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.170185 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:53.171095 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:53.171105 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.171642 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.171646 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:53.171870 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.172641 (+ 771us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:53.172666 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:53.175569 (+ 2903us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:53.178233 (+ 2664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:53.178240 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:53.178263 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:53.178937 (+ 674us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:53.179293 (+ 356us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:53.179295 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:53.179297 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:53.179548 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:53.180127 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:53.180134 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:53.180586 (+ 452us) client_negotiation.cc:769] Sending connection context
0811 17:08:53.181478 (+ 892us) client_negotiation.cc:240] Negotiation successful
0811 17:08:53.182072 (+ 594us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":405,"spinlock_wait_cycles":59520,"thread_start_us":128,"threads_started":1}
I20260811 17:08:53.184959 17795 heartbeater.cc:347] Connected to a master server at 127.4.146.252:41983
I20260811 17:08:53.185118 17796 heartbeater.cc:347] Connected to a master server at 127.4.146.254:33377
I20260811 17:08:53.185086 17798 heartbeater.cc:347] Connected to a master server at 127.4.146.253:38667
I20260811 17:08:53.185259 17795 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:53.185307 17798 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:53.185259 17796 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:53.185989 17795 heartbeater.cc:511] Master 127.4.146.252:41983 requested a full tablet report, sending...
I20260811 17:08:53.186030 17798 heartbeater.cc:511] Master 127.4.146.253:38667 requested a full tablet report, sending...
I20260811 17:08:53.185990 17796 heartbeater.cc:511] Master 127.4.146.254:33377 requested a full tablet report, sending...
I20260811 17:08:53.187417 17209 ts_manager.cc:194] Registered new tserver with Master: 49d7274ea3144adea1f4e9e5e05b7b5d (127.4.146.194:33863)
I20260811 17:08:53.187700 16876 ts_manager.cc:194] Registered new tserver with Master: 49d7274ea3144adea1f4e9e5e05b7b5d (127.4.146.194:33863)
I20260811 17:08:53.187901 15802 ts_manager.cc:194] Re-registered known tserver with Master: 49d7274ea3144adea1f4e9e5e05b7b5d (127.4.146.194:33863)
I20260811 17:08:53.188730 15802 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.146.194@KRBTEST.COM'} at 127.4.146.194:45841
I20260811 17:08:53.201892 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:38683
--local_ip_for_outbound_sockets=127.4.146.195
--tserver_master_addrs=127.4.146.254:33377
--webserver_port=37611
--webserver_interface=127.4.146.195
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.195.keytab
--principal=oryx/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:38843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.4.146.254:33377,127.4.146.253:38667
--tserver_master_addrs=127.4.146.254:33377,127.4.146.253:38667,127.4.146.252:41983 with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:53.322605 17807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:53.322921 17807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:53.322968 17807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:53.327229 17807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:53.327311 17807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:53.327376 17807 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:08:53.333298 17807 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:38843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.195.keytab
--principal=oryx/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:38683
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=37611
--tserver_master_addrs=127.4.146.254:33377,127.4.146.253:38667,127.4.146.252:41983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17807
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:53.334430 17807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:53.335675 17807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:53.346055 17817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:53.346055 17814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:53.346117 17807 server_base.cc:1034] running on GCE node
W20260811 17:08:53.346021 17819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:53.346772 17807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:53.347564 17807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:53.348762 17807 hybrid_clock.cc:648] HybridClock initialized: now 1786468133348745 us; error 30 us; skew 500 ppm
Aug 11 17:08:53 dist-test-slave-7vjv krb5kdc[15729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468133, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:53.351897 17807 init.cc:377] Logged in from keytab as oryx/127.4.146.195@KRBTEST.COM (short username oryx)
I20260811 17:08:53.352972 17807 webserver.cc:460] Webserver started at http://127.4.146.195:37611/ using document root <none> and password file <none>
I20260811 17:08:53.353530 17807 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:53.353611 17807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:53.357698 17807 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260811 17:08:53.359947 17835 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:53.361395 17807 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 17:08:53.361555 17807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d"
format_stamp: "Formatted at 2026-08-11 17:08:51 on dist-test-slave-7vjv"
server_key: "a4460d721d13b8308c5a08407e7ee24b"
server_key_iv: "a5724671e1219e15b02f66c1aba10308"
server_key_version: "encryptionkey@0"
I20260811 17:08:53.362130 17807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:53.378751 17807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:53.382493 17807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:53.382670 17807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:53.383258 17807 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:08:53.384198 17807 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:53.384253 17807 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:53.384296 17807 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:53.384351 17807 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:53.394246 17807 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:38683
I20260811 17:08:53.394271 18032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:38683 every 8 connection(s)
I20260811 17:08:53.395330 17807 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:08:53.400390 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 17807
Aug 11 17:08:53 dist-test-slave-7vjv krb5kdc[15729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468133, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.252@KRBTEST.COM
Aug 11 17:08:53 dist-test-slave-7vjv krb5kdc[15729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468133, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM
Aug 11 17:08:53 dist-test-slave-7vjv krb5kdc[15729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468133, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.253@KRBTEST.COM
I20260811 17:08:53.416992 17100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.399714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:52033 (local address 127.4.146.253:38667)
0811 17:08:53.399854 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:53.399861 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:53.400005 (+ 144us) server_negotiation.cc:407] Connection header received
0811 17:08:53.400213 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:53.400216 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:53.400265 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:53.400320 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:53.405167 (+ 4847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.405893 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.407368 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.407694 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.407786 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.410125 (+ 2339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:53.410131 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:53.410136 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:53.410165 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:53.412308 (+ 2143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.413671 (+ 1363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.413675 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.413678 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.413887 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.414439 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.414444 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.414446 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.414737 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:53.414859 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:53.416256 (+ 1397us) server_negotiation.cc:299] Negotiation successful
0811 17:08:53.416798 (+ 542us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 17:08:53.419184 18044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.399486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:38667 (local address 127.4.146.195:52033)
0811 17:08:53.399912 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:53.399926 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:53.400016 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:53.400507 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:53.400517 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:53.401199 (+ 682us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:53.401985 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:53.402007 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.406333 (+ 4326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.406339 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:53.407243 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:53.407256 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.407902 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.407906 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:53.407993 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.408478 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:53.408493 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:53.409991 (+ 1498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:53.412445 (+ 2454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:53.412452 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:53.412473 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:53.413471 (+ 998us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:53.414036 (+ 565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:53.414040 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:53.414042 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:53.414295 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:53.415058 (+ 763us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:53.415066 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:53.415418 (+ 352us) client_negotiation.cc:769] Sending connection context
0811 17:08:53.415715 (+ 297us) client_negotiation.cc:240] Negotiation successful
0811 17:08:53.417486 (+ 1771us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"mutex_wait_us":124,"spinlock_wait_cycles":23424,"thread_start_us":88,"threads_started":1}
I20260811 17:08:53.420588 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.403226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58492 (local address 127.4.146.253:38667)
0811 17:08:53.405229 (+ 2003us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:53.405233 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:53.406000 (+ 767us) server_negotiation.cc:407] Connection header received
0811 17:08:53.406193 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:53.406196 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:53.406251 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:53.406357 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:53.407289 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.408021 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.409332 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.409731 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.409807 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.412183 (+ 2376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:53.412186 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:53.412189 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:53.412217 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:53.416586 (+ 4369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.418931 (+ 2345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.418937 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.418942 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.419044 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.419391 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.419395 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.419397 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.419659 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:53.419799 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:53.420210 (+ 411us) server_negotiation.cc:299] Negotiation successful
0811 17:08:53.420349 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1928,"thread_start_us":92,"threads_started":1}
I20260811 17:08:53.420745 15876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.397286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:55265 (local address 127.4.146.254:33377)
0811 17:08:53.397427 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:53.397431 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:53.398775 (+ 1344us) server_negotiation.cc:407] Connection header received
0811 17:08:53.399913 (+ 1138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:53.399919 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:53.399989 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:53.400049 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:53.402326 (+ 2277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.403186 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.405165 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.405521 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.405631 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.409725 (+ 4094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:53.409729 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:53.409732 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:53.409761 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:53.415536 (+ 5775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.418080 (+ 2544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.418084 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.418086 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.418191 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.418558 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.418561 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.418563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.418801 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:53.418923 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:53.420454 (+ 1531us) server_negotiation.cc:299] Negotiation successful
0811 17:08:53.420582 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 17:08:53.422196 18061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.406108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57654 (local address 127.4.146.254:33377)
0811 17:08:53.410387 (+ 4279us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:53.410394 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:53.410408 (+ 14us) server_negotiation.cc:407] Connection header received
0811 17:08:53.410442 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:53.410445 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:53.410492 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:53.410960 (+ 468us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:53.411786 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.412760 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.414247 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.414872 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.415067 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.417202 (+ 2135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:53.417209 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:53.417212 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:53.417244 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:53.419721 (+ 2477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.420403 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.420407 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.420409 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.420522 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.421022 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.421028 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.421032 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.421286 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:53.421507 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:53.421931 (+ 424us) server_negotiation.cc:299] Negotiation successful
0811 17:08:53.422080 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":80,"threads_started":1}
I20260811 17:08:53.420311 18040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.398103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.195:55265)
0811 17:08:53.398573 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:53.398638 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:53.399637 (+ 999us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:53.400507 (+ 870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:53.400517 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:53.401177 (+ 660us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:53.402115 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:53.402132 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.403418 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.403421 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:53.405001 (+ 1580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:53.405014 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.405821 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.405827 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:53.406814 (+ 987us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.407334 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:53.407349 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:53.409517 (+ 2168us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:53.417627 (+ 8110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:53.417632 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:53.417635 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:53.417935 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:53.418308 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:53.418312 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:53.418314 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:53.418403 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:53.419671 (+ 1268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:53.419674 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:53.419796 (+ 122us) client_negotiation.cc:769] Sending connection context
0811 17:08:53.419912 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 17:08:53.420087 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"mutex_wait_us":831,"spinlock_wait_cycles":14848,"thread_start_us":126,"threads_started":1}
I20260811 17:08:53.423269 18036 heartbeater.cc:347] Connected to a master server at 127.4.146.253:38667
I20260811 17:08:53.423538 18036 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:53.423940 18034 heartbeater.cc:347] Connected to a master server at 127.4.146.254:33377
I20260811 17:08:53.424064 18034 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:53.424219 18036 heartbeater.cc:511] Master 127.4.146.253:38667 requested a full tablet report, sending...
I20260811 17:08:53.424316 18034 heartbeater.cc:511] Master 127.4.146.254:33377 requested a full tablet report, sending...
I20260811 17:08:53.425498 15800 ts_manager.cc:194] Re-registered known tserver with Master: 2ed2b3fcda594ac59a3c9a7f15f70a5d (127.4.146.195:38683)
I20260811 17:08:53.425729 18041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.399077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:41983 (local address 127.4.146.195:32939)
0811 17:08:53.399375 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:53.399391 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:53.399643 (+ 252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:53.400613 (+ 970us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:53.400618 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:53.401208 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:53.402218 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:53.402226 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.403820 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.403826 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:53.405168 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:53.405179 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.405869 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.405872 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:53.406156 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.406831 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:53.406854 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:53.409517 (+ 2663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:53.420389 (+ 10872us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:53.420393 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:53.420395 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:53.420754 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:53.421939 (+ 1185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:53.421945 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:53.421950 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:53.422059 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:53.424819 (+ 2760us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:53.424823 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:53.425160 (+ 337us) client_negotiation.cc:769] Sending connection context
0811 17:08:53.425280 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 17:08:53.425464 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"mutex_wait_us":93,"spinlock_wait_cycles":7936,"thread_start_us":104,"threads_started":1}
I20260811 17:08:53.426046 18057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.403895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51262 (local address 127.4.146.252:41983)
0811 17:08:53.405371 (+ 1476us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:53.405375 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:53.409044 (+ 3669us) server_negotiation.cc:407] Connection header received
0811 17:08:53.410284 (+ 1240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:53.410290 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:53.410349 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:53.410418 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:53.411359 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.412218 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.413793 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.414290 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.414392 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.416870 (+ 2478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:53.416874 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:53.416877 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:53.416909 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:53.420210 (+ 3301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.422955 (+ 2745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.422959 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.422961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.423075 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.423477 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.423482 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.423483 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.423760 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:53.423889 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:53.425665 (+ 1776us) server_negotiation.cc:299] Negotiation successful
0811 17:08:53.425836 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1403,"thread_start_us":92,"threads_started":1}
I20260811 17:08:53.426236 15800 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.146.195@KRBTEST.COM'} at 127.4.146.195:55265
I20260811 17:08:53.426352 17556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.399221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:32939 (local address 127.4.146.252:41983)
0811 17:08:53.399356 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:53.399360 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:53.399473 (+ 113us) server_negotiation.cc:407] Connection header received
0811 17:08:53.399903 (+ 430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:53.399907 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:53.399966 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:53.400046 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:53.402368 (+ 2322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.403655 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.405325 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.405666 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.405761 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.409725 (+ 3964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:53.409729 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:53.409732 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:53.409761 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:53.419888 (+ 10127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.421710 (+ 1822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.421713 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.421714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.421807 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.424001 (+ 2194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.424020 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.424022 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.424305 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:53.425911 (+ 1606us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:53.426031 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 17:08:53.426167 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 17:08:53.427043 16876 ts_manager.cc:194] Registered new tserver with Master: 2ed2b3fcda594ac59a3c9a7f15f70a5d (127.4.146.195:38683)
I20260811 17:08:53.427477 18033 heartbeater.cc:347] Connected to a master server at 127.4.146.252:41983
I20260811 17:08:53.427572 18033 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:53.427732 18033 heartbeater.cc:511] Master 127.4.146.252:41983 requested a full tablet report, sending...
I20260811 17:08:53.426173 15802 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57654:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 17:08:53.429247 17209 ts_manager.cc:194] Registered new tserver with Master: 2ed2b3fcda594ac59a3c9a7f15f70a5d (127.4.146.195:38683)
W20260811 17:08:53.430032 15802 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:08:53.432616 17165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4f5901df9ec846ffb312adf8fe316c86" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: NON_VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: true } } }
I20260811 17:08:53.432739 17165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:53.436538 17165 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86: attempting to promote NON_VOTER fc10f7924b6d409487c977b1c274d7ff to VOTER
I20260811 17:08:53.436857 17165 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: false } }
I20260811 17:08:53.440161 16892 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 1 FOLLOWER]: Refusing update from remote peer 4f5901df9ec846ffb312adf8fe316c86: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 17:08:53.440375 17236 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 1 LEARNER]: Refusing update from remote peer 4f5901df9ec846ffb312adf8fe316c86: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 17:08:53.440738 17165 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 17:08:53.441035 17165 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 17:08:53.443002 17165 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, fc10f7924b6d409487c977b1c274d7ff (127.4.146.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: false } } }
I20260811 17:08:53.443280 16892 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, fc10f7924b6d409487c977b1c274d7ff (127.4.146.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: false } } }
I20260811 17:08:53.444382 17236 raft_consensus.cc:2932] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, fc10f7924b6d409487c977b1c274d7ff (127.4.146.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: false } } }
I20260811 17:08:53.445148 18081 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4f5901df9ec846ffb312adf8fe316c86" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: false } } }
I20260811 17:08:53.445354 18081 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:08:53.445673 18079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "4f5901df9ec846ffb312adf8fe316c86" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: false } } }
I20260811 17:08:53.445803 18079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:53.446004 17165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4f5901df9ec846ffb312adf8fe316c86" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: false } } }
I20260811 17:08:53.446035 18079 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4f5901df9ec846ffb312adf8fe316c86" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: false } } }
I20260811 17:08:53.446106 17165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:53.446116 18079 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:53.447197 17285 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4f5901df9ec846ffb312adf8fe316c86" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: false } } }
I20260811 17:08:53.447327 17285 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:08:53.453679 16788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.448053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:40803 (local address 127.0.0.1:41716)
0811 17:08:53.448215 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:53.448232 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:53.448323 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:53.449192 (+ 869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:53.449195 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:53.449208 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:53.449349 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:53.449356 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.451102 (+ 1746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.451107 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:53.452012 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:53.452022 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.453286 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.453290 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:53.453379 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.453409 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 17:08:53.453459 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 17:08:53.453545 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260811 17:08:53.454378 18082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.448289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41716 (local address 127.4.146.193:40803)
0811 17:08:53.448570 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:53.448590 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:53.448615 (+ 25us) server_negotiation.cc:407] Connection header received
0811 17:08:53.448696 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:53.448700 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:53.448995 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:53.449764 (+ 769us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:53.449908 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.450979 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.452166 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.453143 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.454002 (+ 859us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.454154 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:53.454200 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 17:08:53.454276 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":116,"threads_started":1}
I20260811 17:08:53.455054 18083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.448770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:38683 (local address 127.0.0.1:53612)
0811 17:08:53.449099 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:53.449115 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:53.449205 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:53.450706 (+ 1501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:53.450709 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:53.450728 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:53.450820 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:53.450825 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.452334 (+ 1509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.452338 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:53.453442 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:53.453453 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.454667 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.454670 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:53.454758 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.454783 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 17:08:53.454860 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 17:08:53.454928 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"mutex_wait_us":1,"thread_start_us":152,"threads_started":1}
I20260811 17:08:53.455155 18084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.449006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53612 (local address 127.4.146.195:38683)
0811 17:08:53.450148 (+ 1142us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:53.450161 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:53.450184 (+ 23us) server_negotiation.cc:407] Connection header received
0811 17:08:53.450252 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:53.450258 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:53.450492 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:53.450742 (+ 250us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:53.450914 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.452214 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.453642 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.454508 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.454614 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.454752 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:53.454889 (+ 137us) server_negotiation.cc:299] Negotiation successful
0811 17:08:53.454988 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1041,"thread_start_us":192,"threads_started":1}
I20260811 17:08:53.456084 18086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.449161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:33863 (local address 127.0.0.1:34016)
0811 17:08:53.449411 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:53.449426 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:53.449711 (+ 285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:53.450827 (+ 1116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:53.450830 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:53.450851 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:53.450983 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:53.450991 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.452614 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.452617 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:53.454252 (+ 1635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:53.454263 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.455656 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.455660 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:53.455756 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.455780 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 17:08:53.455868 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 17:08:53.455940 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":114,"threads_started":1}
I20260811 17:08:53.456182 18088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.449630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34016 (local address 127.4.146.194:33863)
0811 17:08:53.450122 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:53.450135 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:53.450164 (+ 29us) server_negotiation.cc:407] Connection header received
0811 17:08:53.450251 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:53.450258 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:53.450486 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:53.450660 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:53.451154 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.452444 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.454411 (+ 1967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.455335 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.455449 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.455585 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:53.455916 (+ 331us) server_negotiation.cc:299] Negotiation successful
0811 17:08:53.456002 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":125,"threads_started":1}
I20260811 17:08:53.458032 17427 tablet_service.cc:1467] Processing CreateTablet for tablet 214bc0f26512422d8dabaa8f5928540a (DEFAULT_TABLE table=test-table [id=7ed6ea53fd80407b8f2494bdccbccd15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:53.458695 17684 tablet_service.cc:1467] Processing CreateTablet for tablet 214bc0f26512422d8dabaa8f5928540a (DEFAULT_TABLE table=test-table [id=7ed6ea53fd80407b8f2494bdccbccd15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:53.459152 17427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 214bc0f26512422d8dabaa8f5928540a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:53.459496 17684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 214bc0f26512422d8dabaa8f5928540a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:53.462800 17920 tablet_service.cc:1467] Processing CreateTablet for tablet 214bc0f26512422d8dabaa8f5928540a (DEFAULT_TABLE table=test-table [id=7ed6ea53fd80407b8f2494bdccbccd15]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:53.463850 17920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 214bc0f26512422d8dabaa8f5928540a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:53.470670 18090 tablet_bootstrap.cc:492] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35: Bootstrap starting.
I20260811 17:08:53.471249 18089 tablet_bootstrap.cc:492] T 214bc0f26512422d8dabaa8f5928540a P 49d7274ea3144adea1f4e9e5e05b7b5d: Bootstrap starting.
I20260811 17:08:53.471935 18091 tablet_bootstrap.cc:492] T 214bc0f26512422d8dabaa8f5928540a P 2ed2b3fcda594ac59a3c9a7f15f70a5d: Bootstrap starting.
I20260811 17:08:53.473340 18090 tablet_bootstrap.cc:654] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:53.473508 18089 tablet_bootstrap.cc:654] T 214bc0f26512422d8dabaa8f5928540a P 49d7274ea3144adea1f4e9e5e05b7b5d: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:53.474236 18090 log.cc:824] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:53.474354 18089 log.cc:824] T 214bc0f26512422d8dabaa8f5928540a P 49d7274ea3144adea1f4e9e5e05b7b5d: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:53.474622 18091 tablet_bootstrap.cc:654] T 214bc0f26512422d8dabaa8f5928540a P 2ed2b3fcda594ac59a3c9a7f15f70a5d: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:53.475371 18091 log.cc:824] T 214bc0f26512422d8dabaa8f5928540a P 2ed2b3fcda594ac59a3c9a7f15f70a5d: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:53.476919 18089 tablet_bootstrap.cc:492] T 214bc0f26512422d8dabaa8f5928540a P 49d7274ea3144adea1f4e9e5e05b7b5d: No bootstrap required, opened a new log
I20260811 17:08:53.476919 18090 tablet_bootstrap.cc:492] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35: No bootstrap required, opened a new log
I20260811 17:08:53.477142 18089 ts_tablet_manager.cc:1397] T 214bc0f26512422d8dabaa8f5928540a P 49d7274ea3144adea1f4e9e5e05b7b5d: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260811 17:08:53.477142 18090 ts_tablet_manager.cc:1397] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 17:08:53.477744 18091 tablet_bootstrap.cc:492] T 214bc0f26512422d8dabaa8f5928540a P 2ed2b3fcda594ac59a3c9a7f15f70a5d: No bootstrap required, opened a new log
I20260811 17:08:53.477947 18091 ts_tablet_manager.cc:1397] T 214bc0f26512422d8dabaa8f5928540a P 2ed2b3fcda594ac59a3c9a7f15f70a5d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 17:08:53.481401 18091 raft_consensus.cc:348] T 214bc0f26512422d8dabaa8f5928540a P 2ed2b3fcda594ac59a3c9a7f15f70a5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40803 } } peers { permanent_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 38683 } } peers { permanent_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 33863 } }
I20260811 17:08:53.481417 18090 raft_consensus.cc:348] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40803 } } peers { permanent_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 38683 } } peers { permanent_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 33863 } }
I20260811 17:08:53.481673 18091 raft_consensus.cc:374] T 214bc0f26512422d8dabaa8f5928540a P 2ed2b3fcda594ac59a3c9a7f15f70a5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:53.481693 18090 raft_consensus.cc:374] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:53.481730 18091 raft_consensus.cc:729] T 214bc0f26512422d8dabaa8f5928540a P 2ed2b3fcda594ac59a3c9a7f15f70a5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ed2b3fcda594ac59a3c9a7f15f70a5d, State: Initialized, Role: FOLLOWER
I20260811 17:08:53.481755 18090 raft_consensus.cc:729] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2b5f5df53eb4066bb755b3b8b565a35, State: Initialized, Role: FOLLOWER
I20260811 17:08:53.481830 18089 raft_consensus.cc:348] T 214bc0f26512422d8dabaa8f5928540a P 49d7274ea3144adea1f4e9e5e05b7b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40803 } } peers { permanent_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 38683 } } peers { permanent_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 33863 } }
I20260811 17:08:53.482087 18089 raft_consensus.cc:374] T 214bc0f26512422d8dabaa8f5928540a P 49d7274ea3144adea1f4e9e5e05b7b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:53.482147 18089 raft_consensus.cc:729] T 214bc0f26512422d8dabaa8f5928540a P 49d7274ea3144adea1f4e9e5e05b7b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49d7274ea3144adea1f4e9e5e05b7b5d, State: Initialized, Role: FOLLOWER
I20260811 17:08:53.482266 18090 consensus_queue.cc:260] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40803 } } peers { permanent_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 38683 } } peers { permanent_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 33863 } }
I20260811 17:08:53.482280 18091 consensus_queue.cc:260] T 214bc0f26512422d8dabaa8f5928540a P 2ed2b3fcda594ac59a3c9a7f15f70a5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40803 } } peers { permanent_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 38683 } } peers { permanent_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 33863 } }
I20260811 17:08:53.482566 18089 consensus_queue.cc:260] T 214bc0f26512422d8dabaa8f5928540a P 49d7274ea3144adea1f4e9e5e05b7b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40803 } } peers { permanent_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 38683 } } peers { permanent_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 33863 } }
I20260811 17:08:53.483376 18090 ts_tablet_manager.cc:1428] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 17:08:53.483392 18089 ts_tablet_manager.cc:1428] T 214bc0f26512422d8dabaa8f5928540a P 49d7274ea3144adea1f4e9e5e05b7b5d: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260811 17:08:53.483793 17796 heartbeater.cc:503] Master 127.4.146.254:33377 was elected leader, sending a full tablet report...
I20260811 17:08:53.485369 17548 heartbeater.cc:503] Master 127.4.146.254:33377 was elected leader, sending a full tablet report...
I20260811 17:08:53.487696 18091 ts_tablet_manager.cc:1428] T 214bc0f26512422d8dabaa8f5928540a P 2ed2b3fcda594ac59a3c9a7f15f70a5d: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260811 17:08:53.489033 18034 heartbeater.cc:503] Master 127.4.146.254:33377 was elected leader, sending a full tablet report...
W20260811 17:08:53.646806 18039 tablet.cc:2369] T 214bc0f26512422d8dabaa8f5928540a P 2ed2b3fcda594ac59a3c9a7f15f70a5d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 17:08:53.665020 17800 tablet.cc:2369] T 214bc0f26512422d8dabaa8f5928540a P 49d7274ea3144adea1f4e9e5e05b7b5d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 17:08:53.665292 17551 tablet.cc:2369] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 17:08:53.680456 18098 raft_consensus.cc:482] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:08:53.680734 18098 raft_consensus.cc:504] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40803 } } peers { permanent_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 38683 } } peers { permanent_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 33863 } }
I20260811 17:08:53.681923 18098 leader_election.cc:288] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ed2b3fcda594ac59a3c9a7f15f70a5d (127.4.146.195:38683), 49d7274ea3144adea1f4e9e5e05b7b5d (127.4.146.194:33863)
I20260811 17:08:53.686601 18084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.682408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:40985 (local address 127.4.146.195:38683)
0811 17:08:53.682582 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:53.682589 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:53.682744 (+ 155us) server_negotiation.cc:407] Connection header received
0811 17:08:53.682913 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:53.682917 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:53.682987 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:53.683078 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:53.683488 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.684263 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.685406 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.685953 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.686048 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.686092 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:53.686340 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 17:08:53.686454 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 17:08:53.686620 18104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.682289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:38683 (local address 127.4.146.193:40985)
0811 17:08:53.682635 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:53.682648 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:53.682768 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:53.683159 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:53.683163 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:53.683192 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:53.683298 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:53.683323 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.684383 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.684386 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:53.685258 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:53.685267 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.686067 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.686070 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:53.686202 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.686230 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 17:08:53.686310 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 17:08:53.686393 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":170,"threads_started":1}
I20260811 17:08:53.686946 18105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.682894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:33863 (local address 127.4.146.193:58697)
0811 17:08:53.683250 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:53.683261 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:53.683353 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:53.683624 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:53.683627 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:53.683645 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:53.683750 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:53.683755 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.684787 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.684789 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:53.685680 (+ 891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:53.685690 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.686445 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.686449 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:53.686565 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.686589 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 17:08:53.686681 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 17:08:53.686749 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":100,"threads_started":1}
I20260811 17:08:53.687336 18088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.683001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:58697 (local address 127.4.146.194:33863)
0811 17:08:53.683129 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:53.683134 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:53.683335 (+ 201us) server_negotiation.cc:407] Connection header received
0811 17:08:53.683477 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:53.683480 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:53.683521 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:53.683589 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:53.683917 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.684632 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.685798 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.686320 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.686428 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.686473 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:53.687152 (+ 679us) server_negotiation.cc:299] Negotiation successful
0811 17:08:53.687221 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 17:08:53.687371 17954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214bc0f26512422d8dabaa8f5928540a" candidate_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" is_pre_election: true
I20260811 17:08:53.687723 17954 raft_consensus.cc:2454] T 214bc0f26512422d8dabaa8f5928540a P 2ed2b3fcda594ac59a3c9a7f15f70a5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2b5f5df53eb4066bb755b3b8b565a35 in term 0.
I20260811 17:08:53.687912 17722 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214bc0f26512422d8dabaa8f5928540a" candidate_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d" is_pre_election: true
I20260811 17:08:53.688231 17722 raft_consensus.cc:2454] T 214bc0f26512422d8dabaa8f5928540a P 49d7274ea3144adea1f4e9e5e05b7b5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d2b5f5df53eb4066bb755b3b8b565a35 in term 0.
I20260811 17:08:53.688284 17335 leader_election.cc:302] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ed2b3fcda594ac59a3c9a7f15f70a5d, d2b5f5df53eb4066bb755b3b8b565a35; no voters:
I20260811 17:08:53.688614 18098 raft_consensus.cc:2781] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:08:53.688707 18098 raft_consensus.cc:482] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:08:53.688753 18098 raft_consensus.cc:3037] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:53.689821 18098 raft_consensus.cc:504] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40803 } } peers { permanent_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 38683 } } peers { permanent_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 33863 } }
I20260811 17:08:53.690151 18098 leader_election.cc:288] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35 [CANDIDATE]: Term 1 election: Requested vote from peers 2ed2b3fcda594ac59a3c9a7f15f70a5d (127.4.146.195:38683), 49d7274ea3144adea1f4e9e5e05b7b5d (127.4.146.194:33863)
I20260811 17:08:53.690523 17954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214bc0f26512422d8dabaa8f5928540a" candidate_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d"
I20260811 17:08:53.690553 17722 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "214bc0f26512422d8dabaa8f5928540a" candidate_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d"
I20260811 17:08:53.690672 17954 raft_consensus.cc:3037] T 214bc0f26512422d8dabaa8f5928540a P 2ed2b3fcda594ac59a3c9a7f15f70a5d [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:53.690680 17722 raft_consensus.cc:3037] T 214bc0f26512422d8dabaa8f5928540a P 49d7274ea3144adea1f4e9e5e05b7b5d [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:53.691717 17954 raft_consensus.cc:2454] T 214bc0f26512422d8dabaa8f5928540a P 2ed2b3fcda594ac59a3c9a7f15f70a5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2b5f5df53eb4066bb755b3b8b565a35 in term 1.
I20260811 17:08:53.691728 17722 raft_consensus.cc:2454] T 214bc0f26512422d8dabaa8f5928540a P 49d7274ea3144adea1f4e9e5e05b7b5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d2b5f5df53eb4066bb755b3b8b565a35 in term 1.
I20260811 17:08:53.691995 17335 leader_election.cc:302] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ed2b3fcda594ac59a3c9a7f15f70a5d, d2b5f5df53eb4066bb755b3b8b565a35; no voters:
I20260811 17:08:53.692209 18098 raft_consensus.cc:2781] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:53.692436 18098 raft_consensus.cc:686] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35 [term 1 LEADER]: Becoming Leader. State: Replica: d2b5f5df53eb4066bb755b3b8b565a35, State: Running, Role: LEADER
I20260811 17:08:53.692826 18098 consensus_queue.cc:237] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40803 } } peers { permanent_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 38683 } } peers { permanent_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 33863 } }
I20260811 17:08:53.696527 15800 catalog_manager.cc:5495] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35 reported cstate change: term changed from 0 to 1, leader changed from <none> to d2b5f5df53eb4066bb755b3b8b565a35 (127.4.146.193). New cstate: current_term: 1 leader_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 38683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 33863 } health_report { overall_health: UNKNOWN } } }
I20260811 17:08:53.756385 18082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.751741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41730 (local address 127.4.146.193:40803)
0811 17:08:53.751902 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:53.751906 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:53.751923 (+ 17us) server_negotiation.cc:407] Connection header received
0811 17:08:53.752057 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:53.752060 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:53.752196 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:53.752315 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:08:53.752597 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.753182 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.754110 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.754521 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.754632 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.755184 (+ 552us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:08:53.755826 (+ 642us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:08:53.755965 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:53.756150 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 17:08:53.756217 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 17:08:53.767524 17722 raft_consensus.cc:1261] T 214bc0f26512422d8dabaa8f5928540a P 49d7274ea3144adea1f4e9e5e05b7b5d [term 1 FOLLOWER]: Refusing update from remote peer d2b5f5df53eb4066bb755b3b8b565a35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:08:53.767524 17954 raft_consensus.cc:1261] T 214bc0f26512422d8dabaa8f5928540a P 2ed2b3fcda594ac59a3c9a7f15f70a5d [term 1 FOLLOWER]: Refusing update from remote peer d2b5f5df53eb4066bb755b3b8b565a35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:08:53.768417 18106 consensus_queue.cc:1035] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 38683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:08:53.768610 18098 consensus_queue.cc:1035] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:08:53.786345 18110 mvcc.cc:205] Tried to move back new op lower bound from 7317373475902865408 to 7317373475608330240. Current Snapshot: MvccSnapshot[applied={T|T < 7317373475902865408}]
I20260811 17:08:53.795010 18112 mvcc.cc:205] Tried to move back new op lower bound from 7317373475902865408 to 7317373475608330240. Current Snapshot: MvccSnapshot[applied={T|T < 7317373475902865408}]
I20260811 17:08:53.806885 15802 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57654:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:08:53.807122 15802 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57654:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:08:53.814747 15802 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4f5901df9ec846ffb312adf8fe316c86: Sending DeleteTablet for 3 replicas of tablet 214bc0f26512422d8dabaa8f5928540a
I20260811 17:08:53.815689 17427 tablet_service.cc:1514] Processing DeleteTablet for tablet 214bc0f26512422d8dabaa8f5928540a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:53 UTC) from {username='oryx', principal='oryx/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:41716
I20260811 17:08:53.815845 17920 tablet_service.cc:1514] Processing DeleteTablet for tablet 214bc0f26512422d8dabaa8f5928540a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:53 UTC) from {username='oryx', principal='oryx/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:53612
I20260811 17:08:53.815924 17684 tablet_service.cc:1514] Processing DeleteTablet for tablet 214bc0f26512422d8dabaa8f5928540a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:53 UTC) from {username='oryx', principal='oryx/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:34016
I20260811 17:08:53.816864 18129 tablet_replica.cc:330] T 214bc0f26512422d8dabaa8f5928540a P 2ed2b3fcda594ac59a3c9a7f15f70a5d: stopping tablet replica
I20260811 17:08:53.819031 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 15747
I20260811 17:08:53.819043 18130 tablet_replica.cc:330] T 214bc0f26512422d8dabaa8f5928540a P 49d7274ea3144adea1f4e9e5e05b7b5d: stopping tablet replica
I20260811 17:08:53.836640 18130 raft_consensus.cc:2229] T 214bc0f26512422d8dabaa8f5928540a P 49d7274ea3144adea1f4e9e5e05b7b5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:08:53.837014 18129 raft_consensus.cc:2229] T 214bc0f26512422d8dabaa8f5928540a P 2ed2b3fcda594ac59a3c9a7f15f70a5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:08:53.837549 18130 raft_consensus.cc:2258] T 214bc0f26512422d8dabaa8f5928540a P 49d7274ea3144adea1f4e9e5e05b7b5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:53.837913 18129 raft_consensus.cc:2258] T 214bc0f26512422d8dabaa8f5928540a P 2ed2b3fcda594ac59a3c9a7f15f70a5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:53.838649 18128 tablet_replica.cc:330] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35: stopping tablet replica
I20260811 17:08:53.839123 18128 raft_consensus.cc:2229] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35 [term 1 LEADER]: Raft consensus shutting down.
I20260811 17:08:53.839603 18128 raft_consensus.cc:2258] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:53.840243 18130 ts_tablet_manager.cc:1905] T 214bc0f26512422d8dabaa8f5928540a P 49d7274ea3144adea1f4e9e5e05b7b5d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:53.841300 18129 ts_tablet_manager.cc:1905] T 214bc0f26512422d8dabaa8f5928540a P 2ed2b3fcda594ac59a3c9a7f15f70a5d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:53.844053 18130 ts_tablet_manager.cc:1918] T 214bc0f26512422d8dabaa8f5928540a P 49d7274ea3144adea1f4e9e5e05b7b5d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:08:53.845212 18129 ts_tablet_manager.cc:1918] T 214bc0f26512422d8dabaa8f5928540a P 2ed2b3fcda594ac59a3c9a7f15f70a5d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:08:53.845340 18129 log.cc:1196] T 214bc0f26512422d8dabaa8f5928540a P 2ed2b3fcda594ac59a3c9a7f15f70a5d: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/214bc0f26512422d8dabaa8f5928540a
I20260811 17:08:53.845530 18130 log.cc:1196] T 214bc0f26512422d8dabaa8f5928540a P 49d7274ea3144adea1f4e9e5e05b7b5d: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/wal/wals/214bc0f26512422d8dabaa8f5928540a
I20260811 17:08:53.845738 18129 ts_tablet_manager.cc:1939] T 214bc0f26512422d8dabaa8f5928540a P 2ed2b3fcda594ac59a3c9a7f15f70a5d: Deleting consensus metadata
I20260811 17:08:53.846760 18130 ts_tablet_manager.cc:1939] T 214bc0f26512422d8dabaa8f5928540a P 49d7274ea3144adea1f4e9e5e05b7b5d: Deleting consensus metadata
W20260811 17:08:53.847679 17841 connection.cc:441] server connection from 127.0.0.1:53612 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53612 (request call id 1) could send its response
I20260811 17:08:53.848909 18128 ts_tablet_manager.cc:1905] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 17:08:53.850845 17590 connection.cc:441] server connection from 127.0.0.1:34016 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34016 (request call id 1) could send its response
I20260811 17:08:53.853040 18128 ts_tablet_manager.cc:1918] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:08:53.853170 18128 log.cc:1196] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-0/wal/wals/214bc0f26512422d8dabaa8f5928540a
I20260811 17:08:53.853572 18128 ts_tablet_manager.cc:1939] T 214bc0f26512422d8dabaa8f5928540a P d2b5f5df53eb4066bb755b3b8b565a35: Deleting consensus metadata
W20260811 17:08:53.854766 17339 connection.cc:441] server connection from 127.0.0.1:41716 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41716 (request call id 1) could send its response
I20260811 17:08:53.858281 18053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.818303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58494 (local address 127.4.146.253:38667)
0811 17:08:53.818440 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:53.818445 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:53.844578 (+ 26133us) server_negotiation.cc:407] Connection header received
0811 17:08:53.844804 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:53.844808 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:53.844866 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:53.844920 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:53.847985 (+ 3065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.848918 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.851215 (+ 2297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.851591 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.851682 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.854350 (+ 2668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:53.854354 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:53.854357 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:53.854387 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:53.856286 (+ 1899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.856790 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.856794 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.856796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.856883 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.857193 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.857197 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.857199 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.857414 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:53.857529 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:53.857951 (+ 422us) server_negotiation.cc:299] Negotiation successful
0811 17:08:53.858105 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":43}
I20260811 17:08:53.870699 17556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.818459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51270 (local address 127.4.146.252:41983)
0811 17:08:53.818577 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:53.818581 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:53.860267 (+ 41686us) server_negotiation.cc:407] Connection header received
0811 17:08:53.860500 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:53.860504 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:53.860555 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:53.860605 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:53.862011 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.862784 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.864567 (+ 1783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.864916 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.864992 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.866789 (+ 1797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:53.866793 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:53.866796 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:53.866823 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:53.868739 (+ 1916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.869264 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.869268 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.869270 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.869360 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.869659 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.869662 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.869664 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.869896 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:53.870005 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:53.870392 (+ 387us) server_negotiation.cc:299] Negotiation successful
0811 17:08:53.870527 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 17:08:53.873339 18057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.849356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51284 (local address 127.4.146.252:41983)
0811 17:08:53.849497 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:53.849501 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:53.850885 (+ 1384us) server_negotiation.cc:407] Connection header received
0811 17:08:53.852362 (+ 1477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:53.852366 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:53.852424 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:53.852513 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:53.854192 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.854906 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.859759 (+ 4853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.860324 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.860429 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.863898 (+ 3469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:53.863906 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:53.863912 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:53.863955 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:53.866121 (+ 2166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.870695 (+ 4574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.870701 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.870706 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.870877 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.872150 (+ 1273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.872156 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.872159 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.872443 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:53.872575 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:53.873024 (+ 449us) server_negotiation.cc:299] Negotiation successful
0811 17:08:53.873174 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 17:08:53.873795 17100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:53.848682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58496 (local address 127.4.146.253:38667)
0811 17:08:53.848800 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:53.848804 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:53.850578 (+ 1774us) server_negotiation.cc:407] Connection header received
0811 17:08:53.851485 (+ 907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:53.851488 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:53.851561 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:53.851619 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:53.855063 (+ 3444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.855953 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.857729 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:53.858175 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:53.858268 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:53.866660 (+ 8392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:53.866667 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:53.866674 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:53.866714 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:53.869335 (+ 2621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.870225 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.870232 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.870237 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.870343 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:53.871311 (+ 968us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:53.871317 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:53.871321 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:53.871618 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:53.871754 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:53.873393 (+ 1639us) server_negotiation.cc:299] Negotiation successful
0811 17:08:53.873553 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 17:08:54.788830 18145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:54.788243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.195:39195)
0811 17:08:54.788562 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:54.788715 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":83,"threads_started":1}
W20260811 17:08:54.789229 18034 heartbeater.cc:644] Failed to heartbeat to 127.4.146.254:33377 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
I20260811 17:08:54.799937 18147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:54.799443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.194:40657)
0811 17:08:54.799708 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:54.799819 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":94,"threads_started":1}
I20260811 17:08:54.800236 18149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:54.799482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.193:51031)
0811 17:08:54.799911 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:54.800014 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":99,"threads_started":1}
W20260811 17:08:54.800559 17548 heartbeater.cc:644] Failed to heartbeat to 127.4.146.254:33377 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
W20260811 17:08:54.800626 17796 heartbeater.cc:644] Failed to heartbeat to 127.4.146.254:33377 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
I20260811 17:08:55.313716 18150 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f5901df9ec846ffb312adf8fe316c86)
I20260811 17:08:55.313951 18150 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: false } }
I20260811 17:08:55.314335 18151 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4f5901df9ec846ffb312adf8fe316c86)
I20260811 17:08:55.314476 18151 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: false } }
I20260811 17:08:55.315023 18151 leader_election.cc:288] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f5901df9ec846ffb312adf8fe316c86 (127.4.146.254:33377), fc10f7924b6d409487c977b1c274d7ff (127.4.146.252:41983)
I20260811 17:08:55.315388 18150 leader_election.cc:288] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f5901df9ec846ffb312adf8fe316c86 (127.4.146.254:33377), 70769ce76ba048bcabf0a1333d2f2f38 (127.4.146.253:38667)
I20260811 17:08:55.315905 18152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:55.315321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.0.0.1:58070)
0811 17:08:55.315685 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:55.315785 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":98,"threads_started":1}
I20260811 17:08:55.316358 18153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:55.315582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.0.0.1:58076)
0811 17:08:55.316155 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:55.316249 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":79,"threads_started":1}
W20260811 17:08:55.316431 16850 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
W20260811 17:08:55.316679 17183 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
I20260811 17:08:55.317824 18153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:55.317586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.0.0.1:58082)
0811 17:08:55.317697 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:55.317754 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 17:08:55.317989 17183 leader_election.cc:334] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4f5901df9ec846ffb312adf8fe316c86 (127.4.146.254:33377): Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
I20260811 17:08:55.318467 18154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:55.318212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.0.0.1:58088)
0811 17:08:55.318334 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:55.318386 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 17:08:55.318639 16850 leader_election.cc:334] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4f5901df9ec846ffb312adf8fe316c86 (127.4.146.254:33377): Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
I20260811 17:08:55.320415 18158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:55.316143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51298 (local address 127.4.146.252:41983)
0811 17:08:55.316460 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:55.316465 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:55.316479 (+ 14us) server_negotiation.cc:407] Connection header received
0811 17:08:55.316532 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:55.316535 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:55.316587 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:55.317003 (+ 416us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:55.317120 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:55.317806 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:55.319378 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:55.319800 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:55.319922 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:55.319988 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:55.320226 (+ 238us) server_negotiation.cc:299] Negotiation successful
0811 17:08:55.320301 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":245,"thread_start_us":90,"threads_started":1}
I20260811 17:08:55.320413 18152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:55.315739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:41983 (local address 127.0.0.1:51298)
0811 17:08:55.316072 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:55.316087 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:55.316245 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:55.316725 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:55.316730 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:55.316756 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:55.316886 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:55.316895 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:55.317921 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:55.317928 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:55.319247 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:55.319258 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:55.319926 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:55.319930 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:55.320056 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:55.320075 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 17:08:55.320207 (+ 132us) client_negotiation.cc:240] Negotiation successful
0811 17:08:55.320288 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"mutex_wait_us":3,"thread_start_us":55,"threads_started":1}
I20260811 17:08:55.320849 18156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:55.315996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:38667 (local address 127.0.0.1:58506)
0811 17:08:55.316627 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:55.316643 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:55.316751 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:55.317327 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:55.317330 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:55.317348 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:55.317451 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:55.317463 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:55.318593 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:55.318597 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:55.319550 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:55.319562 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:55.320409 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:55.320414 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:55.320525 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:55.320552 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 17:08:55.320629 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 17:08:55.320711 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":106,"threads_started":1}
I20260811 17:08:55.320945 18159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:55.316343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58506 (local address 127.4.146.253:38667)
0811 17:08:55.316983 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:55.316988 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:55.317003 (+ 15us) server_negotiation.cc:407] Connection header received
0811 17:08:55.317053 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:55.317057 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:55.317112 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:55.317203 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:55.317619 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:55.318413 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:55.319714 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:55.320274 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:55.320404 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:55.320462 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:55.320719 (+ 257us) server_negotiation.cc:299] Negotiation successful
0811 17:08:55.320792 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":557,"thread_start_us":75,"threads_started":1}
I20260811 17:08:55.321017 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "70769ce76ba048bcabf0a1333d2f2f38" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "fc10f7924b6d409487c977b1c274d7ff" is_pre_election: true
I20260811 17:08:55.321290 17236 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70769ce76ba048bcabf0a1333d2f2f38 in term 1.
I20260811 17:08:55.321502 16892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fc10f7924b6d409487c977b1c274d7ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "70769ce76ba048bcabf0a1333d2f2f38" is_pre_election: true
I20260811 17:08:55.321748 16892 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc10f7924b6d409487c977b1c274d7ff in term 1.
I20260811 17:08:55.321867 16850 leader_election.cc:302] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70769ce76ba048bcabf0a1333d2f2f38, fc10f7924b6d409487c977b1c274d7ff; no voters: 4f5901df9ec846ffb312adf8fe316c86
I20260811 17:08:55.322119 18151 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 17:08:55.322197 18151 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f5901df9ec846ffb312adf8fe316c86)
I20260811 17:08:55.322156 17183 leader_election.cc:302] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70769ce76ba048bcabf0a1333d2f2f38, fc10f7924b6d409487c977b1c274d7ff; no voters: 4f5901df9ec846ffb312adf8fe316c86
I20260811 17:08:55.322257 18151 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 1 FOLLOWER]: Advancing to term 2
I20260811 17:08:55.322402 18150 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 17:08:55.322499 18150 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4f5901df9ec846ffb312adf8fe316c86)
I20260811 17:08:55.322574 18150 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 1 FOLLOWER]: Advancing to term 2
I20260811 17:08:55.323506 18151 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: false } }
I20260811 17:08:55.323640 18150 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: false } }
I20260811 17:08:55.323930 18151 leader_election.cc:288] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [CANDIDATE]: Term 2 election: Requested vote from peers 4f5901df9ec846ffb312adf8fe316c86 (127.4.146.254:33377), fc10f7924b6d409487c977b1c274d7ff (127.4.146.252:41983)
I20260811 17:08:55.324065 18150 leader_election.cc:288] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [CANDIDATE]: Term 2 election: Requested vote from peers 4f5901df9ec846ffb312adf8fe316c86 (127.4.146.254:33377), 70769ce76ba048bcabf0a1333d2f2f38 (127.4.146.253:38667)
I20260811 17:08:55.324481 17236 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "70769ce76ba048bcabf0a1333d2f2f38" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "fc10f7924b6d409487c977b1c274d7ff"
I20260811 17:08:55.324628 18156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:55.324210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.0.0.1:58098)
0811 17:08:55.324492 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:55.324545 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216}
I20260811 17:08:55.324611 16892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fc10f7924b6d409487c977b1c274d7ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "70769ce76ba048bcabf0a1333d2f2f38"
I20260811 17:08:55.324683 17236 raft_consensus.cc:2379] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 70769ce76ba048bcabf0a1333d2f2f38 in current term 2: Already voted for candidate fc10f7924b6d409487c977b1c274d7ff in this term.
I20260811 17:08:55.324764 16892 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fc10f7924b6d409487c977b1c274d7ff in current term 2: Already voted for candidate 70769ce76ba048bcabf0a1333d2f2f38 in this term.
I20260811 17:08:55.324966 18152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:55.324057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.0.0.1:58096)
0811 17:08:55.324200 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:55.324266 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260811 17:08:55.325382 18156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:55.325193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.0.0.1:58112)
0811 17:08:55.325290 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:55.325334 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 17:08:55.325909 17183 leader_election.cc:334] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4f5901df9ec846ffb312adf8fe316c86 (127.4.146.254:33377): Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
I20260811 17:08:55.326011 18152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:55.325760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.0.0.1:58122)
0811 17:08:55.325879 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:55.325940 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 17:08:55.325997 17183 leader_election.cc:302] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc10f7924b6d409487c977b1c274d7ff; no voters: 4f5901df9ec846ffb312adf8fe316c86, 70769ce76ba048bcabf0a1333d2f2f38
I20260811 17:08:55.326154 18150 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260811 17:08:55.326300 16850 leader_election.cc:334] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4f5901df9ec846ffb312adf8fe316c86 (127.4.146.254:33377): Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
I20260811 17:08:55.326385 16850 leader_election.cc:302] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70769ce76ba048bcabf0a1333d2f2f38; no voters: 4f5901df9ec846ffb312adf8fe316c86, fc10f7924b6d409487c977b1c274d7ff
I20260811 17:08:55.326525 18151 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 17:08:55.790694 18168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:55.790149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.195:37743)
0811 17:08:55.790479 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:55.790562 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":93,"threads_started":1}
I20260811 17:08:55.801676 18172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:55.801195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.193:57591)
0811 17:08:55.801499 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:55.801566 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":97,"threads_started":1}
I20260811 17:08:55.801676 18169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:55.801166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.194:54599)
0811 17:08:55.801498 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:55.801566 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":91,"threads_started":1}
I20260811 17:08:56.792851 18173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:56.792243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.195:44045)
0811 17:08:56.792630 (+ 387us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:56.792719 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":98,"threads_started":1}
I20260811 17:08:56.802976 18176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:56.802375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.194:49419)
0811 17:08:56.802787 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:56.802862 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":83,"threads_started":1}
I20260811 17:08:56.803020 18177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:56.802486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.193:35305)
0811 17:08:56.802840 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:56.802907 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":74,"threads_started":1}
I20260811 17:08:57.097658 18180 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:08:57.097818 18180 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: false } }
I20260811 17:08:57.098287 18180 leader_election.cc:288] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4f5901df9ec846ffb312adf8fe316c86 (127.4.146.254:33377), 70769ce76ba048bcabf0a1333d2f2f38 (127.4.146.253:38667)
I20260811 17:08:57.099013 18183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.098562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.0.0.1:58382)
0811 17:08:57.098834 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.098914 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":96,"threads_started":1}
I20260811 17:08:57.099259 16892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fc10f7924b6d409487c977b1c274d7ff" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "70769ce76ba048bcabf0a1333d2f2f38" is_pre_election: true
I20260811 17:08:57.099452 16892 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc10f7924b6d409487c977b1c274d7ff in term 2.
I20260811 17:08:57.099835 17183 leader_election.cc:302] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70769ce76ba048bcabf0a1333d2f2f38, fc10f7924b6d409487c977b1c274d7ff; no voters:
I20260811 17:08:57.099972 18183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.099665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.0.0.1:58398)
0811 17:08:57.099812 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.099877 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 17:08:57.100024 18180 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 17:08:57.100128 18180 raft_consensus.cc:482] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260811 17:08:57.100142 17183 leader_election.cc:334] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4f5901df9ec846ffb312adf8fe316c86 (127.4.146.254:33377): Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
I20260811 17:08:57.100234 18180 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 2 FOLLOWER]: Advancing to term 3
I20260811 17:08:57.101472 18180 raft_consensus.cc:504] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: false } }
I20260811 17:08:57.101814 18180 leader_election.cc:288] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [CANDIDATE]: Term 3 election: Requested vote from peers 4f5901df9ec846ffb312adf8fe316c86 (127.4.146.254:33377), 70769ce76ba048bcabf0a1333d2f2f38 (127.4.146.253:38667)
I20260811 17:08:57.102247 18183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.101987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.0.0.1:58410)
0811 17:08:57.102100 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.102161 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 17:08:57.102515 16892 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fc10f7924b6d409487c977b1c274d7ff" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "70769ce76ba048bcabf0a1333d2f2f38"
I20260811 17:08:57.102659 16892 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 2 FOLLOWER]: Advancing to term 3
I20260811 17:08:57.103101 18183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.102855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.0.0.1:58422)
0811 17:08:57.102979 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.103037 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 17:08:57.103224 17183 leader_election.cc:334] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 4f5901df9ec846ffb312adf8fe316c86 (127.4.146.254:33377): Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
I20260811 17:08:57.103925 16892 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc10f7924b6d409487c977b1c274d7ff in term 3.
I20260811 17:08:57.104285 17183 leader_election.cc:302] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 70769ce76ba048bcabf0a1333d2f2f38, fc10f7924b6d409487c977b1c274d7ff; no voters: 4f5901df9ec846ffb312adf8fe316c86
I20260811 17:08:57.104471 18180 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 3 FOLLOWER]: Leader election won for term 3
I20260811 17:08:57.104715 18180 raft_consensus.cc:686] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [term 3 LEADER]: Becoming Leader. State: Replica: fc10f7924b6d409487c977b1c274d7ff, State: Running, Role: LEADER
I20260811 17:08:57.104997 18180 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: false } }
I20260811 17:08:57.106220 18185 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc10f7924b6d409487c977b1c274d7ff. Latest consensus state: current_term: 3 leader_uuid: "fc10f7924b6d409487c977b1c274d7ff" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: false } } }
I20260811 17:08:57.106324 18185 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:57.106628 18188 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:08:57.109158 18188 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:08:57.109603 18188 catalog_manager.cc:1259] Loaded cluster ID: 0b854d920aeb454e8a583d46de21771c
I20260811 17:08:57.109680 18188 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:08:57.110260 18188 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:08:57.110664 18188 catalog_manager.cc:5879] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff: Loaded TSK: 0
I20260811 17:08:57.111405 18188 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:08:57.130653 17209 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51284:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 17:08:57.134138 17209 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:08:57.137859 18183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.137542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.0.0.1:58440)
0811 17:08:57.137700 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.137779 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260811 17:08:57.138068 16892 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [term 3 FOLLOWER]: Refusing update from remote peer fc10f7924b6d409487c977b1c274d7ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260811 17:08:57.138717 18183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.138467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.0.0.1:58454)
0811 17:08:57.138586 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.138643 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 17:08:57.138828 18180 consensus_queue.cc:1035] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260811 17:08:57.139055 17183 consensus_peers.cc:487] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff -> Peer 4f5901df9ec846ffb312adf8fe316c86 (127.4.146.254:33377): Couldn't send request to peer 4f5901df9ec846ffb312adf8fe316c86. Status: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 17:08:57.140735 18190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc10f7924b6d409487c977b1c274d7ff. Latest consensus state: current_term: 3 leader_uuid: "fc10f7924b6d409487c977b1c274d7ff" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: false } } }
I20260811 17:08:57.140930 18190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:08:57.142375 18180 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "fc10f7924b6d409487c977b1c274d7ff" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: false } } }
I20260811 17:08:57.142540 18180 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:57.142807 18190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "fc10f7924b6d409487c977b1c274d7ff" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "4f5901df9ec846ffb312adf8fe316c86" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 33377 } } peers { permanent_uuid: "70769ce76ba048bcabf0a1333d2f2f38" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 38667 } attrs { promote: false } } peers { permanent_uuid: "fc10f7924b6d409487c977b1c274d7ff" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41983 } attrs { promote: false } } }
I20260811 17:08:57.142967 18190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70769ce76ba048bcabf0a1333d2f2f38 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:08:57.155319 18183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.149993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:40803 (local address 127.0.0.1:41746)
0811 17:08:57.150153 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.150172 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:57.150284 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:57.151457 (+ 1173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:57.151460 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:57.151477 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:57.151571 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:57.151578 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:57.152678 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:57.152682 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:57.153975 (+ 1293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:57.153986 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:57.154851 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:57.154855 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:57.154959 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:57.154996 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 17:08:57.155069 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 17:08:57.155146 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":89}
I20260811 17:08:57.155556 18201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.150691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34026 (local address 127.4.146.194:33863)
0811 17:08:57.151015 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:57.151019 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:57.151033 (+ 14us) server_negotiation.cc:407] Connection header received
0811 17:08:57.151087 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:57.151090 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:57.151192 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:57.151290 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:57.151640 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:57.152500 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:57.154028 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:57.154682 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:57.155251 (+ 569us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:57.155315 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:57.155355 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 17:08:57.155429 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":112,"threads_started":1}
I20260811 17:08:57.155611 18207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.151277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53626 (local address 127.4.146.195:38683)
0811 17:08:57.151626 (+ 349us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:57.151631 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:57.151763 (+ 132us) server_negotiation.cc:407] Connection header received
0811 17:08:57.151856 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:57.151859 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:57.151912 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:57.152004 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:57.152295 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:57.153177 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:57.154451 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:57.154944 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:57.155074 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:57.155135 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:57.155387 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 17:08:57.155463 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":79,"threads_started":1}
I20260811 17:08:57.155866 18202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.151066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:38683 (local address 127.0.0.1:53626)
0811 17:08:57.151669 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.151681 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:57.151774 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:57.152032 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:57.152035 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:57.152053 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:57.152175 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:57.152181 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:57.153313 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:57.153317 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:57.154335 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:57.154343 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:57.155074 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:57.155078 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:57.155154 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:57.155180 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 17:08:57.155251 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 17:08:57.155312 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":99,"threads_started":1}
I20260811 17:08:57.155320 18199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.150272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:33863 (local address 127.0.0.1:34026)
0811 17:08:57.150533 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.150548 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:57.150643 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:57.151316 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:57.151319 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:57.151341 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:57.151473 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:57.151482 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:57.152627 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:57.152631 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:57.153856 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:57.153866 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:57.154830 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:57.154834 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:57.154917 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:57.154946 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 17:08:57.155029 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 17:08:57.155112 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"mutex_wait_us":40,"thread_start_us":116,"threads_started":1}
I20260811 17:08:57.155970 18200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.150299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41746 (local address 127.4.146.193:40803)
0811 17:08:57.150810 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:57.150814 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:57.150846 (+ 32us) server_negotiation.cc:407] Connection header received
0811 17:08:57.151304 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:57.151308 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:57.151357 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:57.151442 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:57.151750 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:57.152582 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:57.154110 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:57.154724 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:57.154835 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:57.154905 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:57.155665 (+ 760us) server_negotiation.cc:299] Negotiation successful
0811 17:08:57.155755 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":103,"threads_started":1}
I20260811 17:08:57.156523 17427 tablet_service.cc:1467] Processing CreateTablet for tablet 873323afe2634ddba54bd7157a9a99e8 (DEFAULT_TABLE table=test-table [id=6758783be1c04aa3a117fe9d94459b41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:57.156524 17920 tablet_service.cc:1467] Processing CreateTablet for tablet 873323afe2634ddba54bd7157a9a99e8 (DEFAULT_TABLE table=test-table [id=6758783be1c04aa3a117fe9d94459b41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:57.156891 17427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 873323afe2634ddba54bd7157a9a99e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:57.156891 17920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 873323afe2634ddba54bd7157a9a99e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:57.156829 17684 tablet_service.cc:1467] Processing CreateTablet for tablet 873323afe2634ddba54bd7157a9a99e8 (DEFAULT_TABLE table=test-table [id=6758783be1c04aa3a117fe9d94459b41]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:08:57.157147 17684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 873323afe2634ddba54bd7157a9a99e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:57.159654 18208 tablet_bootstrap.cc:492] T 873323afe2634ddba54bd7157a9a99e8 P 49d7274ea3144adea1f4e9e5e05b7b5d: Bootstrap starting.
I20260811 17:08:57.160301 18211 tablet_bootstrap.cc:492] T 873323afe2634ddba54bd7157a9a99e8 P d2b5f5df53eb4066bb755b3b8b565a35: Bootstrap starting.
I20260811 17:08:57.160713 18208 tablet_bootstrap.cc:654] T 873323afe2634ddba54bd7157a9a99e8 P 49d7274ea3144adea1f4e9e5e05b7b5d: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:57.161345 18211 tablet_bootstrap.cc:654] T 873323afe2634ddba54bd7157a9a99e8 P d2b5f5df53eb4066bb755b3b8b565a35: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:57.162047 18212 tablet_bootstrap.cc:492] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d: Bootstrap starting.
I20260811 17:08:57.162190 18208 tablet_bootstrap.cc:492] T 873323afe2634ddba54bd7157a9a99e8 P 49d7274ea3144adea1f4e9e5e05b7b5d: No bootstrap required, opened a new log
I20260811 17:08:57.162287 18208 ts_tablet_manager.cc:1397] T 873323afe2634ddba54bd7157a9a99e8 P 49d7274ea3144adea1f4e9e5e05b7b5d: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 17:08:57.162719 18208 raft_consensus.cc:348] T 873323afe2634ddba54bd7157a9a99e8 P 49d7274ea3144adea1f4e9e5e05b7b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40803 } } peers { permanent_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 33863 } } peers { permanent_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 38683 } }
I20260811 17:08:57.162845 18208 raft_consensus.cc:374] T 873323afe2634ddba54bd7157a9a99e8 P 49d7274ea3144adea1f4e9e5e05b7b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:57.162910 18208 raft_consensus.cc:729] T 873323afe2634ddba54bd7157a9a99e8 P 49d7274ea3144adea1f4e9e5e05b7b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49d7274ea3144adea1f4e9e5e05b7b5d, State: Initialized, Role: FOLLOWER
I20260811 17:08:57.162918 18212 tablet_bootstrap.cc:654] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:57.163066 18208 consensus_queue.cc:260] T 873323afe2634ddba54bd7157a9a99e8 P 49d7274ea3144adea1f4e9e5e05b7b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40803 } } peers { permanent_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 33863 } } peers { permanent_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 38683 } }
I20260811 17:08:57.163467 18208 ts_tablet_manager.cc:1428] T 873323afe2634ddba54bd7157a9a99e8 P 49d7274ea3144adea1f4e9e5e05b7b5d: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 17:08:57.164223 18176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.163920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.194:46143)
0811 17:08:57.164049 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.164141 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 17:08:57.164793 18211 tablet_bootstrap.cc:492] T 873323afe2634ddba54bd7157a9a99e8 P d2b5f5df53eb4066bb755b3b8b565a35: No bootstrap required, opened a new log
I20260811 17:08:57.164872 18211 ts_tablet_manager.cc:1397] T 873323afe2634ddba54bd7157a9a99e8 P d2b5f5df53eb4066bb755b3b8b565a35: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 17:08:57.165324 18211 raft_consensus.cc:348] T 873323afe2634ddba54bd7157a9a99e8 P d2b5f5df53eb4066bb755b3b8b565a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40803 } } peers { permanent_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 33863 } } peers { permanent_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 38683 } }
I20260811 17:08:57.165439 18211 raft_consensus.cc:374] T 873323afe2634ddba54bd7157a9a99e8 P d2b5f5df53eb4066bb755b3b8b565a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:57.165474 18211 raft_consensus.cc:729] T 873323afe2634ddba54bd7157a9a99e8 P d2b5f5df53eb4066bb755b3b8b565a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2b5f5df53eb4066bb755b3b8b565a35, State: Initialized, Role: FOLLOWER
I20260811 17:08:57.165630 18211 consensus_queue.cc:260] T 873323afe2634ddba54bd7157a9a99e8 P d2b5f5df53eb4066bb755b3b8b565a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40803 } } peers { permanent_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 33863 } } peers { permanent_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 38683 } }
I20260811 17:08:57.166018 18211 ts_tablet_manager.cc:1428] T 873323afe2634ddba54bd7157a9a99e8 P d2b5f5df53eb4066bb755b3b8b565a35: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 17:08:57.166791 18177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.166532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.193:41811)
0811 17:08:57.166652 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.166715 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 17:08:57.166911 17795 heartbeater.cc:503] Master 127.4.146.252:41983 was elected leader, sending a full tablet report...
I20260811 17:08:57.167613 18176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.167232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.194:45725)
0811 17:08:57.167459 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.167534 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159}
I20260811 17:08:57.168295 17546 heartbeater.cc:503] Master 127.4.146.252:41983 was elected leader, sending a full tablet report...
I20260811 17:08:57.168824 18212 tablet_bootstrap.cc:492] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d: No bootstrap required, opened a new log
I20260811 17:08:57.168926 18212 ts_tablet_manager.cc:1397] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260811 17:08:57.169361 18212 raft_consensus.cc:348] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40803 } } peers { permanent_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 33863 } } peers { permanent_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 38683 } }
I20260811 17:08:57.169467 18212 raft_consensus.cc:374] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:57.169494 18212 raft_consensus.cc:729] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ed2b3fcda594ac59a3c9a7f15f70a5d, State: Initialized, Role: FOLLOWER
I20260811 17:08:57.169636 18177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.168646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.193:58699)
0811 17:08:57.169500 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.169559 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":773}
I20260811 17:08:57.169603 18212 consensus_queue.cc:260] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40803 } } peers { permanent_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 33863 } } peers { permanent_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 38683 } }
I20260811 17:08:57.169930 18212 ts_tablet_manager.cc:1428] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 17:08:57.171314 18173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.170976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.195:47355)
0811 17:08:57.171193 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.171247 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137}
I20260811 17:08:57.172029 18033 heartbeater.cc:503] Master 127.4.146.252:41983 was elected leader, sending a full tablet report...
I20260811 17:08:57.172601 18173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.172339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.195:53887)
0811 17:08:57.172433 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.172488 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 17:08:57.316279 18223 raft_consensus.cc:482] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:08:57.316449 18223 raft_consensus.cc:504] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40803 } } peers { permanent_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 33863 } } peers { permanent_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 38683 } }
I20260811 17:08:57.317983 18223 leader_election.cc:288] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2b5f5df53eb4066bb755b3b8b565a35 (127.4.146.193:40803), 49d7274ea3144adea1f4e9e5e05b7b5d (127.4.146.194:33863)
I20260811 17:08:57.324047 18201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.318398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:54867 (local address 127.4.146.194:33863)
0811 17:08:57.318544 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:57.318548 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:57.318804 (+ 256us) server_negotiation.cc:407] Connection header received
0811 17:08:57.318893 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:57.318899 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:57.318952 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:57.319025 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:57.319517 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:57.320358 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:57.322501 (+ 2143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:57.323200 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:57.323381 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:57.323457 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:57.323818 (+ 361us) server_negotiation.cc:299] Negotiation successful
0811 17:08:57.323910 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 17:08:57.324047 18200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.318346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:58031 (local address 127.4.146.193:40803)
0811 17:08:57.318496 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:57.318502 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:57.318656 (+ 154us) server_negotiation.cc:407] Connection header received
0811 17:08:57.318783 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:57.318789 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:57.318854 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:57.318944 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:08:57.319517 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:57.320371 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:57.322480 (+ 2109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:57.323255 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:57.323395 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:57.323456 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:57.323818 (+ 362us) server_negotiation.cc:299] Negotiation successful
0811 17:08:57.323912 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 17:08:57.324079 18173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.318202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:40803 (local address 127.4.146.195:58031)
0811 17:08:57.318494 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.318513 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:57.318650 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:57.319095 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:57.319098 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:57.319160 (+ 62us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:57.319375 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:57.319380 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:57.320489 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:57.320493 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:57.322290 (+ 1797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:57.322303 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:57.323406 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:57.323410 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:57.323586 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:57.323660 (+ 74us) client_negotiation.cc:769] Sending connection context
0811 17:08:57.323754 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 17:08:57.323885 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":332,"spinlock_wait_cycles":7168}
I20260811 17:08:57.324118 18224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.318302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:33863 (local address 127.4.146.195:54867)
0811 17:08:57.318695 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.318710 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:57.318813 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:57.319095 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:57.319098 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:57.319160 (+ 62us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:08:57.319370 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:57.319380 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:57.320489 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:57.320493 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:57.322290 (+ 1797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:57.322303 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:57.323406 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:57.323410 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:57.323613 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:57.323663 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 17:08:57.323754 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 17:08:57.323885 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"mutex_wait_us":390,"spinlock_wait_cycles":67968,"thread_start_us":161,"threads_started":1}
I20260811 17:08:57.324746 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "873323afe2634ddba54bd7157a9a99e8" candidate_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" is_pre_election: true
I20260811 17:08:57.324983 17721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "873323afe2634ddba54bd7157a9a99e8" candidate_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d" is_pre_election: true
I20260811 17:08:57.325060 17463 raft_consensus.cc:2454] T 873323afe2634ddba54bd7157a9a99e8 P d2b5f5df53eb4066bb755b3b8b565a35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ed2b3fcda594ac59a3c9a7f15f70a5d in term 0.
I20260811 17:08:57.325183 17721 raft_consensus.cc:2454] T 873323afe2634ddba54bd7157a9a99e8 P 49d7274ea3144adea1f4e9e5e05b7b5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ed2b3fcda594ac59a3c9a7f15f70a5d in term 0.
I20260811 17:08:57.325660 17836 leader_election.cc:302] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2ed2b3fcda594ac59a3c9a7f15f70a5d, 49d7274ea3144adea1f4e9e5e05b7b5d, d2b5f5df53eb4066bb755b3b8b565a35; no voters:
I20260811 17:08:57.325981 18223 raft_consensus.cc:2781] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:08:57.326050 18223 raft_consensus.cc:482] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:08:57.326088 18223 raft_consensus.cc:3037] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:57.327205 18223 raft_consensus.cc:504] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40803 } } peers { permanent_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 33863 } } peers { permanent_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 38683 } }
I20260811 17:08:57.327582 18223 leader_election.cc:288] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d [CANDIDATE]: Term 1 election: Requested vote from peers d2b5f5df53eb4066bb755b3b8b565a35 (127.4.146.193:40803), 49d7274ea3144adea1f4e9e5e05b7b5d (127.4.146.194:33863)
I20260811 17:08:57.328029 17463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "873323afe2634ddba54bd7157a9a99e8" candidate_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2b5f5df53eb4066bb755b3b8b565a35"
I20260811 17:08:57.328029 17721 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "873323afe2634ddba54bd7157a9a99e8" candidate_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d"
I20260811 17:08:57.328218 17721 raft_consensus.cc:3037] T 873323afe2634ddba54bd7157a9a99e8 P 49d7274ea3144adea1f4e9e5e05b7b5d [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:57.328218 17463 raft_consensus.cc:3037] T 873323afe2634ddba54bd7157a9a99e8 P d2b5f5df53eb4066bb755b3b8b565a35 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:57.329592 17463 raft_consensus.cc:2454] T 873323afe2634ddba54bd7157a9a99e8 P d2b5f5df53eb4066bb755b3b8b565a35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ed2b3fcda594ac59a3c9a7f15f70a5d in term 1.
I20260811 17:08:57.329584 17721 raft_consensus.cc:2454] T 873323afe2634ddba54bd7157a9a99e8 P 49d7274ea3144adea1f4e9e5e05b7b5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ed2b3fcda594ac59a3c9a7f15f70a5d in term 1.
I20260811 17:08:57.329985 17841 leader_election.cc:302] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ed2b3fcda594ac59a3c9a7f15f70a5d, d2b5f5df53eb4066bb755b3b8b565a35; no voters:
I20260811 17:08:57.330204 18223 raft_consensus.cc:2781] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:57.330507 18223 raft_consensus.cc:686] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d [term 1 LEADER]: Becoming Leader. State: Replica: 2ed2b3fcda594ac59a3c9a7f15f70a5d, State: Running, Role: LEADER
I20260811 17:08:57.330834 18223 consensus_queue.cc:237] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40803 } } peers { permanent_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 33863 } } peers { permanent_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 38683 } }
I20260811 17:08:57.331432 18224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.331158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.195:51791)
0811 17:08:57.331279 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.331349 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 17:08:57.333902 17208 catalog_manager.cc:5495] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ed2b3fcda594ac59a3c9a7f15f70a5d (127.4.146.195). New cstate: current_term: 1 leader_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 33863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ed2b3fcda594ac59a3c9a7f15f70a5d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 38683 } health_report { overall_health: HEALTHY } } }
I20260811 17:08:57.349725 18207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.345537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53638 (local address 127.4.146.195:38683)
0811 17:08:57.345719 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:57.345725 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:57.345741 (+ 16us) server_negotiation.cc:407] Connection header received
0811 17:08:57.345974 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:57.345977 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:57.346056 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:57.346200 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:08:57.346456 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:57.347190 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:57.348187 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:57.348415 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:57.348529 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:57.348820 (+ 291us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:08:57.349301 (+ 481us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:08:57.349439 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:57.349510 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 17:08:57.349572 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 17:08:57.352875 17721 raft_consensus.cc:1261] T 873323afe2634ddba54bd7157a9a99e8 P 49d7274ea3144adea1f4e9e5e05b7b5d [term 1 FOLLOWER]: Refusing update from remote peer 2ed2b3fcda594ac59a3c9a7f15f70a5d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:08:57.353271 17463 raft_consensus.cc:1261] T 873323afe2634ddba54bd7157a9a99e8 P d2b5f5df53eb4066bb755b3b8b565a35 [term 1 FOLLOWER]: Refusing update from remote peer 2ed2b3fcda594ac59a3c9a7f15f70a5d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:08:57.353477 18227 consensus_queue.cc:1035] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "49d7274ea3144adea1f4e9e5e05b7b5d" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 33863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:08:57.353875 18223 consensus_queue.cc:1035] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2b5f5df53eb4066bb755b3b8b565a35" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 40803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:08:57.355654 18176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.355341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.194:36821)
0811 17:08:57.355507 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.355572 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260811 17:08:57.359122 18224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.358645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.195:47929)
0811 17:08:57.358951 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.359025 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215}
I20260811 17:08:57.361481 18176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.361151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.194:45251)
0811 17:08:57.361333 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.361400 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260811 17:08:57.362267 18177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.361895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.193:55655)
0811 17:08:57.362110 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.362179 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140}
I20260811 17:08:57.364452 18177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.363887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:33377 (local address 127.4.146.193:46601)
0811 17:08:57.364295 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.364365 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:33377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318}
I20260811 17:08:57.371603 17208 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51284:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:08:57.371819 17208 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51284:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:08:57.376631 17208 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fc10f7924b6d409487c977b1c274d7ff: Sending DeleteTablet for 3 replicas of tablet 873323afe2634ddba54bd7157a9a99e8
I20260811 17:08:57.377511 17427 tablet_service.cc:1514] Processing DeleteTablet for tablet 873323afe2634ddba54bd7157a9a99e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:57 UTC) from {username='oryx', principal='oryx/127.4.146.252@KRBTEST.COM'} at 127.0.0.1:41746
I20260811 17:08:57.378012 18248 tablet_replica.cc:330] T 873323afe2634ddba54bd7157a9a99e8 P d2b5f5df53eb4066bb755b3b8b565a35: stopping tablet replica
I20260811 17:08:57.378201 18248 raft_consensus.cc:2229] T 873323afe2634ddba54bd7157a9a99e8 P d2b5f5df53eb4066bb755b3b8b565a35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:08:57.378219 17684 tablet_service.cc:1514] Processing DeleteTablet for tablet 873323afe2634ddba54bd7157a9a99e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:57 UTC) from {username='oryx', principal='oryx/127.4.146.252@KRBTEST.COM'} at 127.0.0.1:34026
I20260811 17:08:57.378360 18248 raft_consensus.cc:2258] T 873323afe2634ddba54bd7157a9a99e8 P d2b5f5df53eb4066bb755b3b8b565a35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:57.378350 17920 tablet_service.cc:1514] Processing DeleteTablet for tablet 873323afe2634ddba54bd7157a9a99e8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:08:57 UTC) from {username='oryx', principal='oryx/127.4.146.252@KRBTEST.COM'} at 127.0.0.1:53626
I20260811 17:08:57.378667 18249 tablet_replica.cc:330] T 873323afe2634ddba54bd7157a9a99e8 P 49d7274ea3144adea1f4e9e5e05b7b5d: stopping tablet replica
I20260811 17:08:57.378839 18249 raft_consensus.cc:2229] T 873323afe2634ddba54bd7157a9a99e8 P 49d7274ea3144adea1f4e9e5e05b7b5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:08:57.379045 18249 raft_consensus.cc:2258] T 873323afe2634ddba54bd7157a9a99e8 P 49d7274ea3144adea1f4e9e5e05b7b5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:57.379372 18248 ts_tablet_manager.cc:1905] T 873323afe2634ddba54bd7157a9a99e8 P d2b5f5df53eb4066bb755b3b8b565a35: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:57.379626 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 17145
I20260811 17:08:57.380378 18249 ts_tablet_manager.cc:1905] T 873323afe2634ddba54bd7157a9a99e8 P 49d7274ea3144adea1f4e9e5e05b7b5d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:57.380628 18254 tablet_replica.cc:330] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d: stopping tablet replica
I20260811 17:08:57.380756 18254 raft_consensus.cc:2229] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d [term 1 LEADER]: Raft consensus shutting down.
I20260811 17:08:57.381145 18254 raft_consensus.cc:2258] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:08:57.383378 18249 ts_tablet_manager.cc:1918] T 873323afe2634ddba54bd7157a9a99e8 P 49d7274ea3144adea1f4e9e5e05b7b5d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:08:57.383447 18249 log.cc:1196] T 873323afe2634ddba54bd7157a9a99e8 P 49d7274ea3144adea1f4e9e5e05b7b5d: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-1/wal/wals/873323afe2634ddba54bd7157a9a99e8
I20260811 17:08:57.383666 18249 ts_tablet_manager.cc:1939] T 873323afe2634ddba54bd7157a9a99e8 P 49d7274ea3144adea1f4e9e5e05b7b5d: Deleting consensus metadata
I20260811 17:08:57.388240 17181 catalog_manager.cc:4841] TS 49d7274ea3144adea1f4e9e5e05b7b5d (127.4.146.194:33863): tablet 873323afe2634ddba54bd7157a9a99e8 (table test-table [id=6758783be1c04aa3a117fe9d94459b41]) successfully deleted
I20260811 17:08:57.393406 18254 ts_tablet_manager.cc:1905] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:08:57.396227 18254 ts_tablet_manager.cc:1918] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:08:57.396366 18254 log.cc:1196] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/873323afe2634ddba54bd7157a9a99e8
I20260811 17:08:57.396697 18254 ts_tablet_manager.cc:1939] T 873323afe2634ddba54bd7157a9a99e8 P 2ed2b3fcda594ac59a3c9a7f15f70a5d: Deleting consensus metadata
W20260811 17:08:57.397464 18202 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:08:57.396386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:40803 (local address 127.0.0.1:41748)
0811 17:08:57.396562 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.396577 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:57.396666 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:57.397350 (+ 684us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.193:40803: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":99}
W20260811 17:08:57.397800 17184 catalog_manager.cc:4584] TS d2b5f5df53eb4066bb755b3b8b565a35 (127.4.146.193:40803): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 873323afe2634ddba54bd7157a9a99e8: Network error: Client connection negotiation failed: client connection to 127.4.146.193:40803: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 17:08:57.398124 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 17563
I20260811 17:08:57.426416 17181 catalog_manager.cc:4841] TS 2ed2b3fcda594ac59a3c9a7f15f70a5d (127.4.146.195:38683): tablet 873323afe2634ddba54bd7157a9a99e8 (table test-table [id=6758783be1c04aa3a117fe9d94459b41]) successfully deleted
I20260811 17:08:57.436206 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 17807
I20260811 17:08:57.450991 18202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.450608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:40803 (local address 127.0.0.1:41756)
0811 17:08:57.450791 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.450877 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.193:40803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 17:08:57.453123 18202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:57.452829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:40803 (local address 127.0.0.1:41772)
0811 17:08:57.452989 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:57.453043 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.193:40803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260811 17:08:57.458702 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 16624
I20260811 17:08:57.476575 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 16803
2026-08-11T17:08:57Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7980 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:08:57 dist-test-slave-7vjv krb5kdc[18258](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:08:57 dist-test-slave-7vjv krb5kdc[18258](info): set up 2 sockets
Aug 11 17:08:57 dist-test-slave-7vjv krb5kdc[18258](info): commencing operation
krb5kdc: starting...
W20260811 17:08:58.818698 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.303s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:08:58 dist-test-slave-7vjv krb5kdc[18258](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:08:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:08:58Z Disabled control of system clock
WARNING: no policy specified for oryx/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.254.keytab.
Entry for principal oryx/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.254.keytab.
I20260811 17:08:58.969143 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:34413
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.254.keytab
--principal=oryx/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:34533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:34413
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:59.090834 18283 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:59.091228 18283 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:59.091315 18283 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:59.095629 18283 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:08:59.095752 18283 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 17:08:59.095790 18283 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:59.095839 18283 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:59.095898 18283 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:08:59.095938 18283 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:08:59.101745 18283 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:34533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:34413
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.254.keytab
--principal=oryx/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:34413
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18283
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:59.103067 18283 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:59.104265 18283 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:59.115002 18295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:59.114974 18309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:59.115127 18283 server_base.cc:1034] running on GCE node
W20260811 17:08:59.115005 18300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:59.115984 18283 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:59.117576 18283 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:59.118846 18283 hybrid_clock.cc:648] HybridClock initialized: now 1786468139118777 us; error 87 us; skew 500 ppm
Aug 11 17:08:59 dist-test-slave-7vjv krb5kdc[18258](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468139, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:59.122996 18283 init.cc:377] Logged in from keytab as oryx/127.4.146.254@KRBTEST.COM (short username oryx)
I20260811 17:08:59.124244 18283 webserver.cc:460] Webserver started at http://127.4.146.254:40741/ using document root <none> and password file <none>
I20260811 17:08:59.124861 18283 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:59.124933 18283 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:59.125131 18283 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:59.127521 18283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "c8ac038d5cae4b1eb3e03a9bba7e7d33"
format_stamp: "Formatted at 2026-08-11 17:08:59 on dist-test-slave-7vjv"
server_key: "586e749ee31790637224c582a59d4f01"
server_key_iv: "99f7cfe6d51bbd3936c61425372433db"
server_key_version: "encryptionkey@0"
I20260811 17:08:59.128304 18283 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "c8ac038d5cae4b1eb3e03a9bba7e7d33"
format_stamp: "Formatted at 2026-08-11 17:08:59 on dist-test-slave-7vjv"
server_key: "586e749ee31790637224c582a59d4f01"
server_key_iv: "99f7cfe6d51bbd3936c61425372433db"
server_key_version: "encryptionkey@0"
I20260811 17:08:59.132841 18283 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 17:08:59.135780 18319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:59.137550 18283 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:08:59.137707 18283 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "c8ac038d5cae4b1eb3e03a9bba7e7d33"
format_stamp: "Formatted at 2026-08-11 17:08:59 on dist-test-slave-7vjv"
server_key: "586e749ee31790637224c582a59d4f01"
server_key_iv: "99f7cfe6d51bbd3936c61425372433db"
server_key_version: "encryptionkey@0"
I20260811 17:08:59.137890 18283 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:59.157013 18283 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:59.161368 18283 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:59.161633 18283 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:59.171305 18283 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:34413
I20260811 17:08:59.171366 18414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:34413 every 8 connection(s)
I20260811 17:08:59.172544 18283 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:08:59.175732 18418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:08:59.178463 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 18283
I20260811 17:08:59.178582 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:08:59.178903 4683 external_mini_cluster.cc:1428] Setting key 72445eb4c93dba49580eefa88fb7652b
I20260811 17:08:59.182547 18418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33: Bootstrap starting.
I20260811 17:08:59.185388 18418 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33: Neither blocks nor log segments found. Creating new log.
I20260811 17:08:59.186280 18418 log.cc:824] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33: Log is configured to *not* fsync() on all Append() calls
I20260811 17:08:59.188635 18418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33: No bootstrap required, opened a new log
Aug 11 17:08:59 dist-test-slave-7vjv krb5kdc[18258](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM
I20260811 17:08:59.193442 18418 raft_consensus.cc:348] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8ac038d5cae4b1eb3e03a9bba7e7d33" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34413 } }
I20260811 17:08:59.193761 18418 raft_consensus.cc:374] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:08:59.193817 18418 raft_consensus.cc:729] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8ac038d5cae4b1eb3e03a9bba7e7d33, State: Initialized, Role: FOLLOWER
I20260811 17:08:59.194370 18418 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8ac038d5cae4b1eb3e03a9bba7e7d33" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34413 } }
I20260811 17:08:59.194547 18418 raft_consensus.cc:388] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:08:59.194662 18418 raft_consensus.cc:482] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:08:59.194788 18418 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:08:59.196033 18418 raft_consensus.cc:504] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8ac038d5cae4b1eb3e03a9bba7e7d33" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34413 } }
I20260811 17:08:59.196147 18422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:59.180553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50150 (local address 127.4.146.254:34413)
0811 17:08:59.181046 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:59.181067 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:59.181114 (+ 47us) server_negotiation.cc:407] Connection header received
0811 17:08:59.181938 (+ 824us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:59.181964 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:59.182407 (+ 443us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:59.182803 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:59.183632 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:59.185167 (+ 1535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:59.186188 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:59.186888 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:59.187012 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:59.190058 (+ 3046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:59.190064 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:59.190082 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:59.190115 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:59.192311 (+ 2196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:59.192825 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:59.192832 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:59.192839 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:59.193011 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:59.193360 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:59.193364 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:59.193366 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:59.193954 (+ 588us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:59.194184 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:59.194532 (+ 348us) server_negotiation.cc:299] Negotiation successful
0811 17:08:59.195071 (+ 539us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":327,"thread_start_us":127,"threads_started":1}
I20260811 17:08:59.196458 18418 leader_election.cc:302] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c8ac038d5cae4b1eb3e03a9bba7e7d33; no voters:
I20260811 17:08:59.196861 18418 leader_election.cc:288] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:08:59.197008 18426 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:08:59.197310 18426 raft_consensus.cc:686] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33 [term 1 LEADER]: Becoming Leader. State: Replica: c8ac038d5cae4b1eb3e03a9bba7e7d33, State: Running, Role: LEADER
I20260811 17:08:59.197710 18426 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8ac038d5cae4b1eb3e03a9bba7e7d33" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34413 } }
I20260811 17:08:59.198220 18418 sys_catalog.cc:564] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:08:59.199080 18430 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8ac038d5cae4b1eb3e03a9bba7e7d33. Latest consensus state: current_term: 1 leader_uuid: "c8ac038d5cae4b1eb3e03a9bba7e7d33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8ac038d5cae4b1eb3e03a9bba7e7d33" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34413 } } }
I20260811 17:08:59.199237 18430 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33 [sys.catalog]: This master's current role is: LEADER
I20260811 17:08:59.199990 18428 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c8ac038d5cae4b1eb3e03a9bba7e7d33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8ac038d5cae4b1eb3e03a9bba7e7d33" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34413 } } }
I20260811 17:08:59.200140 18428 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33 [sys.catalog]: This master's current role is: LEADER
W20260811 17:08:59.203169 18459 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 17:08:59.203250 18459 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 17:08:59.203337 18442 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:08:59.204151 18442 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:08:59.211388 18442 catalog_manager.cc:1347] Generated new cluster ID: 389a114787a94e7b8304aaf47b4f33ba
I20260811 17:08:59.211484 18442 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:08:59.223692 18442 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:08:59.225188 18442 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:08:59.231725 18442 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33: Generated new TSK 0
I20260811 17:08:59.232656 18442 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.4.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.193.keytab.
Entry for principal oryx/127.4.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.193.keytab.
I20260811 17:08:59.276459 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:34413
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.193.keytab
--principal=oryx/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:34533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:59.402804 18469 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:59.403170 18469 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:59.403272 18469 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:59.407610 18469 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:59.407728 18469 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:59.407811 18469 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 17:08:59.407894 18469 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:08:59.413564 18469 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:34533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.193.keytab
--principal=oryx/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.146.254:34413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18469
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:59.414835 18469 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:59.416078 18469 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:59.426854 18476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:59.427371 18482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:59.427583 18469 server_base.cc:1034] running on GCE node
W20260811 17:08:59.427393 18478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:59.428385 18469 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:59.429337 18469 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:59.430564 18469 hybrid_clock.cc:648] HybridClock initialized: now 1786468139430538 us; error 52 us; skew 500 ppm
Aug 11 17:08:59 dist-test-slave-7vjv krb5kdc[18258](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468139, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:59.434098 18469 init.cc:377] Logged in from keytab as oryx/127.4.146.193@KRBTEST.COM (short username oryx)
I20260811 17:08:59.435204 18469 webserver.cc:460] Webserver started at http://127.4.146.193:38897/ using document root <none> and password file <none>
I20260811 17:08:59.435870 18469 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:59.435992 18469 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:59.436309 18469 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:59.438664 18469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "eb44dd7038fb4b2f93f90652f9bcfae0"
format_stamp: "Formatted at 2026-08-11 17:08:59 on dist-test-slave-7vjv"
server_key: "e1a20ef0ddaef74d821f8be6576efdcd"
server_key_iv: "8b8c8ce3b412d12f63c6071a994182e0"
server_key_version: "encryptionkey@0"
I20260811 17:08:59.439338 18469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "eb44dd7038fb4b2f93f90652f9bcfae0"
format_stamp: "Formatted at 2026-08-11 17:08:59 on dist-test-slave-7vjv"
server_key: "e1a20ef0ddaef74d821f8be6576efdcd"
server_key_iv: "8b8c8ce3b412d12f63c6071a994182e0"
server_key_version: "encryptionkey@0"
I20260811 17:08:59.444022 18469 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260811 17:08:59.446818 18493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:59.448354 18469 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:08:59.448526 18469 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "eb44dd7038fb4b2f93f90652f9bcfae0"
format_stamp: "Formatted at 2026-08-11 17:08:59 on dist-test-slave-7vjv"
server_key: "e1a20ef0ddaef74d821f8be6576efdcd"
server_key_iv: "8b8c8ce3b412d12f63c6071a994182e0"
server_key_version: "encryptionkey@0"
I20260811 17:08:59.448673 18469 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:59.470436 18469 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:59.474630 18469 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:59.474895 18469 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:59.476725 18469 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:59.476812 18469 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:59.476879 18469 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:59.476920 18469 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 17:08:59 dist-test-slave-7vjv krb5kdc[18258](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468139, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM
I20260811 17:08:59.489869 18469 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:33001
I20260811 17:08:59.489980 18711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:33001 every 8 connection(s)
I20260811 17:08:59.491282 18469 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:08:59.493603 18422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:59.477635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:40511 (local address 127.4.146.254:34413)
0811 17:08:59.477777 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:59.477781 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:59.479073 (+ 1292us) server_negotiation.cc:407] Connection header received
0811 17:08:59.480423 (+ 1350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:59.480427 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:59.480529 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:59.480644 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:59.482187 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:59.482802 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:59.484505 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:59.484780 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:59.484924 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:59.488971 (+ 4047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:59.488976 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:59.488978 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:59.489011 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:59.490927 (+ 1916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:59.491615 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:59.491621 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:59.491625 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:59.491742 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:59.492237 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:59.492241 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:59.492244 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:59.492458 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:59.492542 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:59.493191 (+ 649us) server_negotiation.cc:299] Negotiation successful
0811 17:08:59.493448 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 17:08:59.494292 18507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:59.478268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34413 (local address 127.4.146.193:40511)
0811 17:08:59.478867 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:59.478921 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:59.480137 (+ 1216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:59.480858 (+ 721us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:59.480866 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:59.481418 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:59.481982 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:59.482009 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:59.482971 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:59.482975 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:59.484329 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:59.484343 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:59.484994 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:59.485008 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:59.485406 (+ 398us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:59.486292 (+ 886us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:59.486312 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:59.488718 (+ 2406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:59.491090 (+ 2372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:59.491095 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:59.491112 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:59.491456 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:59.491873 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:59.491877 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:59.491879 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:59.492069 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:59.492561 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:59.492567 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:59.492849 (+ 282us) client_negotiation.cc:769] Sending connection context
0811 17:08:59.493017 (+ 168us) client_negotiation.cc:240] Negotiation successful
0811 17:08:59.493342 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":163,"threads_started":1}
I20260811 17:08:59.495747 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 18469
I20260811 17:08:59.495905 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
I20260811 17:08:59.495927 18712 heartbeater.cc:347] Connected to a master server at 127.4.146.254:34413
I20260811 17:08:59.496227 18712 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:59.496340 4683 external_mini_cluster.cc:1428] Setting key cb8824daf784dd67a835a1cc7d44d7e7
I20260811 17:08:59.496937 18712 heartbeater.cc:511] Master 127.4.146.254:34413 requested a full tablet report, sending...
I20260811 17:08:59.498708 18342 ts_manager.cc:194] Registered new tserver with Master: eb44dd7038fb4b2f93f90652f9bcfae0 (127.4.146.193:33001)
I20260811 17:08:59.500175 18342 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.146.193@KRBTEST.COM'} at 127.4.146.193:40511
WARNING: no policy specified for oryx/127.4.146.194@KRBTEST.COM; defaulting to no policy
I20260811 17:08:59.509629 18422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:59.500844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:57687 (local address 127.4.146.254:34413)
0811 17:08:59.500966 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:59.500971 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:59.500986 (+ 15us) server_negotiation.cc:407] Connection header received
0811 17:08:59.501072 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:59.501074 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:59.501120 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:59.501208 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:59.501929 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:59.502680 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:59.504135 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:59.504418 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:59.504521 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:59.506125 (+ 1604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:59.506128 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:59.506130 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:59.506156 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:59.507702 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:59.508339 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:59.508342 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:59.508343 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:59.508445 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:59.508822 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:59.508825 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:59.508826 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:59.509027 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:59.509115 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:59.509394 (+ 279us) server_negotiation.cc:299] Negotiation successful
0811 17:08:59.509501 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 17:08:59.509622 18721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:59.500446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34413 (local address 127.4.146.193:57687)
0811 17:08:59.500844 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:59.500865 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:59.500977 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:59.501250 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:59.501254 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:59.501533 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:59.501781 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:59.501790 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:59.502841 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:59.502848 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:59.503912 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:59.503928 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:59.504563 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:59.504568 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:59.504725 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:59.505344 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:59.505366 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:59.505921 (+ 555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:59.507833 (+ 1912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:59.507839 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:59.507841 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:59.508199 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:59.508562 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:59.508567 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:59.508570 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:59.508699 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:59.509135 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:59.509137 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:59.509235 (+ 98us) client_negotiation.cc:769] Sending connection context
0811 17:08:59.509327 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 17:08:59.509462 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"mutex_wait_us":3,"thread_start_us":135,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.194.keytab.
Entry for principal oryx/127.4.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.194.keytab.
I20260811 17:08:59.533375 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:34413
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.194.keytab
--principal=oryx/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:34533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:59.660360 18727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:59.660732 18727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:59.660826 18727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:59.665118 18727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:59.665226 18727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:59.665303 18727 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 17:08:59.665387 18727 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:08:59.671038 18727 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:34533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.194.keytab
--principal=oryx/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.146.254:34413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18727
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:59.672365 18727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:59.673480 18727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:59.683864 18737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:59.683864 18739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:59.683877 18736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:59.684185 18727 server_base.cc:1034] running on GCE node
I20260811 17:08:59.684808 18727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:59.685518 18727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:59.686726 18727 hybrid_clock.cc:648] HybridClock initialized: now 1786468139686707 us; error 33 us; skew 500 ppm
Aug 11 17:08:59 dist-test-slave-7vjv krb5kdc[18258](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468139, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:59.690119 18727 init.cc:377] Logged in from keytab as oryx/127.4.146.194@KRBTEST.COM (short username oryx)
I20260811 17:08:59.691190 18727 webserver.cc:460] Webserver started at http://127.4.146.194:33147/ using document root <none> and password file <none>
I20260811 17:08:59.691839 18727 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:59.691944 18727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:59.692273 18727 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:59.694540 18727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "c3e66afb9f7c4e1099b947435d9b8ce4"
format_stamp: "Formatted at 2026-08-11 17:08:59 on dist-test-slave-7vjv"
server_key: "01ba41b1b809d9aef39eac0807ddbe5c"
server_key_iv: "b00a931de007eaefbccf34e19c5f4a2f"
server_key_version: "encryptionkey@0"
I20260811 17:08:59.695223 18727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "c3e66afb9f7c4e1099b947435d9b8ce4"
format_stamp: "Formatted at 2026-08-11 17:08:59 on dist-test-slave-7vjv"
server_key: "01ba41b1b809d9aef39eac0807ddbe5c"
server_key_iv: "b00a931de007eaefbccf34e19c5f4a2f"
server_key_version: "encryptionkey@0"
I20260811 17:08:59.700179 18727 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 17:08:59.703217 18753 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:59.704815 18727 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:08:59.704996 18727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "c3e66afb9f7c4e1099b947435d9b8ce4"
format_stamp: "Formatted at 2026-08-11 17:08:59 on dist-test-slave-7vjv"
server_key: "01ba41b1b809d9aef39eac0807ddbe5c"
server_key_iv: "b00a931de007eaefbccf34e19c5f4a2f"
server_key_version: "encryptionkey@0"
I20260811 17:08:59.705142 18727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:59.722579 18727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:59.726080 18727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:59.726333 18727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:59.727934 18727 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:59.728015 18727 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:59.728134 18727 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:59.728178 18727 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:59.740281 18727 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:45395
Aug 11 17:08:59 dist-test-slave-7vjv krb5kdc[18258](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468139, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM
I20260811 17:08:59.740428 18950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:45395 every 8 connection(s)
I20260811 17:08:59.741416 18727 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:08:59.742702 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 18727
I20260811 17:08:59.742839 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:08:59.743187 4683 external_mini_cluster.cc:1428] Setting key 2b906b9b9223f384d9b486222df79476
I20260811 17:08:59.745724 18422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:59.729067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:51861 (local address 127.4.146.254:34413)
0811 17:08:59.729220 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:59.729224 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:59.730404 (+ 1180us) server_negotiation.cc:407] Connection header received
0811 17:08:59.731813 (+ 1409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:59.731817 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:59.731886 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:59.731981 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:59.734152 (+ 2171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:59.735217 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:59.737171 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:59.737439 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:59.737576 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:59.741105 (+ 3529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:59.741109 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:59.741111 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:59.741143 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:59.743189 (+ 2046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:59.743763 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:59.743770 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:59.743771 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:59.743867 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:59.744360 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:59.744363 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:59.744364 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:59.744553 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:59.744697 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:59.745350 (+ 653us) server_negotiation.cc:299] Negotiation successful
0811 17:08:59.745498 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 17:08:59.746654 18768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:59.729640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34413 (local address 127.4.146.194:51861)
0811 17:08:59.730214 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:59.730265 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:59.731512 (+ 1247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:59.732544 (+ 1032us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:59.732557 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:59.733131 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:59.733971 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:59.733998 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:59.735363 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:59.735367 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:59.737018 (+ 1651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:59.737031 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:59.737632 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:59.737636 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:59.737901 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:59.738731 (+ 830us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:59.738757 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:59.740853 (+ 2096us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:59.743339 (+ 2486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:59.743345 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:59.743361 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:59.743641 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:59.744005 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:59.744009 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:59.744011 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:59.744248 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:59.744728 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:59.744736 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:59.745067 (+ 331us) client_negotiation.cc:769] Sending connection context
0811 17:08:59.745257 (+ 190us) client_negotiation.cc:240] Negotiation successful
0811 17:08:59.745572 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":153,"threads_started":1}
I20260811 17:08:59.748272 18951 heartbeater.cc:347] Connected to a master server at 127.4.146.254:34413
I20260811 17:08:59.748458 18951 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:59.749014 18951 heartbeater.cc:511] Master 127.4.146.254:34413 requested a full tablet report, sending...
I20260811 17:08:59.750204 18342 ts_manager.cc:194] Registered new tserver with Master: c3e66afb9f7c4e1099b947435d9b8ce4 (127.4.146.194:45395)
I20260811 17:08:59.750772 18342 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.146.194@KRBTEST.COM'} at 127.4.146.194:51861
WARNING: no policy specified for oryx/127.4.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.146.195@KRBTEST.COM" created.
I20260811 17:08:59.761755 18422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:59.751454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:44567 (local address 127.4.146.254:34413)
0811 17:08:59.751605 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:59.751610 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:59.752313 (+ 703us) server_negotiation.cc:407] Connection header received
0811 17:08:59.752448 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:59.752451 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:59.752500 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:59.752590 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:59.753506 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:59.754489 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:59.756157 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:59.756392 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:59.756482 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:59.758150 (+ 1668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:59.758153 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:59.758155 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:59.758183 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:59.759874 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:59.760442 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:59.760445 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:59.760447 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:59.760530 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:59.760825 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:59.760828 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:59.760829 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:59.761082 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:59.761185 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:59.761426 (+ 241us) server_negotiation.cc:299] Negotiation successful
0811 17:08:59.761530 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 17:08:59.761833 18969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:59.751049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34413 (local address 127.4.146.194:44567)
0811 17:08:59.752195 (+ 1146us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:59.752216 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:59.752353 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:59.752690 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:59.752697 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:59.753129 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:59.753316 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:59.753327 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:59.754734 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:59.754741 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:59.755946 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:59.755960 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:59.756537 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:59.756544 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:59.756681 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:59.757352 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:59.757375 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:59.757912 (+ 537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:59.760034 (+ 2122us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:59.760040 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:59.760048 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:59.760343 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:59.760623 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:59.760626 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:59.760627 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:59.760712 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:59.761192 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:59.761195 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:59.761299 (+ 104us) client_negotiation.cc:769] Sending connection context
0811 17:08:59.761388 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 17:08:59.761621 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":124,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.195.keytab.
Entry for principal oryx/127.4.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.195.keytab.
I20260811 17:08:59.780308 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:34413
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.195.keytab
--principal=oryx/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:34533
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:08:59.908480 18973 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:08:59.908995 18973 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:08:59.909070 18973 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:08:59.913800 18973 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:08:59.913908 18973 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:08:59.913952 18973 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 17:08:59.913988 18973 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:08:59.920310 18973 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:34533
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.195.keytab
--principal=oryx/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.4.146.254:34413
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18973
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:08:59.921579 18973 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:08:59.922711 18973 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:08:59.933897 18982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:08:59.933905 18989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:59.934127 18973 server_base.cc:1034] running on GCE node
W20260811 17:08:59.933905 18983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:08:59.934753 18973 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:08:59.935506 18973 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:08:59.936699 18973 hybrid_clock.cc:648] HybridClock initialized: now 1786468139936676 us; error 35 us; skew 500 ppm
Aug 11 17:08:59 dist-test-slave-7vjv krb5kdc[18258](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468139, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:08:59.939870 18973 init.cc:377] Logged in from keytab as oryx/127.4.146.195@KRBTEST.COM (short username oryx)
I20260811 17:08:59.940924 18973 webserver.cc:460] Webserver started at http://127.4.146.195:38713/ using document root <none> and password file <none>
I20260811 17:08:59.941537 18973 fs_manager.cc:359] Metadata directory not provided
I20260811 17:08:59.941677 18973 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:08:59.941939 18973 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:08:59.944314 18973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "b43ac4cbb8f2463980c032920066085d"
format_stamp: "Formatted at 2026-08-11 17:08:59 on dist-test-slave-7vjv"
server_key: "4270051e740e0368a9de4d71f8b6fe09"
server_key_iv: "6db6caab5276636fa4547543f743d459"
server_key_version: "encryptionkey@0"
I20260811 17:08:59.944974 18973 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "b43ac4cbb8f2463980c032920066085d"
format_stamp: "Formatted at 2026-08-11 17:08:59 on dist-test-slave-7vjv"
server_key: "4270051e740e0368a9de4d71f8b6fe09"
server_key_iv: "6db6caab5276636fa4547543f743d459"
server_key_version: "encryptionkey@0"
I20260811 17:08:59.949366 18973 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 17:08:59.952527 19000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:59.954104 18973 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 17:08:59.954281 18973 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "b43ac4cbb8f2463980c032920066085d"
format_stamp: "Formatted at 2026-08-11 17:08:59 on dist-test-slave-7vjv"
server_key: "4270051e740e0368a9de4d71f8b6fe09"
server_key_iv: "6db6caab5276636fa4547543f743d459"
server_key_version: "encryptionkey@0"
I20260811 17:08:59.954412 18973 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:08:59.975063 18973 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:08:59.978878 18973 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:08:59.979139 18973 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:08:59.981160 18973 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:08:59.981225 18973 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:08:59.981271 18973 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:08:59.981330 18973 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 17:08:59 dist-test-slave-7vjv krb5kdc[18258](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468139, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM
I20260811 17:08:59.992998 18973 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:45501
I20260811 17:08:59.993093 19197 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:45501 every 8 connection(s)
I20260811 17:08:59.994246 18973 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:08:59.997189 18422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:59.982269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:40409 (local address 127.4.146.254:34413)
0811 17:08:59.982437 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 17:08:59.982443 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:08:59.983383 (+ 940us) server_negotiation.cc:407] Connection header received
0811 17:08:59.984816 (+ 1433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:08:59.984819 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:08:59.984884 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:08:59.984999 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:08:59.986775 (+ 1776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:59.987672 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:59.989058 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:08:59.989298 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:08:59.989423 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:59.992742 (+ 3319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:08:59.992748 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:08:59.992751 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:08:59.992787 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:08:59.994695 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:59.995467 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:59.995471 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:59.995473 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:59.995592 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:08:59.995939 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:08:59.995942 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:08:59.995971 (+ 29us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:08:59.996263 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:08:59.996352 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 17:08:59.996910 (+ 558us) server_negotiation.cc:299] Negotiation successful
0811 17:08:59.997036 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 17:08:59.998080 19016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:08:59.982734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34413 (local address 127.4.146.195:40409)
0811 17:08:59.983215 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0811 17:08:59.983271 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 17:08:59.984547 (+ 1276us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:08:59.985206 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:08:59.985217 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:08:59.985716 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:08:59.986563 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:59.986587 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:59.987799 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:59.987803 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:59.988893 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:08:59.988905 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:08:59.989486 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:08:59.989490 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:08:59.989713 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:08:59.990457 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:08:59.990487 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:08:59.992529 (+ 2042us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:08:59.994856 (+ 2327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:59.994862 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:59.994877 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:59.995325 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:59.995685 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:08:59.995687 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:08:59.995689 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:08:59.995824 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:08:59.996379 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:08:59.996385 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:08:59.996640 (+ 255us) client_negotiation.cc:769] Sending connection context
0811 17:08:59.996801 (+ 161us) client_negotiation.cc:240] Negotiation successful
0811 17:08:59.997071 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":142,"threads_started":1}
I20260811 17:08:59.999593 19199 heartbeater.cc:347] Connected to a master server at 127.4.146.254:34413
I20260811 17:08:59.999785 19199 heartbeater.cc:464] Registering TS with master...
I20260811 17:08:59.999890 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 18973
I20260811 17:09:00.000037 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:09:00.000418 4683 external_mini_cluster.cc:1428] Setting key 685a2f345e24294283f4675bd29cd423
I20260811 17:09:00.000617 19199 heartbeater.cc:511] Master 127.4.146.254:34413 requested a full tablet report, sending...
I20260811 17:09:00.001812 18345 ts_manager.cc:194] Registered new tserver with Master: b43ac4cbb8f2463980c032920066085d (127.4.146.195:45501)
I20260811 17:09:00.002880 18345 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.4.146.195@KRBTEST.COM'} at 127.4.146.195:40409
I20260811 17:09:00.003089 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 17:09:00.011065 19208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:00.002373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34413 (local address 127.4.146.195:53483)
0811 17:09:00.002749 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:00.002767 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:00.002864 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:00.003226 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:00.003229 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:00.003473 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:00.003612 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:00.003621 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.004687 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.004693 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:00.005689 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:00.005706 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.006403 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.006406 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:00.006488 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:00.007071 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:00.007111 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:00.007466 (+ 355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:09:00.009351 (+ 1885us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:09:00.009355 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:09:00.009357 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:09:00.009578 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:09:00.009909 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:09:00.009913 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:09:00.009915 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:09:00.010004 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:09:00.010460 (+ 456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:09:00.010463 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:09:00.010574 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 17:09:00.010693 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 17:09:00.010868 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":140,"threads_started":1}
I20260811 17:09:00.011051 18422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:00.002797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:53483 (local address 127.4.146.254:34413)
0811 17:09:00.002941 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:00.002948 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:00.002965 (+ 17us) server_negotiation.cc:407] Connection header received
0811 17:09:00.003005 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:00.003007 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:00.003046 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:00.003141 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:00.003754 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.004534 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.005850 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.006272 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.006397 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:00.007607 (+ 1210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:09:00.007610 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:09:00.007612 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:09:00.007636 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:09:00.009204 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:00.009704 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:00.009709 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:00.009715 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:00.009795 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:00.010137 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:00.010139 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:00.010141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:00.010353 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:09:00.010474 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:00.010751 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 17:09:00.010881 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
Aug 11 17:09:00 dist-test-slave-7vjv krb5kdc[18258](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468140, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 17:09:00 dist-test-slave-7vjv krb5kdc[18258](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:00 dist-test-slave-7vjv krb5kdc[18258](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 17:09:00.033437 18422 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:00.026037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40268 (local address 127.4.146.254:34413)
0811 17:09:00.026189 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:00.026193 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:00.026208 (+ 15us) server_negotiation.cc:407] Connection header received
0811 17:09:00.026256 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:00.026259 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:00.026299 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:00.026383 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:00.027399 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.027968 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.029159 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.029395 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.029511 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:00.033237 (+ 3726us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40268: BlockingRecv error: recv got EOF from 127.0.0.1:40268 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 17:09:00 dist-test-slave-7vjv krb5kdc[18258](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468140, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM
I20260811 17:09:00.044018 18422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:00.035082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40284 (local address 127.4.146.254:34413)
0811 17:09:00.035223 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:00.035229 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:00.035318 (+ 89us) server_negotiation.cc:407] Connection header received
0811 17:09:00.035497 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:00.035500 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:00.035544 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:00.035630 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:00.036388 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.036926 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.037758 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.037983 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.038102 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:00.040642 (+ 2540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:09:00.040646 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:09:00.040648 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:09:00.040677 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:09:00.042168 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:00.042634 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:00.042638 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:00.042641 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:00.042730 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:00.043048 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:00.043052 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:00.043054 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:00.043290 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:09:00.043443 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:00.043702 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 17:09:00.043835 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 17:09:00.047636 18345 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40284:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 17:09:00.051257 18345 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:09:00.067456 19241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:00.061715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:45395 (local address 127.0.0.1:50882)
0811 17:09:00.061968 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:00.061981 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:00.062143 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:00.062931 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:00.062937 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:00.062960 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:09:00.063066 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:00.063072 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.064461 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.064464 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:00.065904 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:00.065916 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.066805 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.066809 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:00.066918 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:00.066958 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 17:09:00.067121 (+ 163us) client_negotiation.cc:240] Negotiation successful
0811 17:09:00.067298 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":155,"thread_start_us":106,"threads_started":1}
I20260811 17:09:00.067441 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:00.061899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50882 (local address 127.4.146.194:45395)
0811 17:09:00.062256 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:00.062272 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:00.062295 (+ 23us) server_negotiation.cc:407] Connection header received
0811 17:09:00.062370 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:00.062375 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:00.062773 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:00.062934 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:09:00.063202 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.064332 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.066061 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.066662 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.066791 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:00.066985 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:00.067155 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 17:09:00.067264 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":102,"threads_started":1}
I20260811 17:09:00.067497 19238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:00.060945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:45501 (local address 127.0.0.1:58158)
0811 17:09:00.061641 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:00.061655 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:00.061748 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:00.063015 (+ 1267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:00.063018 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:00.063031 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:09:00.063096 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:00.063101 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.064223 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.064230 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:00.065904 (+ 1674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:00.065916 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.066958 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.066962 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:00.067058 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:00.067113 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 17:09:00.067166 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 17:09:00.067307 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":631,"mutex_wait_us":194,"thread_start_us":105,"threads_started":1}
I20260811 17:09:00.067497 19239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:00.060922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:33001 (local address 127.0.0.1:51766)
0811 17:09:00.061353 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:00.061405 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:00.061536 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:00.062748 (+ 1212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:00.062754 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:00.062778 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:09:00.062943 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:00.062951 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.064494 (+ 1543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.064497 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:00.065726 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:00.065735 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.067057 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.067060 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:00.067169 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:00.067189 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 17:09:00.067258 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 17:09:00.067330 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"mutex_wait_us":58,"thread_start_us":108,"threads_started":1}
I20260811 17:09:00.067996 19240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:00.061056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51766 (local address 127.4.146.193:33001)
0811 17:09:00.061474 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:00.061481 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:00.061509 (+ 28us) server_negotiation.cc:407] Connection header received
0811 17:09:00.062266 (+ 757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:00.062275 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:00.062510 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:00.062676 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:09:00.063084 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.064332 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.065857 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.066716 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.066830 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:00.067002 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:00.067702 (+ 700us) server_negotiation.cc:299] Negotiation successful
0811 17:09:00.067840 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":96,"threads_started":1}
I20260811 17:09:00.068240 19243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:00.062142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58158 (local address 127.4.146.195:45501)
0811 17:09:00.062546 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:00.062558 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:00.062598 (+ 40us) server_negotiation.cc:407] Connection header received
0811 17:09:00.062671 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:00.062676 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:00.062844 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:00.063241 (+ 397us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:09:00.063343 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.064052 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.066046 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.066823 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.067720 (+ 897us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:00.067919 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:00.067964 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 17:09:00.068042 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":116,"threads_started":1}
I20260811 17:09:00.071182 18593 tablet_service.cc:1467] Processing CreateTablet for tablet 6d385796e89249fb99042ba9708ae993 (DEFAULT_TABLE table=test-table [id=a6e81298d2c84a21b2644cb4b2468335]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:09:00.071607 18837 tablet_service.cc:1467] Processing CreateTablet for tablet 6d385796e89249fb99042ba9708ae993 (DEFAULT_TABLE table=test-table [id=a6e81298d2c84a21b2644cb4b2468335]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:09:00.071597 19089 tablet_service.cc:1467] Processing CreateTablet for tablet 6d385796e89249fb99042ba9708ae993 (DEFAULT_TABLE table=test-table [id=a6e81298d2c84a21b2644cb4b2468335]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:09:00.072572 18593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d385796e89249fb99042ba9708ae993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:09:00.072724 19089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d385796e89249fb99042ba9708ae993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:09:00.072724 18837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d385796e89249fb99042ba9708ae993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:09:00.080850 19244 tablet_bootstrap.cc:492] T 6d385796e89249fb99042ba9708ae993 P eb44dd7038fb4b2f93f90652f9bcfae0: Bootstrap starting.
I20260811 17:09:00.082229 19245 tablet_bootstrap.cc:492] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4: Bootstrap starting.
I20260811 17:09:00.083072 19249 tablet_bootstrap.cc:492] T 6d385796e89249fb99042ba9708ae993 P b43ac4cbb8f2463980c032920066085d: Bootstrap starting.
I20260811 17:09:00.084443 19245 tablet_bootstrap.cc:654] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4: Neither blocks nor log segments found. Creating new log.
I20260811 17:09:00.084460 19244 tablet_bootstrap.cc:654] T 6d385796e89249fb99042ba9708ae993 P eb44dd7038fb4b2f93f90652f9bcfae0: Neither blocks nor log segments found. Creating new log.
I20260811 17:09:00.085289 19245 log.cc:824] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4: Log is configured to *not* fsync() on all Append() calls
I20260811 17:09:00.085305 19249 tablet_bootstrap.cc:654] T 6d385796e89249fb99042ba9708ae993 P b43ac4cbb8f2463980c032920066085d: Neither blocks nor log segments found. Creating new log.
I20260811 17:09:00.085354 19244 log.cc:824] T 6d385796e89249fb99042ba9708ae993 P eb44dd7038fb4b2f93f90652f9bcfae0: Log is configured to *not* fsync() on all Append() calls
I20260811 17:09:00.086236 19249 log.cc:824] T 6d385796e89249fb99042ba9708ae993 P b43ac4cbb8f2463980c032920066085d: Log is configured to *not* fsync() on all Append() calls
I20260811 17:09:00.087555 19245 tablet_bootstrap.cc:492] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4: No bootstrap required, opened a new log
I20260811 17:09:00.087591 19244 tablet_bootstrap.cc:492] T 6d385796e89249fb99042ba9708ae993 P eb44dd7038fb4b2f93f90652f9bcfae0: No bootstrap required, opened a new log
I20260811 17:09:00.087793 19245 ts_tablet_manager.cc:1397] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 17:09:00.087797 19244 ts_tablet_manager.cc:1397] T 6d385796e89249fb99042ba9708ae993 P eb44dd7038fb4b2f93f90652f9bcfae0: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 17:09:00.088433 19249 tablet_bootstrap.cc:492] T 6d385796e89249fb99042ba9708ae993 P b43ac4cbb8f2463980c032920066085d: No bootstrap required, opened a new log
I20260811 17:09:00.088640 19249 ts_tablet_manager.cc:1397] T 6d385796e89249fb99042ba9708ae993 P b43ac4cbb8f2463980c032920066085d: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 17:09:00.091276 19245 raft_consensus.cc:348] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } }
I20260811 17:09:00.091574 19245 raft_consensus.cc:374] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:09:00.091643 19245 raft_consensus.cc:729] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3e66afb9f7c4e1099b947435d9b8ce4, State: Initialized, Role: FOLLOWER
I20260811 17:09:00.092240 19245 consensus_queue.cc:260] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } }
I20260811 17:09:00.092681 19244 raft_consensus.cc:348] T 6d385796e89249fb99042ba9708ae993 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } }
I20260811 17:09:00.092973 19244 raft_consensus.cc:374] T 6d385796e89249fb99042ba9708ae993 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:09:00.093047 19244 raft_consensus.cc:729] T 6d385796e89249fb99042ba9708ae993 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb44dd7038fb4b2f93f90652f9bcfae0, State: Initialized, Role: FOLLOWER
I20260811 17:09:00.093065 18951 heartbeater.cc:503] Master 127.4.146.254:34413 was elected leader, sending a full tablet report...
I20260811 17:09:00.093482 19245 ts_tablet_manager.cc:1428] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 17:09:00.093510 19244 consensus_queue.cc:260] T 6d385796e89249fb99042ba9708ae993 P eb44dd7038fb4b2f93f90652f9bcfae0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } }
I20260811 17:09:00.092681 19249 raft_consensus.cc:348] T 6d385796e89249fb99042ba9708ae993 P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } }
I20260811 17:09:00.094194 18712 heartbeater.cc:503] Master 127.4.146.254:34413 was elected leader, sending a full tablet report...
I20260811 17:09:00.094249 19249 raft_consensus.cc:374] T 6d385796e89249fb99042ba9708ae993 P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:09:00.094311 19249 raft_consensus.cc:729] T 6d385796e89249fb99042ba9708ae993 P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b43ac4cbb8f2463980c032920066085d, State: Initialized, Role: FOLLOWER
I20260811 17:09:00.094537 19244 ts_tablet_manager.cc:1428] T 6d385796e89249fb99042ba9708ae993 P eb44dd7038fb4b2f93f90652f9bcfae0: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260811 17:09:00.094805 19249 consensus_queue.cc:260] T 6d385796e89249fb99042ba9708ae993 P b43ac4cbb8f2463980c032920066085d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } }
I20260811 17:09:00.095923 19249 ts_tablet_manager.cc:1428] T 6d385796e89249fb99042ba9708ae993 P b43ac4cbb8f2463980c032920066085d: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260811 17:09:00.096221 19199 heartbeater.cc:503] Master 127.4.146.254:34413 was elected leader, sending a full tablet report...
W20260811 17:09:00.242830 18952 tablet.cc:2369] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 17:09:00.242864 18713 tablet.cc:2369] T 6d385796e89249fb99042ba9708ae993 P eb44dd7038fb4b2f93f90652f9bcfae0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 17:09:00.245556 19200 tablet.cc:2369] T 6d385796e89249fb99042ba9708ae993 P b43ac4cbb8f2463980c032920066085d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 17:09:00.270156 19257 raft_consensus.cc:482] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:09:00.270455 19257 raft_consensus.cc:504] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } }
I20260811 17:09:00.271763 19257 leader_election.cc:288] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb44dd7038fb4b2f93f90652f9bcfae0 (127.4.146.193:33001), b43ac4cbb8f2463980c032920066085d (127.4.146.195:45501)
I20260811 17:09:00.276373 19243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:00.272421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:38845 (local address 127.4.146.195:45501)
0811 17:09:00.272549 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:00.272554 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:00.272743 (+ 189us) server_negotiation.cc:407] Connection header received
0811 17:09:00.272908 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:00.272911 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:00.272965 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:00.273032 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:09:00.273405 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.273951 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.275249 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.275652 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.275783 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:00.275844 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:00.276072 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 17:09:00.276213 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 17:09:00.276399 19263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:00.272152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:45501 (local address 127.4.146.194:38845)
0811 17:09:00.272625 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:00.272640 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:00.272755 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:00.273077 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:00.273081 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:00.273103 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:09:00.273272 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:00.273280 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.274074 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.274078 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:00.275078 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:00.275111 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.275790 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.275794 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:00.275905 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:00.275954 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 17:09:00.276018 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 17:09:00.276162 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"mutex_wait_us":68,"thread_start_us":104,"threads_started":1}
I20260811 17:09:00.276870 19264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:00.272167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:33001 (local address 127.4.146.194:39363)
0811 17:09:00.272673 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:00.272685 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:00.272838 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:00.273167 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:00.273170 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:00.273186 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:09:00.273323 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:00.273353 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.274189 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.274191 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:00.275035 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:00.275045 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.275819 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.275823 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:00.275959 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:00.275977 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 17:09:00.276263 (+ 286us) client_negotiation.cc:240] Negotiation successful
0811 17:09:00.276336 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"mutex_wait_us":205,"thread_start_us":56,"threads_started":1}
I20260811 17:09:00.276878 19240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:00.272286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:39363 (local address 127.4.146.193:33001)
0811 17:09:00.272457 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:00.272461 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:00.272830 (+ 369us) server_negotiation.cc:407] Connection header received
0811 17:09:00.272960 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:00.272963 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:00.273034 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:00.273131 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:09:00.273471 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.274065 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.275170 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.275661 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.275814 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:00.275874 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:00.276604 (+ 730us) server_negotiation.cc:299] Negotiation successful
0811 17:09:00.276710 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 17:09:00.277184 19117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d385796e89249fb99042ba9708ae993" candidate_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b43ac4cbb8f2463980c032920066085d" is_pre_election: true
I20260811 17:09:00.277675 19117 raft_consensus.cc:2454] T 6d385796e89249fb99042ba9708ae993 P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3e66afb9f7c4e1099b947435d9b8ce4 in term 0.
I20260811 17:09:00.277738 18631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d385796e89249fb99042ba9708ae993" candidate_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" is_pre_election: true
I20260811 17:09:00.278050 18631 raft_consensus.cc:2454] T 6d385796e89249fb99042ba9708ae993 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3e66afb9f7c4e1099b947435d9b8ce4 in term 0.
I20260811 17:09:00.278285 18760 leader_election.cc:302] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b43ac4cbb8f2463980c032920066085d, c3e66afb9f7c4e1099b947435d9b8ce4; no voters:
I20260811 17:09:00.278654 19257 raft_consensus.cc:2781] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:09:00.278743 19257 raft_consensus.cc:482] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:09:00.278775 19257 raft_consensus.cc:3037] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:09:00.279997 19257 raft_consensus.cc:504] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } }
I20260811 17:09:00.280519 19257 leader_election.cc:288] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4 [CANDIDATE]: Term 1 election: Requested vote from peers eb44dd7038fb4b2f93f90652f9bcfae0 (127.4.146.193:33001), b43ac4cbb8f2463980c032920066085d (127.4.146.195:45501)
I20260811 17:09:00.280958 18631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d385796e89249fb99042ba9708ae993" candidate_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0"
I20260811 17:09:00.280980 19117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d385796e89249fb99042ba9708ae993" candidate_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b43ac4cbb8f2463980c032920066085d"
I20260811 17:09:00.281128 19117 raft_consensus.cc:3037] T 6d385796e89249fb99042ba9708ae993 P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:09:00.281136 18631 raft_consensus.cc:3037] T 6d385796e89249fb99042ba9708ae993 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:09:00.282351 18631 raft_consensus.cc:2454] T 6d385796e89249fb99042ba9708ae993 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3e66afb9f7c4e1099b947435d9b8ce4 in term 1.
I20260811 17:09:00.282502 19117 raft_consensus.cc:2454] T 6d385796e89249fb99042ba9708ae993 P b43ac4cbb8f2463980c032920066085d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3e66afb9f7c4e1099b947435d9b8ce4 in term 1.
I20260811 17:09:00.282775 18756 leader_election.cc:302] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3e66afb9f7c4e1099b947435d9b8ce4, eb44dd7038fb4b2f93f90652f9bcfae0; no voters:
I20260811 17:09:00.283026 19257 raft_consensus.cc:2781] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:09:00.283274 19257 raft_consensus.cc:686] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 1 LEADER]: Becoming Leader. State: Replica: c3e66afb9f7c4e1099b947435d9b8ce4, State: Running, Role: LEADER
I20260811 17:09:00.283632 19257 consensus_queue.cc:237] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } }
I20260811 17:09:00.286963 18342 catalog_manager.cc:5495] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3e66afb9f7c4e1099b947435d9b8ce4 (127.4.146.194). New cstate: current_term: 1 leader_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } health_report { overall_health: HEALTHY } } }
I20260811 17:09:00.313741 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:00.309472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50898 (local address 127.4.146.194:45395)
0811 17:09:00.309630 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:00.309635 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:00.309676 (+ 41us) server_negotiation.cc:407] Connection header received
0811 17:09:00.309779 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:00.309782 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:00.309845 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:00.310049 (+ 204us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:09:00.310372 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.310999 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.312006 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.312286 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.312417 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:00.312762 (+ 345us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:09:00.313272 (+ 510us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:09:00.313417 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:00.313492 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 17:09:00.313561 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 17:09:00.320757 19117 raft_consensus.cc:1261] T 6d385796e89249fb99042ba9708ae993 P b43ac4cbb8f2463980c032920066085d [term 1 FOLLOWER]: Refusing update from remote peer c3e66afb9f7c4e1099b947435d9b8ce4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:09:00.320757 18631 raft_consensus.cc:1261] T 6d385796e89249fb99042ba9708ae993 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 1 FOLLOWER]: Refusing update from remote peer c3e66afb9f7c4e1099b947435d9b8ce4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:09:00.321600 19266 consensus_queue.cc:1035] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:09:00.321830 19257 consensus_queue.cc:1035] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:09:00.331869 19273 mvcc.cc:205] Tried to move back new op lower bound from 7317373502745477120 to 7317373502604673024. Current Snapshot: MvccSnapshot[applied={T|T < 7317373502745477120}]
I20260811 17:09:00.342232 18345 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40284:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:09:00.342473 18345 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40284:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:09:00.345486 18345 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33: Sending DeleteTablet for 3 replicas of tablet 6d385796e89249fb99042ba9708ae993
I20260811 17:09:00.346531 18593 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d385796e89249fb99042ba9708ae993 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:09:00 UTC) from {username='oryx', principal='oryx/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:51766
I20260811 17:09:00.346709 19089 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d385796e89249fb99042ba9708ae993 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:09:00 UTC) from {username='oryx', principal='oryx/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:58158
I20260811 17:09:00.347321 19289 tablet_replica.cc:330] T 6d385796e89249fb99042ba9708ae993 P eb44dd7038fb4b2f93f90652f9bcfae0: stopping tablet replica
I20260811 17:09:00.347282 18345 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40284:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 17:09:00.347460 18837 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d385796e89249fb99042ba9708ae993 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:09:00 UTC) from {username='oryx', principal='oryx/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:50882
I20260811 17:09:00.347671 19289 raft_consensus.cc:2229] T 6d385796e89249fb99042ba9708ae993 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260811 17:09:00.347994 18345 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:09:00.348037 19295 tablet_replica.cc:330] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4: stopping tablet replica
I20260811 17:09:00.348181 19292 tablet_replica.cc:330] T 6d385796e89249fb99042ba9708ae993 P b43ac4cbb8f2463980c032920066085d: stopping tablet replica
I20260811 17:09:00.348376 19295 raft_consensus.cc:2229] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 1 LEADER]: Raft consensus shutting down.
I20260811 17:09:00.348508 19292 raft_consensus.cc:2229] T 6d385796e89249fb99042ba9708ae993 P b43ac4cbb8f2463980c032920066085d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:09:00.348832 19292 raft_consensus.cc:2258] T 6d385796e89249fb99042ba9708ae993 P b43ac4cbb8f2463980c032920066085d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:09:00.348842 19295 raft_consensus.cc:2258] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:09:00.349172 19289 raft_consensus.cc:2258] T 6d385796e89249fb99042ba9708ae993 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:09:00.350630 19295 ts_tablet_manager.cc:1905] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:09:00.351815 19292 ts_tablet_manager.cc:1905] T 6d385796e89249fb99042ba9708ae993 P b43ac4cbb8f2463980c032920066085d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:09:00.353536 19289 ts_tablet_manager.cc:1905] T 6d385796e89249fb99042ba9708ae993 P eb44dd7038fb4b2f93f90652f9bcfae0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:09:00.354056 19295 ts_tablet_manager.cc:1918] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:09:00.354163 19295 log.cc:1196] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-1/wal/wals/6d385796e89249fb99042ba9708ae993
I20260811 17:09:00.354522 19295 ts_tablet_manager.cc:1939] T 6d385796e89249fb99042ba9708ae993 P c3e66afb9f7c4e1099b947435d9b8ce4: Deleting consensus metadata
I20260811 17:09:00.354667 18837 tablet_service.cc:1467] Processing CreateTablet for tablet fffbfc19ed2e4579ba3bd28ca6c73321 (DEFAULT_TABLE table=test-table [id=e1999347cdf1430b878b69877a87c86d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:09:00.354993 18837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fffbfc19ed2e4579ba3bd28ca6c73321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:09:00.355060 19089 tablet_service.cc:1467] Processing CreateTablet for tablet fffbfc19ed2e4579ba3bd28ca6c73321 (DEFAULT_TABLE table=test-table [id=e1999347cdf1430b878b69877a87c86d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:09:00.355362 19089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fffbfc19ed2e4579ba3bd28ca6c73321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:09:00.356464 19289 ts_tablet_manager.cc:1918] T 6d385796e89249fb99042ba9708ae993 P eb44dd7038fb4b2f93f90652f9bcfae0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:09:00.356571 19289 log.cc:1196] T 6d385796e89249fb99042ba9708ae993 P eb44dd7038fb4b2f93f90652f9bcfae0: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-0/wal/wals/6d385796e89249fb99042ba9708ae993
I20260811 17:09:00.356925 19289 ts_tablet_manager.cc:1939] T 6d385796e89249fb99042ba9708ae993 P eb44dd7038fb4b2f93f90652f9bcfae0: Deleting consensus metadata
I20260811 17:09:00.357457 19245 tablet_bootstrap.cc:492] T fffbfc19ed2e4579ba3bd28ca6c73321 P c3e66afb9f7c4e1099b947435d9b8ce4: Bootstrap starting.
I20260811 17:09:00.358551 19245 tablet_bootstrap.cc:654] T fffbfc19ed2e4579ba3bd28ca6c73321 P c3e66afb9f7c4e1099b947435d9b8ce4: Neither blocks nor log segments found. Creating new log.
I20260811 17:09:00.358796 18325 catalog_manager.cc:4841] TS c3e66afb9f7c4e1099b947435d9b8ce4 (127.4.146.194:45395): tablet 6d385796e89249fb99042ba9708ae993 (table test-table [id=a6e81298d2c84a21b2644cb4b2468335]) successfully deleted
I20260811 17:09:00.359632 18593 tablet_service.cc:1467] Processing CreateTablet for tablet fffbfc19ed2e4579ba3bd28ca6c73321 (DEFAULT_TABLE table=test-table [id=e1999347cdf1430b878b69877a87c86d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:09:00.359910 18593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fffbfc19ed2e4579ba3bd28ca6c73321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:09:00.360020 19245 tablet_bootstrap.cc:492] T fffbfc19ed2e4579ba3bd28ca6c73321 P c3e66afb9f7c4e1099b947435d9b8ce4: No bootstrap required, opened a new log
I20260811 17:09:00.360256 19245 ts_tablet_manager.cc:1397] T fffbfc19ed2e4579ba3bd28ca6c73321 P c3e66afb9f7c4e1099b947435d9b8ce4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 17:09:00.360527 19292 ts_tablet_manager.cc:1918] T 6d385796e89249fb99042ba9708ae993 P b43ac4cbb8f2463980c032920066085d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:09:00.360638 19292 log.cc:1196] T 6d385796e89249fb99042ba9708ae993 P b43ac4cbb8f2463980c032920066085d: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/6d385796e89249fb99042ba9708ae993
I20260811 17:09:00.360783 19245 raft_consensus.cc:348] T fffbfc19ed2e4579ba3bd28ca6c73321 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:00.360914 19245 raft_consensus.cc:374] T fffbfc19ed2e4579ba3bd28ca6c73321 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:09:00.360950 19245 raft_consensus.cc:729] T fffbfc19ed2e4579ba3bd28ca6c73321 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3e66afb9f7c4e1099b947435d9b8ce4, State: Initialized, Role: FOLLOWER
I20260811 17:09:00.360953 19292 ts_tablet_manager.cc:1939] T 6d385796e89249fb99042ba9708ae993 P b43ac4cbb8f2463980c032920066085d: Deleting consensus metadata
I20260811 17:09:00.361251 19245 consensus_queue.cc:260] T fffbfc19ed2e4579ba3bd28ca6c73321 P c3e66afb9f7c4e1099b947435d9b8ce4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:00.361635 19245 ts_tablet_manager.cc:1428] T fffbfc19ed2e4579ba3bd28ca6c73321 P c3e66afb9f7c4e1099b947435d9b8ce4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 17:09:00.362432 19244 tablet_bootstrap.cc:492] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0: Bootstrap starting.
I20260811 17:09:00.363214 19244 tablet_bootstrap.cc:654] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0: Neither blocks nor log segments found. Creating new log.
I20260811 17:09:00.364302 18320 catalog_manager.cc:4841] TS eb44dd7038fb4b2f93f90652f9bcfae0 (127.4.146.193:33001): tablet 6d385796e89249fb99042ba9708ae993 (table test-table [id=a6e81298d2c84a21b2644cb4b2468335]) successfully deleted
I20260811 17:09:00.364576 18325 catalog_manager.cc:4841] TS b43ac4cbb8f2463980c032920066085d (127.4.146.195:45501): tablet 6d385796e89249fb99042ba9708ae993 (table test-table [id=a6e81298d2c84a21b2644cb4b2468335]) successfully deleted
I20260811 17:09:00.365026 19244 tablet_bootstrap.cc:492] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0: No bootstrap required, opened a new log
I20260811 17:09:00.365087 19244 ts_tablet_manager.cc:1397] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 17:09:00.365890 19244 raft_consensus.cc:348] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:00.365989 19244 raft_consensus.cc:374] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:09:00.366011 19244 raft_consensus.cc:729] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb44dd7038fb4b2f93f90652f9bcfae0, State: Initialized, Role: FOLLOWER
I20260811 17:09:00.366148 19244 consensus_queue.cc:260] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:00.366446 19244 ts_tablet_manager.cc:1428] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 17:09:00.366655 19249 tablet_bootstrap.cc:492] T fffbfc19ed2e4579ba3bd28ca6c73321 P b43ac4cbb8f2463980c032920066085d: Bootstrap starting.
I20260811 17:09:00.367787 19249 tablet_bootstrap.cc:654] T fffbfc19ed2e4579ba3bd28ca6c73321 P b43ac4cbb8f2463980c032920066085d: Neither blocks nor log segments found. Creating new log.
I20260811 17:09:00.369306 19249 tablet_bootstrap.cc:492] T fffbfc19ed2e4579ba3bd28ca6c73321 P b43ac4cbb8f2463980c032920066085d: No bootstrap required, opened a new log
I20260811 17:09:00.369407 19249 ts_tablet_manager.cc:1397] T fffbfc19ed2e4579ba3bd28ca6c73321 P b43ac4cbb8f2463980c032920066085d: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 17:09:00.369907 19249 raft_consensus.cc:348] T fffbfc19ed2e4579ba3bd28ca6c73321 P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:00.370034 19249 raft_consensus.cc:374] T fffbfc19ed2e4579ba3bd28ca6c73321 P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:09:00.370070 19249 raft_consensus.cc:729] T fffbfc19ed2e4579ba3bd28ca6c73321 P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b43ac4cbb8f2463980c032920066085d, State: Initialized, Role: FOLLOWER
I20260811 17:09:00.370235 19249 consensus_queue.cc:260] T fffbfc19ed2e4579ba3bd28ca6c73321 P b43ac4cbb8f2463980c032920066085d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:00.370539 19249 ts_tablet_manager.cc:1428] T fffbfc19ed2e4579ba3bd28ca6c73321 P b43ac4cbb8f2463980c032920066085d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 17:09:00.712603 19260 raft_consensus.cc:482] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:09:00.712810 19260 raft_consensus.cc:504] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:00.714179 19260 leader_election.cc:288] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3e66afb9f7c4e1099b947435d9b8ce4 (127.4.146.194:45395), b43ac4cbb8f2463980c032920066085d (127.4.146.195:45501)
I20260811 17:09:00.719561 19243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:00.715130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:54023 (local address 127.4.146.195:45501)
0811 17:09:00.715275 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:00.715280 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:00.715468 (+ 188us) server_negotiation.cc:407] Connection header received
0811 17:09:00.715579 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:00.715582 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:00.715637 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:00.715720 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:09:00.715967 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.716683 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.718129 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.718754 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.718890 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:00.718948 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:00.719323 (+ 375us) server_negotiation.cc:299] Negotiation successful
0811 17:09:00.719418 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 17:09:00.719561 19242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:00.714518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:51111 (local address 127.4.146.194:45395)
0811 17:09:00.714676 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:00.714681 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:00.714878 (+ 197us) server_negotiation.cc:407] Connection header received
0811 17:09:00.715056 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:00.715059 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:00.715154 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:00.715253 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:09:00.715618 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.716454 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.718129 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.718755 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.718890 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:00.718948 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:00.719323 (+ 375us) server_negotiation.cc:299] Negotiation successful
0811 17:09:00.719418 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 17:09:00.719573 19302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:00.714453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:45395 (local address 127.4.146.193:51111)
0811 17:09:00.714750 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:00.714767 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:00.714926 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:00.715343 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:00.715346 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:00.715365 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:09:00.715496 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:00.715506 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.716593 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.716597 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:00.717950 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:00.717963 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.718906 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.718911 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:00.719144 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:00.719167 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 17:09:00.719247 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 17:09:00.719363 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":102,"thread_start_us":107,"threads_started":1}
I20260811 17:09:00.719588 19303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:00.714951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:45501 (local address 127.4.146.193:54023)
0811 17:09:00.715366 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:00.715380 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:00.715477 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:00.715745 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:00.715747 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:00.715763 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:09:00.715853 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:00.715857 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.716807 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.716810 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:00.717950 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:00.717963 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.718906 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.718911 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:00.719088 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:00.719160 (+ 72us) client_negotiation.cc:769] Sending connection context
0811 17:09:00.719247 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 17:09:00.719363 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"mutex_wait_us":46,"thread_start_us":183,"threads_started":1}
I20260811 17:09:00.720227 19117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fffbfc19ed2e4579ba3bd28ca6c73321" candidate_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b43ac4cbb8f2463980c032920066085d" is_pre_election: true
I20260811 17:09:00.720476 19117 raft_consensus.cc:2454] T fffbfc19ed2e4579ba3bd28ca6c73321 P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb44dd7038fb4b2f93f90652f9bcfae0 in term 0.
I20260811 17:09:00.720453 18880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fffbfc19ed2e4579ba3bd28ca6c73321" candidate_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" is_pre_election: true
I20260811 17:09:00.720739 18880 raft_consensus.cc:2454] T fffbfc19ed2e4579ba3bd28ca6c73321 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb44dd7038fb4b2f93f90652f9bcfae0 in term 0.
I20260811 17:09:00.720953 18499 leader_election.cc:302] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b43ac4cbb8f2463980c032920066085d, eb44dd7038fb4b2f93f90652f9bcfae0; no voters:
I20260811 17:09:00.721333 19260 raft_consensus.cc:2781] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:09:00.721396 19260 raft_consensus.cc:482] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:09:00.721426 19260 raft_consensus.cc:3037] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:09:00.722513 19260 raft_consensus.cc:504] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:00.722901 19260 leader_election.cc:288] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0 [CANDIDATE]: Term 1 election: Requested vote from peers c3e66afb9f7c4e1099b947435d9b8ce4 (127.4.146.194:45395), b43ac4cbb8f2463980c032920066085d (127.4.146.195:45501)
I20260811 17:09:00.723348 18880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fffbfc19ed2e4579ba3bd28ca6c73321" candidate_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4"
I20260811 17:09:00.723481 18880 raft_consensus.cc:3037] T fffbfc19ed2e4579ba3bd28ca6c73321 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:09:00.723480 19117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fffbfc19ed2e4579ba3bd28ca6c73321" candidate_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b43ac4cbb8f2463980c032920066085d"
I20260811 17:09:00.723634 19117 raft_consensus.cc:3037] T fffbfc19ed2e4579ba3bd28ca6c73321 P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:09:00.724671 18880 raft_consensus.cc:2454] T fffbfc19ed2e4579ba3bd28ca6c73321 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb44dd7038fb4b2f93f90652f9bcfae0 in term 1.
I20260811 17:09:00.724753 19117 raft_consensus.cc:2454] T fffbfc19ed2e4579ba3bd28ca6c73321 P b43ac4cbb8f2463980c032920066085d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb44dd7038fb4b2f93f90652f9bcfae0 in term 1.
I20260811 17:09:00.725049 18499 leader_election.cc:302] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c3e66afb9f7c4e1099b947435d9b8ce4, eb44dd7038fb4b2f93f90652f9bcfae0; no voters:
I20260811 17:09:00.725255 19260 raft_consensus.cc:2781] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:09:00.725530 19260 raft_consensus.cc:686] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 1 LEADER]: Becoming Leader. State: Replica: eb44dd7038fb4b2f93f90652f9bcfae0, State: Running, Role: LEADER
I20260811 17:09:00.725816 19260 consensus_queue.cc:237] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:00.728437 18345 catalog_manager.cc:5495] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb44dd7038fb4b2f93f90652f9bcfae0 (127.4.146.193). New cstate: current_term: 1 leader_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } health_report { overall_health: UNKNOWN } } }
Aug 11 17:09:00 dist-test-slave-7vjv krb5kdc[18258](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468139, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.254@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM
I20260811 17:09:00.771426 19313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:00.762077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40296 (local address 127.4.146.254:34413)
0811 17:09:00.762390 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:00.762399 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:00.762522 (+ 123us) server_negotiation.cc:407] Connection header received
0811 17:09:00.762695 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:00.762698 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:00.762744 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:00.762846 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:00.763561 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.764175 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.764984 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.765217 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.765333 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:00.767827 (+ 2494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:09:00.767830 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:09:00.767832 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:09:00.767856 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:09:00.769480 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:00.770067 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:00.770072 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:00.770074 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:00.770193 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:00.770468 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:00.770473 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:00.770475 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:00.770675 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:09:00.770788 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:00.771083 (+ 295us) server_negotiation.cc:299] Negotiation successful
0811 17:09:00.771262 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":71,"server-negotiator.queue_time_us":253,"thread_start_us":164,"threads_started":1}
I20260811 17:09:00.771426 19312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:00.762035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34413 (local address 127.0.0.1:40296)
0811 17:09:00.762413 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:00.762430 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:00.762585 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:00.762864 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:00.762867 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:00.763321 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:00.763426 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:00.763433 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.764288 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.764294 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:00.764856 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:00.764865 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:00.765341 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:00.765344 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:00.765484 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:00.766076 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:00.766088 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:00.767674 (+ 1586us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:09:00.769596 (+ 1922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:09:00.769633 (+ 37us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:09:00.769642 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:09:00.769977 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:09:00.770281 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:09:00.770284 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:09:00.770286 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:09:00.770393 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:09:00.770788 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:09:00.770796 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:09:00.770916 (+ 120us) client_negotiation.cc:769] Sending connection context
0811 17:09:00.771035 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 17:09:00.771207 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"mutex_wait_us":39,"thread_start_us":139,"threads_started":1}
I20260811 17:09:00.775759 18345 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:40296:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 17:09:00.776590 18345 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:09:00.781950 18593 tablet_service.cc:1467] Processing CreateTablet for tablet 8caeab5b6f804529a4451a5fe0f83275 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=40ed2f5bf28a450bb17ac6ef19feddf5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 17:09:00.782094 18837 tablet_service.cc:1467] Processing CreateTablet for tablet 8caeab5b6f804529a4451a5fe0f83275 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=40ed2f5bf28a450bb17ac6ef19feddf5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 17:09:00.782428 18593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8caeab5b6f804529a4451a5fe0f83275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:09:00.782428 18837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8caeab5b6f804529a4451a5fe0f83275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:09:00.784520 19089 tablet_service.cc:1467] Processing CreateTablet for tablet 8caeab5b6f804529a4451a5fe0f83275 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=40ed2f5bf28a450bb17ac6ef19feddf5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 17:09:00.784965 19089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8caeab5b6f804529a4451a5fe0f83275. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:09:00.785627 19244 tablet_bootstrap.cc:492] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0: Bootstrap starting.
I20260811 17:09:00.786142 19245 tablet_bootstrap.cc:492] T 8caeab5b6f804529a4451a5fe0f83275 P c3e66afb9f7c4e1099b947435d9b8ce4: Bootstrap starting.
I20260811 17:09:00.786677 19244 tablet_bootstrap.cc:654] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0: Neither blocks nor log segments found. Creating new log.
I20260811 17:09:00.787006 19245 tablet_bootstrap.cc:654] T 8caeab5b6f804529a4451a5fe0f83275 P c3e66afb9f7c4e1099b947435d9b8ce4: Neither blocks nor log segments found. Creating new log.
I20260811 17:09:00.787884 19244 tablet_bootstrap.cc:492] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0: No bootstrap required, opened a new log
I20260811 17:09:00.788007 19244 ts_tablet_manager.cc:1397] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 17:09:00.788077 19249 tablet_bootstrap.cc:492] T 8caeab5b6f804529a4451a5fe0f83275 P b43ac4cbb8f2463980c032920066085d: Bootstrap starting.
I20260811 17:09:00.788395 19245 tablet_bootstrap.cc:492] T 8caeab5b6f804529a4451a5fe0f83275 P c3e66afb9f7c4e1099b947435d9b8ce4: No bootstrap required, opened a new log
I20260811 17:09:00.788479 19245 ts_tablet_manager.cc:1397] T 8caeab5b6f804529a4451a5fe0f83275 P c3e66afb9f7c4e1099b947435d9b8ce4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 17:09:00.788517 19244 raft_consensus.cc:348] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:00.788628 19244 raft_consensus.cc:374] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:09:00.788662 19244 raft_consensus.cc:729] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb44dd7038fb4b2f93f90652f9bcfae0, State: Initialized, Role: FOLLOWER
I20260811 17:09:00.788818 19244 consensus_queue.cc:260] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:00.788914 19245 raft_consensus.cc:348] T 8caeab5b6f804529a4451a5fe0f83275 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:00.789027 19245 raft_consensus.cc:374] T 8caeab5b6f804529a4451a5fe0f83275 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:09:00.789059 19245 raft_consensus.cc:729] T 8caeab5b6f804529a4451a5fe0f83275 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3e66afb9f7c4e1099b947435d9b8ce4, State: Initialized, Role: FOLLOWER
I20260811 17:09:00.789121 19249 tablet_bootstrap.cc:654] T 8caeab5b6f804529a4451a5fe0f83275 P b43ac4cbb8f2463980c032920066085d: Neither blocks nor log segments found. Creating new log.
I20260811 17:09:00.789057 19260 tablet_replica.cc:439] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } } }
I20260811 17:09:00.789194 19260 tablet_replica.cc:442] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 17:09:00.789179 19245 consensus_queue.cc:260] T 8caeab5b6f804529a4451a5fe0f83275 P c3e66afb9f7c4e1099b947435d9b8ce4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:00.789435 19245 ts_tablet_manager.cc:1428] T 8caeab5b6f804529a4451a5fe0f83275 P c3e66afb9f7c4e1099b947435d9b8ce4: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 17:09:00.789446 19282 tablet_replica.cc:439] T 8caeab5b6f804529a4451a5fe0f83275 P c3e66afb9f7c4e1099b947435d9b8ce4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } } }
I20260811 17:09:00.789722 19282 tablet_replica.cc:442] T 8caeab5b6f804529a4451a5fe0f83275 P c3e66afb9f7c4e1099b947435d9b8ce4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 17:09:00.789870 19244 ts_tablet_manager.cc:1428] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 17:09:00.790411 19249 tablet_bootstrap.cc:492] T 8caeab5b6f804529a4451a5fe0f83275 P b43ac4cbb8f2463980c032920066085d: No bootstrap required, opened a new log
I20260811 17:09:00.790515 19249 ts_tablet_manager.cc:1397] T 8caeab5b6f804529a4451a5fe0f83275 P b43ac4cbb8f2463980c032920066085d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260811 17:09:00.790977 19249 raft_consensus.cc:348] T 8caeab5b6f804529a4451a5fe0f83275 P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:00.791106 19249 raft_consensus.cc:374] T 8caeab5b6f804529a4451a5fe0f83275 P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:09:00.791141 19249 raft_consensus.cc:729] T 8caeab5b6f804529a4451a5fe0f83275 P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b43ac4cbb8f2463980c032920066085d, State: Initialized, Role: FOLLOWER
I20260811 17:09:00.791260 19249 consensus_queue.cc:260] T 8caeab5b6f804529a4451a5fe0f83275 P b43ac4cbb8f2463980c032920066085d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:00.791602 19249 ts_tablet_manager.cc:1428] T 8caeab5b6f804529a4451a5fe0f83275 P b43ac4cbb8f2463980c032920066085d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 17:09:00.791540 19261 tablet_replica.cc:439] T 8caeab5b6f804529a4451a5fe0f83275 P b43ac4cbb8f2463980c032920066085d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } } }
I20260811 17:09:00.791689 19261 tablet_replica.cc:442] T 8caeab5b6f804529a4451a5fe0f83275 P b43ac4cbb8f2463980c032920066085d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 17:09:01.013546 19260 raft_consensus.cc:482] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:09:01.013741 19260 raft_consensus.cc:504] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:01.014295 19260 leader_election.cc:288] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3e66afb9f7c4e1099b947435d9b8ce4 (127.4.146.194:45395), b43ac4cbb8f2463980c032920066085d (127.4.146.195:45501)
I20260811 17:09:01.014945 19117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8caeab5b6f804529a4451a5fe0f83275" candidate_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b43ac4cbb8f2463980c032920066085d" is_pre_election: true
I20260811 17:09:01.014945 18880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8caeab5b6f804529a4451a5fe0f83275" candidate_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" is_pre_election: true
I20260811 17:09:01.015123 18880 raft_consensus.cc:2454] T 8caeab5b6f804529a4451a5fe0f83275 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb44dd7038fb4b2f93f90652f9bcfae0 in term 0.
I20260811 17:09:01.015149 19117 raft_consensus.cc:2454] T 8caeab5b6f804529a4451a5fe0f83275 P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb44dd7038fb4b2f93f90652f9bcfae0 in term 0.
I20260811 17:09:01.015487 18499 leader_election.cc:302] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b43ac4cbb8f2463980c032920066085d, eb44dd7038fb4b2f93f90652f9bcfae0; no voters:
I20260811 17:09:01.015705 19260 raft_consensus.cc:2781] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:09:01.015775 19260 raft_consensus.cc:482] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:09:01.015825 19260 raft_consensus.cc:3037] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:09:01.016855 19260 raft_consensus.cc:504] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:01.017220 19260 leader_election.cc:288] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0 [CANDIDATE]: Term 1 election: Requested vote from peers c3e66afb9f7c4e1099b947435d9b8ce4 (127.4.146.194:45395), b43ac4cbb8f2463980c032920066085d (127.4.146.195:45501)
I20260811 17:09:01.017696 19117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8caeab5b6f804529a4451a5fe0f83275" candidate_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b43ac4cbb8f2463980c032920066085d"
I20260811 17:09:01.017696 18880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8caeab5b6f804529a4451a5fe0f83275" candidate_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4"
I20260811 17:09:01.017833 19117 raft_consensus.cc:3037] T 8caeab5b6f804529a4451a5fe0f83275 P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:09:01.017833 18880 raft_consensus.cc:3037] T 8caeab5b6f804529a4451a5fe0f83275 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:09:01.019006 18880 raft_consensus.cc:2454] T 8caeab5b6f804529a4451a5fe0f83275 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb44dd7038fb4b2f93f90652f9bcfae0 in term 1.
I20260811 17:09:01.019006 19117 raft_consensus.cc:2454] T 8caeab5b6f804529a4451a5fe0f83275 P b43ac4cbb8f2463980c032920066085d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb44dd7038fb4b2f93f90652f9bcfae0 in term 1.
I20260811 17:09:01.019340 18499 leader_election.cc:302] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b43ac4cbb8f2463980c032920066085d, eb44dd7038fb4b2f93f90652f9bcfae0; no voters:
I20260811 17:09:01.019573 19260 raft_consensus.cc:2781] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:09:01.019734 19260 raft_consensus.cc:686] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 1 LEADER]: Becoming Leader. State: Replica: eb44dd7038fb4b2f93f90652f9bcfae0, State: Running, Role: LEADER
I20260811 17:09:01.019887 19260 consensus_queue.cc:237] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:01.020617 19304 tablet_replica.cc:439] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0: TxnStatusTablet state changed. Reason: New leader eb44dd7038fb4b2f93f90652f9bcfae0. Latest consensus state: current_term: 1 leader_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } } }
I20260811 17:09:01.020735 19304 tablet_replica.cc:442] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0: This TxnStatusTablet replica's current role is: LEADER
I20260811 17:09:01.021010 19319 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 17:09:01.021193 19319 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 17:09:01.021835 18342 catalog_manager.cc:5495] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb44dd7038fb4b2f93f90652f9bcfae0 (127.4.146.193). New cstate: current_term: 1 leader_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } health_report { overall_health: UNKNOWN } } }
I20260811 17:09:01.094273 19322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:01.089848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51770 (local address 127.4.146.193:33001)
0811 17:09:01.090079 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:01.090083 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:01.090097 (+ 14us) server_negotiation.cc:407] Connection header received
0811 17:09:01.090181 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:01.090183 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:01.090240 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:01.090353 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:09:01.090696 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.091321 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.092619 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.092870 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.092963 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:01.093369 (+ 406us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:09:01.093841 (+ 472us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:09:01.093931 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:01.094058 (+ 127us) server_negotiation.cc:299] Negotiation successful
0811 17:09:01.094115 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":89,"threads_started":1}
I20260811 17:09:01.094290 19312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:01.089721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:33001 (local address 127.0.0.1:51770)
0811 17:09:01.089876 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:01.089892 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:01.090004 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:01.090397 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:01.090401 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:01.090409 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 17:09:01.090530 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:01.090536 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.091456 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.091459 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:01.092478 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:01.092490 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.093022 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.093025 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:01.093135 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:01.093202 (+ 67us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 17:09:01.093941 (+ 739us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 17:09:01.093959 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 17:09:01.094035 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 17:09:01.094133 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 17:09:01.097653 19117 raft_consensus.cc:1261] T 8caeab5b6f804529a4451a5fe0f83275 P b43ac4cbb8f2463980c032920066085d [term 1 FOLLOWER]: Refusing update from remote peer eb44dd7038fb4b2f93f90652f9bcfae0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:09:01.097920 18880 raft_consensus.cc:1261] T 8caeab5b6f804529a4451a5fe0f83275 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 1 FOLLOWER]: Refusing update from remote peer eb44dd7038fb4b2f93f90652f9bcfae0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:09:01.098357 19304 consensus_queue.cc:1035] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:09:01.098570 19260 consensus_queue.cc:1035] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:09:01.100530 19261 tablet_replica.cc:439] T 8caeab5b6f804529a4451a5fe0f83275 P b43ac4cbb8f2463980c032920066085d: TxnStatusTablet state changed. Reason: New leader eb44dd7038fb4b2f93f90652f9bcfae0. Latest consensus state: current_term: 1 leader_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } } }
I20260811 17:09:01.100670 19261 tablet_replica.cc:442] T 8caeab5b6f804529a4451a5fe0f83275 P b43ac4cbb8f2463980c032920066085d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 17:09:01.100745 19282 tablet_replica.cc:439] T 8caeab5b6f804529a4451a5fe0f83275 P c3e66afb9f7c4e1099b947435d9b8ce4: TxnStatusTablet state changed. Reason: New leader eb44dd7038fb4b2f93f90652f9bcfae0. Latest consensus state: current_term: 1 leader_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } } }
I20260811 17:09:01.100873 19282 tablet_replica.cc:442] T 8caeab5b6f804529a4451a5fe0f83275 P c3e66afb9f7c4e1099b947435d9b8ce4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 17:09:01.103487 19260 tablet_replica.cc:439] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } } }
I20260811 17:09:01.103631 19260 tablet_replica.cc:442] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0: This TxnStatusTablet replica's current role is: LEADER
I20260811 17:09:01.104110 19282 tablet_replica.cc:439] T 8caeab5b6f804529a4451a5fe0f83275 P c3e66afb9f7c4e1099b947435d9b8ce4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } } }
I20260811 17:09:01.104228 19282 tablet_replica.cc:442] T 8caeab5b6f804529a4451a5fe0f83275 P c3e66afb9f7c4e1099b947435d9b8ce4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 17:09:01.104528 19329 mvcc.cc:205] Tried to move back new op lower bound from 7317373505930379264 to 7317373505619234816. Current Snapshot: MvccSnapshot[applied={T|T < 7317373505930379264}]
I20260811 17:09:01.105136 19304 tablet_replica.cc:439] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } } }
I20260811 17:09:01.105252 19304 tablet_replica.cc:442] T 8caeab5b6f804529a4451a5fe0f83275 P eb44dd7038fb4b2f93f90652f9bcfae0: This TxnStatusTablet replica's current role is: LEADER
I20260811 17:09:01.106045 19261 tablet_replica.cc:439] T 8caeab5b6f804529a4451a5fe0f83275 P b43ac4cbb8f2463980c032920066085d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } } }
I20260811 17:09:01.106174 19261 tablet_replica.cc:442] T 8caeab5b6f804529a4451a5fe0f83275 P b43ac4cbb8f2463980c032920066085d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 17:09:01.106750 19326 mvcc.cc:205] Tried to move back new op lower bound from 7317373505930379264 to 7317373505619234816. Current Snapshot: MvccSnapshot[applied={T|T < 7317373505930379264}]
I20260811 17:09:01.115679 19322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:01.111631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51782 (local address 127.4.146.193:33001)
0811 17:09:01.111754 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:01.111759 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:01.111971 (+ 212us) server_negotiation.cc:407] Connection header received
0811 17:09:01.112087 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:01.112137 (+ 50us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:01.112200 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:01.112270 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:09:01.112596 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.113211 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.114456 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.114675 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.114757 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:01.115109 (+ 352us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:09:01.115191 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:09:01.115310 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:01.115422 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 17:09:01.115474 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 17:09:01.128021 19341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:01.124365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:33001 (local address 127.4.146.193:41555)
0811 17:09:01.124703 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:01.124716 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:01.124854 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:01.125119 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:01.125122 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:01.125129 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 17:09:01.125272 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:01.125278 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.126010 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.126015 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:01.126638 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:01.126649 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.127177 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.127181 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:01.127260 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:01.127316 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 17:09:01.127630 (+ 314us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 17:09:01.127637 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 17:09:01.127698 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 17:09:01.127850 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"mutex_wait_us":38,"thread_start_us":107,"threads_started":1}
I20260811 17:09:01.128019 19322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:01.124438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:41555 (local address 127.4.146.193:33001)
0811 17:09:01.124573 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:01.124578 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:01.124793 (+ 215us) server_negotiation.cc:407] Connection header received
0811 17:09:01.124962 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:01.124969 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:01.125013 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:01.125109 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:09:01.125384 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.125902 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.126774 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.127058 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.127172 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:01.127454 (+ 282us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:09:01.127536 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:09:01.127615 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:01.127706 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 17:09:01.127831 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":71,"server-negotiator.queue_time_us":44}
I20260811 17:09:01.135874 18880 raft_consensus.cc:1261] T fffbfc19ed2e4579ba3bd28ca6c73321 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 1 FOLLOWER]: Refusing update from remote peer eb44dd7038fb4b2f93f90652f9bcfae0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:09:01.136132 19117 raft_consensus.cc:1261] T fffbfc19ed2e4579ba3bd28ca6c73321 P b43ac4cbb8f2463980c032920066085d [term 1 FOLLOWER]: Refusing update from remote peer eb44dd7038fb4b2f93f90652f9bcfae0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:09:01.136430 19334 consensus_queue.cc:1035] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:09:01.136618 19260 consensus_queue.cc:1035] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:09:01.188277 18342 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40284:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:09:01.188469 18342 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40284:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:09:01.190726 18342 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33: Sending DeleteTablet for 3 replicas of tablet fffbfc19ed2e4579ba3bd28ca6c73321
I20260811 17:09:01.191425 18590 tablet_service.cc:1514] Processing DeleteTablet for tablet fffbfc19ed2e4579ba3bd28ca6c73321 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:09:01 UTC) from {username='oryx', principal='oryx/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:51766
I20260811 17:09:01.191553 18837 tablet_service.cc:1514] Processing DeleteTablet for tablet fffbfc19ed2e4579ba3bd28ca6c73321 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:09:01 UTC) from {username='oryx', principal='oryx/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:50882
I20260811 17:09:01.191859 19089 tablet_service.cc:1514] Processing DeleteTablet for tablet fffbfc19ed2e4579ba3bd28ca6c73321 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:09:01 UTC) from {username='oryx', principal='oryx/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:58158
I20260811 17:09:01.192057 19354 tablet_replica.cc:330] T fffbfc19ed2e4579ba3bd28ca6c73321 P c3e66afb9f7c4e1099b947435d9b8ce4: stopping tablet replica
I20260811 17:09:01.192288 19354 raft_consensus.cc:2229] T fffbfc19ed2e4579ba3bd28ca6c73321 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:09:01.192301 19357 tablet_replica.cc:330] T fffbfc19ed2e4579ba3bd28ca6c73321 P b43ac4cbb8f2463980c032920066085d: stopping tablet replica
I20260811 17:09:01.192430 19357 raft_consensus.cc:2229] T fffbfc19ed2e4579ba3bd28ca6c73321 P b43ac4cbb8f2463980c032920066085d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:09:01.192559 19357 raft_consensus.cc:2258] T fffbfc19ed2e4579ba3bd28ca6c73321 P b43ac4cbb8f2463980c032920066085d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:09:01.192564 19354 raft_consensus.cc:2258] T fffbfc19ed2e4579ba3bd28ca6c73321 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:09:01.192776 19353 tablet_replica.cc:330] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0: stopping tablet replica
I20260811 17:09:01.192934 19353 raft_consensus.cc:2229] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 1 LEADER]: Raft consensus shutting down.
I20260811 17:09:01.193311 19353 raft_consensus.cc:2258] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:09:01.194216 19353 ts_tablet_manager.cc:1905] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:09:01.197285 19354 ts_tablet_manager.cc:1905] T fffbfc19ed2e4579ba3bd28ca6c73321 P c3e66afb9f7c4e1099b947435d9b8ce4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:09:01.197443 19353 ts_tablet_manager.cc:1918] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 17:09:01.197557 19353 log.cc:1196] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-0/wal/wals/fffbfc19ed2e4579ba3bd28ca6c73321
I20260811 17:09:01.197926 19353 ts_tablet_manager.cc:1939] T fffbfc19ed2e4579ba3bd28ca6c73321 P eb44dd7038fb4b2f93f90652f9bcfae0: Deleting consensus metadata
I20260811 17:09:01.198822 18320 catalog_manager.cc:4841] TS eb44dd7038fb4b2f93f90652f9bcfae0 (127.4.146.193:33001): tablet fffbfc19ed2e4579ba3bd28ca6c73321 (table test-table [id=e1999347cdf1430b878b69877a87c86d]) successfully deleted
I20260811 17:09:01.199568 19357 ts_tablet_manager.cc:1905] T fffbfc19ed2e4579ba3bd28ca6c73321 P b43ac4cbb8f2463980c032920066085d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:09:01.202610 19357 ts_tablet_manager.cc:1918] T fffbfc19ed2e4579ba3bd28ca6c73321 P b43ac4cbb8f2463980c032920066085d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 17:09:01.202700 19357 log.cc:1196] T fffbfc19ed2e4579ba3bd28ca6c73321 P b43ac4cbb8f2463980c032920066085d: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/fffbfc19ed2e4579ba3bd28ca6c73321
I20260811 17:09:01.202963 19357 ts_tablet_manager.cc:1939] T fffbfc19ed2e4579ba3bd28ca6c73321 P b43ac4cbb8f2463980c032920066085d: Deleting consensus metadata
I20260811 17:09:01.203806 18325 catalog_manager.cc:4841] TS b43ac4cbb8f2463980c032920066085d (127.4.146.195:45501): tablet fffbfc19ed2e4579ba3bd28ca6c73321 (table test-table [id=e1999347cdf1430b878b69877a87c86d]) successfully deleted
I20260811 17:09:01.205504 19354 ts_tablet_manager.cc:1918] T fffbfc19ed2e4579ba3bd28ca6c73321 P c3e66afb9f7c4e1099b947435d9b8ce4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 17:09:01.205610 19354 log.cc:1196] T fffbfc19ed2e4579ba3bd28ca6c73321 P c3e66afb9f7c4e1099b947435d9b8ce4: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-1/wal/wals/fffbfc19ed2e4579ba3bd28ca6c73321
I20260811 17:09:01.205866 19354 ts_tablet_manager.cc:1939] T fffbfc19ed2e4579ba3bd28ca6c73321 P c3e66afb9f7c4e1099b947435d9b8ce4: Deleting consensus metadata
I20260811 17:09:01.206719 18325 catalog_manager.cc:4841] TS c3e66afb9f7c4e1099b947435d9b8ce4 (127.4.146.194:45395): tablet fffbfc19ed2e4579ba3bd28ca6c73321 (table test-table [id=e1999347cdf1430b878b69877a87c86d]) successfully deleted
Aug 11 17:09:01 dist-test-slave-7vjv krb5kdc[18258](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468141, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 17:09:01 dist-test-slave-7vjv krb5kdc[18258](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:01 dist-test-slave-7vjv krb5kdc[18258](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 17:09:01.229550 19313 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:01.221197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40300 (local address 127.4.146.254:34413)
0811 17:09:01.221388 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:01.221394 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:01.221614 (+ 220us) server_negotiation.cc:407] Connection header received
0811 17:09:01.221781 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:01.221783 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:01.221841 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:01.221936 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:01.222943 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.223510 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.224822 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.225079 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.225173 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:01.229400 (+ 4227us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40300: BlockingRecv error: recv got EOF from 127.0.0.1:40300 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 11 17:09:01 dist-test-slave-7vjv krb5kdc[18258](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468141, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM
I20260811 17:09:01.243686 19313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:01.231266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40306 (local address 127.4.146.254:34413)
0811 17:09:01.231427 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:01.231432 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:01.231783 (+ 351us) server_negotiation.cc:407] Connection header received
0811 17:09:01.231857 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:01.231860 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:01.231920 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:01.232031 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:01.233180 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.233740 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.235309 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.235551 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.235646 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:01.239301 (+ 3655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:09:01.239306 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:09:01.239308 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:09:01.239346 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:09:01.241227 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:01.241850 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:01.241854 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:01.241855 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:01.241955 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:01.242425 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:01.242428 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:01.242430 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:01.242769 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:09:01.242937 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:01.243349 (+ 412us) server_negotiation.cc:299] Negotiation successful
0811 17:09:01.243497 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 17:09:01.247103 18342 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40306:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 17:09:01.247730 18342 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:09:01.253878 18837 tablet_service.cc:1467] Processing CreateTablet for tablet 6e395f98fad2435da99fdb4a472bccfe (DEFAULT_TABLE table=test-table [id=9f307873166348bb87f853d0c83270bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:09:01.253906 18590 tablet_service.cc:1467] Processing CreateTablet for tablet 6e395f98fad2435da99fdb4a472bccfe (DEFAULT_TABLE table=test-table [id=9f307873166348bb87f853d0c83270bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:09:01.253906 19089 tablet_service.cc:1467] Processing CreateTablet for tablet 6e395f98fad2435da99fdb4a472bccfe (DEFAULT_TABLE table=test-table [id=9f307873166348bb87f853d0c83270bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:09:01.254252 18837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e395f98fad2435da99fdb4a472bccfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:09:01.254263 19089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e395f98fad2435da99fdb4a472bccfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:09:01.254263 18590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e395f98fad2435da99fdb4a472bccfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:09:01.256860 19245 tablet_bootstrap.cc:492] T 6e395f98fad2435da99fdb4a472bccfe P c3e66afb9f7c4e1099b947435d9b8ce4: Bootstrap starting.
I20260811 17:09:01.256918 19249 tablet_bootstrap.cc:492] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d: Bootstrap starting.
I20260811 17:09:01.257789 19245 tablet_bootstrap.cc:654] T 6e395f98fad2435da99fdb4a472bccfe P c3e66afb9f7c4e1099b947435d9b8ce4: Neither blocks nor log segments found. Creating new log.
I20260811 17:09:01.257925 19249 tablet_bootstrap.cc:654] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d: Neither blocks nor log segments found. Creating new log.
I20260811 17:09:01.258860 19244 tablet_bootstrap.cc:492] T 6e395f98fad2435da99fdb4a472bccfe P eb44dd7038fb4b2f93f90652f9bcfae0: Bootstrap starting.
I20260811 17:09:01.259732 19244 tablet_bootstrap.cc:654] T 6e395f98fad2435da99fdb4a472bccfe P eb44dd7038fb4b2f93f90652f9bcfae0: Neither blocks nor log segments found. Creating new log.
I20260811 17:09:01.260769 19249 tablet_bootstrap.cc:492] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d: No bootstrap required, opened a new log
I20260811 17:09:01.260877 19249 ts_tablet_manager.cc:1397] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260811 17:09:01.261359 19249 raft_consensus.cc:348] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:01.261471 19249 raft_consensus.cc:374] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:09:01.261492 19249 raft_consensus.cc:729] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b43ac4cbb8f2463980c032920066085d, State: Initialized, Role: FOLLOWER
I20260811 17:09:01.261653 19249 consensus_queue.cc:260] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:01.261965 19249 ts_tablet_manager.cc:1428] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 17:09:01.262539 19244 tablet_bootstrap.cc:492] T 6e395f98fad2435da99fdb4a472bccfe P eb44dd7038fb4b2f93f90652f9bcfae0: No bootstrap required, opened a new log
I20260811 17:09:01.262671 19244 ts_tablet_manager.cc:1397] T 6e395f98fad2435da99fdb4a472bccfe P eb44dd7038fb4b2f93f90652f9bcfae0: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 17:09:01.263123 19244 raft_consensus.cc:348] T 6e395f98fad2435da99fdb4a472bccfe P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:01.263253 19244 raft_consensus.cc:374] T 6e395f98fad2435da99fdb4a472bccfe P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:09:01.263289 19244 raft_consensus.cc:729] T 6e395f98fad2435da99fdb4a472bccfe P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb44dd7038fb4b2f93f90652f9bcfae0, State: Initialized, Role: FOLLOWER
I20260811 17:09:01.263427 19244 consensus_queue.cc:260] T 6e395f98fad2435da99fdb4a472bccfe P eb44dd7038fb4b2f93f90652f9bcfae0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:01.263859 19244 ts_tablet_manager.cc:1428] T 6e395f98fad2435da99fdb4a472bccfe P eb44dd7038fb4b2f93f90652f9bcfae0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 17:09:01.265489 19245 tablet_bootstrap.cc:492] T 6e395f98fad2435da99fdb4a472bccfe P c3e66afb9f7c4e1099b947435d9b8ce4: No bootstrap required, opened a new log
I20260811 17:09:01.265583 19245 ts_tablet_manager.cc:1397] T 6e395f98fad2435da99fdb4a472bccfe P c3e66afb9f7c4e1099b947435d9b8ce4: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20260811 17:09:01.265980 19245 raft_consensus.cc:348] T 6e395f98fad2435da99fdb4a472bccfe P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:01.266101 19245 raft_consensus.cc:374] T 6e395f98fad2435da99fdb4a472bccfe P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:09:01.266132 19245 raft_consensus.cc:729] T 6e395f98fad2435da99fdb4a472bccfe P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3e66afb9f7c4e1099b947435d9b8ce4, State: Initialized, Role: FOLLOWER
I20260811 17:09:01.266259 19245 consensus_queue.cc:260] T 6e395f98fad2435da99fdb4a472bccfe P c3e66afb9f7c4e1099b947435d9b8ce4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:01.266505 19245 ts_tablet_manager.cc:1428] T 6e395f98fad2435da99fdb4a472bccfe P c3e66afb9f7c4e1099b947435d9b8ce4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 17:09:01.418469 19261 raft_consensus.cc:482] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:09:01.418659 19261 raft_consensus.cc:504] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:01.419956 19261 leader_election.cc:288] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb44dd7038fb4b2f93f90652f9bcfae0 (127.4.146.193:33001), c3e66afb9f7c4e1099b947435d9b8ce4 (127.4.146.194:45395)
I20260811 17:09:01.424768 19393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:01.420731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:46007 (local address 127.4.146.194:45395)
0811 17:09:01.421117 (+ 386us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:01.421124 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:01.421142 (+ 18us) server_negotiation.cc:407] Connection header received
0811 17:09:01.421200 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:01.421203 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:01.421254 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:01.421360 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:09:01.421687 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.422243 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.423639 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.424043 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.424221 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:01.424298 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:01.424519 (+ 221us) server_negotiation.cc:299] Negotiation successful
0811 17:09:01.424615 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":123,"threads_started":1}
I20260811 17:09:01.424791 19390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:01.420249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:33001 (local address 127.4.146.195:51103)
0811 17:09:01.420546 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:01.420563 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:01.420681 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:01.420976 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:01.420980 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:01.420999 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:09:01.421652 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:01.421665 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.422585 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.422589 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:01.423492 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:01.423503 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.424320 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.424325 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:01.424418 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:01.424436 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 17:09:01.424539 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 17:09:01.424615 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"mutex_wait_us":1,"thread_start_us":79,"threads_started":1}
I20260811 17:09:01.424805 19322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:01.420307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:51103 (local address 127.4.146.193:33001)
0811 17:09:01.420460 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:01.420467 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:01.420692 (+ 225us) server_negotiation.cc:407] Connection header received
0811 17:09:01.420772 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:01.420776 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:01.420839 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:01.420951 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:09:01.421808 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.422431 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.423636 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.424190 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.424329 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:01.424389 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:01.424582 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 17:09:01.424681 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 17:09:01.424801 19392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:01.420339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:45395 (local address 127.4.146.195:46007)
0811 17:09:01.420828 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:01.420838 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:01.420885 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:01.421411 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:01.421414 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:01.421434 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:09:01.421546 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:01.421552 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.422404 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.422408 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:01.423488 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:01.423500 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.424236 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.424243 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:01.424360 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:01.424385 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 17:09:01.424477 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 17:09:01.424582 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"mutex_wait_us":1,"thread_start_us":82,"threads_started":1}
I20260811 17:09:01.425438 18631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e395f98fad2435da99fdb4a472bccfe" candidate_uuid: "b43ac4cbb8f2463980c032920066085d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" is_pre_election: true
I20260811 17:09:01.425439 18880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e395f98fad2435da99fdb4a472bccfe" candidate_uuid: "b43ac4cbb8f2463980c032920066085d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" is_pre_election: true
I20260811 17:09:01.425628 18631 raft_consensus.cc:2454] T 6e395f98fad2435da99fdb4a472bccfe P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b43ac4cbb8f2463980c032920066085d in term 0.
I20260811 17:09:01.425647 18880 raft_consensus.cc:2454] T 6e395f98fad2435da99fdb4a472bccfe P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b43ac4cbb8f2463980c032920066085d in term 0.
I20260811 17:09:01.426075 19007 leader_election.cc:302] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b43ac4cbb8f2463980c032920066085d, c3e66afb9f7c4e1099b947435d9b8ce4; no voters:
I20260811 17:09:01.426431 19261 raft_consensus.cc:2781] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:09:01.426514 19261 raft_consensus.cc:482] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:09:01.426561 19261 raft_consensus.cc:3037] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:09:01.427747 19261 raft_consensus.cc:504] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:01.428365 19261 leader_election.cc:288] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d [CANDIDATE]: Term 1 election: Requested vote from peers eb44dd7038fb4b2f93f90652f9bcfae0 (127.4.146.193:33001), c3e66afb9f7c4e1099b947435d9b8ce4 (127.4.146.194:45395)
I20260811 17:09:01.428803 18631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e395f98fad2435da99fdb4a472bccfe" candidate_uuid: "b43ac4cbb8f2463980c032920066085d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0"
I20260811 17:09:01.428987 18631 raft_consensus.cc:3037] T 6e395f98fad2435da99fdb4a472bccfe P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:09:01.428978 18880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e395f98fad2435da99fdb4a472bccfe" candidate_uuid: "b43ac4cbb8f2463980c032920066085d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4"
I20260811 17:09:01.429145 18880 raft_consensus.cc:3037] T 6e395f98fad2435da99fdb4a472bccfe P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:09:01.430227 18880 raft_consensus.cc:2454] T 6e395f98fad2435da99fdb4a472bccfe P c3e66afb9f7c4e1099b947435d9b8ce4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b43ac4cbb8f2463980c032920066085d in term 1.
I20260811 17:09:01.430233 18631 raft_consensus.cc:2454] T 6e395f98fad2435da99fdb4a472bccfe P eb44dd7038fb4b2f93f90652f9bcfae0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b43ac4cbb8f2463980c032920066085d in term 1.
I20260811 17:09:01.430586 19007 leader_election.cc:302] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b43ac4cbb8f2463980c032920066085d, c3e66afb9f7c4e1099b947435d9b8ce4; no voters:
I20260811 17:09:01.430807 19261 raft_consensus.cc:2781] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:09:01.431039 19261 raft_consensus.cc:686] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d [term 1 LEADER]: Becoming Leader. State: Replica: b43ac4cbb8f2463980c032920066085d, State: Running, Role: LEADER
I20260811 17:09:01.431347 19261 consensus_queue.cc:237] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:01.434312 18345 catalog_manager.cc:5495] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d reported cstate change: term changed from 0 to 1, leader changed from <none> to b43ac4cbb8f2463980c032920066085d (127.4.146.195). New cstate: current_term: 1 leader_uuid: "b43ac4cbb8f2463980c032920066085d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } health_report { overall_health: HEALTHY } } }
I20260811 17:09:01.462417 19397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:01.458453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58168 (local address 127.4.146.195:45501)
0811 17:09:01.458766 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:01.458773 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:01.458786 (+ 13us) server_negotiation.cc:407] Connection header received
0811 17:09:01.458870 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:01.458872 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:01.458931 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:01.459041 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:09:01.459340 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.459963 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.460870 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.461109 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.461191 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:01.461431 (+ 240us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:09:01.461920 (+ 489us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:09:01.462013 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:01.462212 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 17:09:01.462266 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":155,"threads_started":1}
I20260811 17:09:01.465613 18880 raft_consensus.cc:1261] T 6e395f98fad2435da99fdb4a472bccfe P c3e66afb9f7c4e1099b947435d9b8ce4 [term 1 FOLLOWER]: Refusing update from remote peer b43ac4cbb8f2463980c032920066085d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:09:01.465638 18631 raft_consensus.cc:1261] T 6e395f98fad2435da99fdb4a472bccfe P eb44dd7038fb4b2f93f90652f9bcfae0 [term 1 FOLLOWER]: Refusing update from remote peer b43ac4cbb8f2463980c032920066085d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:09:01.466190 19394 consensus_queue.cc:1035] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:09:01.466475 19261 consensus_queue.cc:1035] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:09:01.478359 18345 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:09:01.478552 18345 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:09:01.480881 18345 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33: Sending DeleteTablet for 3 replicas of tablet 6e395f98fad2435da99fdb4a472bccfe
I20260811 17:09:01.481549 18590 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e395f98fad2435da99fdb4a472bccfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:09:01 UTC) from {username='oryx', principal='oryx/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:51766
I20260811 17:09:01.481698 19089 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e395f98fad2435da99fdb4a472bccfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:09:01 UTC) from {username='oryx', principal='oryx/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:58158
I20260811 17:09:01.481791 19353 tablet_replica.cc:330] T 6e395f98fad2435da99fdb4a472bccfe P eb44dd7038fb4b2f93f90652f9bcfae0: stopping tablet replica
I20260811 17:09:01.481935 19353 raft_consensus.cc:2229] T 6e395f98fad2435da99fdb4a472bccfe P eb44dd7038fb4b2f93f90652f9bcfae0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:09:01.481926 18837 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e395f98fad2435da99fdb4a472bccfe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:09:01 UTC) from {username='oryx', principal='oryx/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:50882
I20260811 17:09:01.482125 19357 tablet_replica.cc:330] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d: stopping tablet replica
I20260811 17:09:01.482128 19353 raft_consensus.cc:2258] T 6e395f98fad2435da99fdb4a472bccfe P eb44dd7038fb4b2f93f90652f9bcfae0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:09:01.482247 19357 raft_consensus.cc:2229] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d [term 1 LEADER]: Raft consensus shutting down.
I20260811 17:09:01.482623 19357 raft_consensus.cc:2258] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:09:01.482843 19354 tablet_replica.cc:330] T 6e395f98fad2435da99fdb4a472bccfe P c3e66afb9f7c4e1099b947435d9b8ce4: stopping tablet replica
I20260811 17:09:01.482975 19354 raft_consensus.cc:2229] T 6e395f98fad2435da99fdb4a472bccfe P c3e66afb9f7c4e1099b947435d9b8ce4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:09:01.483127 19354 raft_consensus.cc:2258] T 6e395f98fad2435da99fdb4a472bccfe P c3e66afb9f7c4e1099b947435d9b8ce4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:09:01.483230 19353 ts_tablet_manager.cc:1905] T 6e395f98fad2435da99fdb4a472bccfe P eb44dd7038fb4b2f93f90652f9bcfae0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:09:01.483904 18345 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40306:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 17:09:01.484058 19357 ts_tablet_manager.cc:1905] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 17:09:01.484596 18345 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:09:01.485942 19353 ts_tablet_manager.cc:1918] T 6e395f98fad2435da99fdb4a472bccfe P eb44dd7038fb4b2f93f90652f9bcfae0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:09:01.486052 19353 log.cc:1196] T 6e395f98fad2435da99fdb4a472bccfe P eb44dd7038fb4b2f93f90652f9bcfae0: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-0/wal/wals/6e395f98fad2435da99fdb4a472bccfe
I20260811 17:09:01.486325 19353 ts_tablet_manager.cc:1939] T 6e395f98fad2435da99fdb4a472bccfe P eb44dd7038fb4b2f93f90652f9bcfae0: Deleting consensus metadata
I20260811 17:09:01.486716 19357 ts_tablet_manager.cc:1918] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:09:01.486805 19357 log.cc:1196] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/6e395f98fad2435da99fdb4a472bccfe
I20260811 17:09:01.487095 19357 ts_tablet_manager.cc:1939] T 6e395f98fad2435da99fdb4a472bccfe P b43ac4cbb8f2463980c032920066085d: Deleting consensus metadata
I20260811 17:09:01.487076 18320 catalog_manager.cc:4841] TS eb44dd7038fb4b2f93f90652f9bcfae0 (127.4.146.193:33001): tablet 6e395f98fad2435da99fdb4a472bccfe (table test-table [id=9f307873166348bb87f853d0c83270bf]) successfully deleted
I20260811 17:09:01.487890 18325 catalog_manager.cc:4841] TS b43ac4cbb8f2463980c032920066085d (127.4.146.195:45501): tablet 6e395f98fad2435da99fdb4a472bccfe (table test-table [id=9f307873166348bb87f853d0c83270bf]) successfully deleted
I20260811 17:09:01.488320 19354 ts_tablet_manager.cc:1905] T 6e395f98fad2435da99fdb4a472bccfe P c3e66afb9f7c4e1099b947435d9b8ce4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:09:01.490945 19354 ts_tablet_manager.cc:1918] T 6e395f98fad2435da99fdb4a472bccfe P c3e66afb9f7c4e1099b947435d9b8ce4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:09:01.491051 19354 log.cc:1196] T 6e395f98fad2435da99fdb4a472bccfe P c3e66afb9f7c4e1099b947435d9b8ce4: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-1/wal/wals/6e395f98fad2435da99fdb4a472bccfe
I20260811 17:09:01.491325 19354 ts_tablet_manager.cc:1939] T 6e395f98fad2435da99fdb4a472bccfe P c3e66afb9f7c4e1099b947435d9b8ce4: Deleting consensus metadata
I20260811 17:09:01.492067 18325 catalog_manager.cc:4841] TS c3e66afb9f7c4e1099b947435d9b8ce4 (127.4.146.194:45395): tablet 6e395f98fad2435da99fdb4a472bccfe (table test-table [id=9f307873166348bb87f853d0c83270bf]) successfully deleted
I20260811 17:09:01.496259 18590 tablet_service.cc:1467] Processing CreateTablet for tablet f1c535eda99b4d26a43cd40175047192 (DEFAULT_TABLE table=test-table [id=88e1df6fd64840b7adb7257d61e0ac3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:09:01.496371 18837 tablet_service.cc:1467] Processing CreateTablet for tablet f1c535eda99b4d26a43cd40175047192 (DEFAULT_TABLE table=test-table [id=88e1df6fd64840b7adb7257d61e0ac3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:09:01.496622 18590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1c535eda99b4d26a43cd40175047192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:09:01.496577 19089 tablet_service.cc:1467] Processing CreateTablet for tablet f1c535eda99b4d26a43cd40175047192 (DEFAULT_TABLE table=test-table [id=88e1df6fd64840b7adb7257d61e0ac3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:09:01.496672 18837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1c535eda99b4d26a43cd40175047192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:09:01.496860 19089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1c535eda99b4d26a43cd40175047192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:09:01.499311 19244 tablet_bootstrap.cc:492] T f1c535eda99b4d26a43cd40175047192 P eb44dd7038fb4b2f93f90652f9bcfae0: Bootstrap starting.
I20260811 17:09:01.499581 19245 tablet_bootstrap.cc:492] T f1c535eda99b4d26a43cd40175047192 P c3e66afb9f7c4e1099b947435d9b8ce4: Bootstrap starting.
I20260811 17:09:01.500260 19244 tablet_bootstrap.cc:654] T f1c535eda99b4d26a43cd40175047192 P eb44dd7038fb4b2f93f90652f9bcfae0: Neither blocks nor log segments found. Creating new log.
I20260811 17:09:01.500332 19249 tablet_bootstrap.cc:492] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d: Bootstrap starting.
I20260811 17:09:01.500451 19245 tablet_bootstrap.cc:654] T f1c535eda99b4d26a43cd40175047192 P c3e66afb9f7c4e1099b947435d9b8ce4: Neither blocks nor log segments found. Creating new log.
I20260811 17:09:01.501283 19249 tablet_bootstrap.cc:654] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d: Neither blocks nor log segments found. Creating new log.
I20260811 17:09:01.501524 19245 tablet_bootstrap.cc:492] T f1c535eda99b4d26a43cd40175047192 P c3e66afb9f7c4e1099b947435d9b8ce4: No bootstrap required, opened a new log
I20260811 17:09:01.501613 19245 ts_tablet_manager.cc:1397] T f1c535eda99b4d26a43cd40175047192 P c3e66afb9f7c4e1099b947435d9b8ce4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 17:09:01.501996 19245 raft_consensus.cc:348] T f1c535eda99b4d26a43cd40175047192 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:01.502100 19245 raft_consensus.cc:374] T f1c535eda99b4d26a43cd40175047192 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:09:01.502128 19245 raft_consensus.cc:729] T f1c535eda99b4d26a43cd40175047192 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3e66afb9f7c4e1099b947435d9b8ce4, State: Initialized, Role: FOLLOWER
I20260811 17:09:01.502243 19245 consensus_queue.cc:260] T f1c535eda99b4d26a43cd40175047192 P c3e66afb9f7c4e1099b947435d9b8ce4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:01.502483 19245 ts_tablet_manager.cc:1428] T f1c535eda99b4d26a43cd40175047192 P c3e66afb9f7c4e1099b947435d9b8ce4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 17:09:01.505040 19249 tablet_bootstrap.cc:492] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d: No bootstrap required, opened a new log
I20260811 17:09:01.505134 19249 ts_tablet_manager.cc:1397] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20260811 17:09:01.505303 19244 tablet_bootstrap.cc:492] T f1c535eda99b4d26a43cd40175047192 P eb44dd7038fb4b2f93f90652f9bcfae0: No bootstrap required, opened a new log
I20260811 17:09:01.505393 19244 ts_tablet_manager.cc:1397] T f1c535eda99b4d26a43cd40175047192 P eb44dd7038fb4b2f93f90652f9bcfae0: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20260811 17:09:01.505574 19249 raft_consensus.cc:348] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:01.505693 19249 raft_consensus.cc:374] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:09:01.505723 19249 raft_consensus.cc:729] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b43ac4cbb8f2463980c032920066085d, State: Initialized, Role: FOLLOWER
I20260811 17:09:01.505795 19244 raft_consensus.cc:348] T f1c535eda99b4d26a43cd40175047192 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:01.505841 19249 consensus_queue.cc:260] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:01.505911 19244 raft_consensus.cc:374] T f1c535eda99b4d26a43cd40175047192 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:09:01.505944 19244 raft_consensus.cc:729] T f1c535eda99b4d26a43cd40175047192 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb44dd7038fb4b2f93f90652f9bcfae0, State: Initialized, Role: FOLLOWER
I20260811 17:09:01.506068 19249 ts_tablet_manager.cc:1428] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 17:09:01.506062 19244 consensus_queue.cc:260] T f1c535eda99b4d26a43cd40175047192 P eb44dd7038fb4b2f93f90652f9bcfae0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:01.506343 19244 ts_tablet_manager.cc:1428] T f1c535eda99b4d26a43cd40175047192 P eb44dd7038fb4b2f93f90652f9bcfae0: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 17:09:01.687170 19394 raft_consensus.cc:482] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:09:01.687355 19394 raft_consensus.cc:504] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:01.687949 19394 leader_election.cc:288] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb44dd7038fb4b2f93f90652f9bcfae0 (127.4.146.193:33001), c3e66afb9f7c4e1099b947435d9b8ce4 (127.4.146.194:45395)
I20260811 17:09:01.688602 18880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1c535eda99b4d26a43cd40175047192" candidate_uuid: "b43ac4cbb8f2463980c032920066085d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" is_pre_election: true
I20260811 17:09:01.688606 18631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1c535eda99b4d26a43cd40175047192" candidate_uuid: "b43ac4cbb8f2463980c032920066085d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" is_pre_election: true
I20260811 17:09:01.688788 18880 raft_consensus.cc:2454] T f1c535eda99b4d26a43cd40175047192 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b43ac4cbb8f2463980c032920066085d in term 0.
I20260811 17:09:01.688788 18631 raft_consensus.cc:2454] T f1c535eda99b4d26a43cd40175047192 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b43ac4cbb8f2463980c032920066085d in term 0.
I20260811 17:09:01.689275 19001 leader_election.cc:302] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b43ac4cbb8f2463980c032920066085d, eb44dd7038fb4b2f93f90652f9bcfae0; no voters:
I20260811 17:09:01.689524 19394 raft_consensus.cc:2781] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:09:01.689625 19394 raft_consensus.cc:482] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:09:01.689707 19394 raft_consensus.cc:3037] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:09:01.690795 19394 raft_consensus.cc:504] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:01.691179 19394 leader_election.cc:288] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d [CANDIDATE]: Term 1 election: Requested vote from peers eb44dd7038fb4b2f93f90652f9bcfae0 (127.4.146.193:33001), c3e66afb9f7c4e1099b947435d9b8ce4 (127.4.146.194:45395)
I20260811 17:09:01.691721 18631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1c535eda99b4d26a43cd40175047192" candidate_uuid: "b43ac4cbb8f2463980c032920066085d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0"
I20260811 17:09:01.691720 18880 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1c535eda99b4d26a43cd40175047192" candidate_uuid: "b43ac4cbb8f2463980c032920066085d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4"
I20260811 17:09:01.691883 18631 raft_consensus.cc:3037] T f1c535eda99b4d26a43cd40175047192 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:09:01.691887 18880 raft_consensus.cc:3037] T f1c535eda99b4d26a43cd40175047192 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:09:01.693112 18880 raft_consensus.cc:2454] T f1c535eda99b4d26a43cd40175047192 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b43ac4cbb8f2463980c032920066085d in term 1.
I20260811 17:09:01.693132 18631 raft_consensus.cc:2454] T f1c535eda99b4d26a43cd40175047192 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b43ac4cbb8f2463980c032920066085d in term 1.
I20260811 17:09:01.693454 19007 leader_election.cc:302] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b43ac4cbb8f2463980c032920066085d, c3e66afb9f7c4e1099b947435d9b8ce4; no voters:
I20260811 17:09:01.693645 19394 raft_consensus.cc:2781] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:09:01.693779 19394 raft_consensus.cc:686] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d [term 1 LEADER]: Becoming Leader. State: Replica: b43ac4cbb8f2463980c032920066085d, State: Running, Role: LEADER
I20260811 17:09:01.693943 19394 consensus_queue.cc:237] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } }
I20260811 17:09:01.695990 18345 catalog_manager.cc:5495] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d reported cstate change: term changed from 0 to 1, leader changed from <none> to b43ac4cbb8f2463980c032920066085d (127.4.146.195). New cstate: current_term: 1 leader_uuid: "b43ac4cbb8f2463980c032920066085d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b43ac4cbb8f2463980c032920066085d" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45501 } health_report { overall_health: HEALTHY } } }
I20260811 17:09:01.761475 19322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:01.757434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:46495 (local address 127.4.146.193:33001)
0811 17:09:01.757605 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:01.757609 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:01.757787 (+ 178us) server_negotiation.cc:407] Connection header received
0811 17:09:01.757879 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:01.757882 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:01.757935 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:01.758113 (+ 178us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:09:01.758442 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.759022 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.760432 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.760653 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.760731 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:01.761060 (+ 329us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:09:01.761132 (+ 72us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:09:01.761185 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:01.761314 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 17:09:01.761361 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 17:09:01.761559 19412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:01.757248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:33001 (local address 127.4.146.195:46495)
0811 17:09:01.757651 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:01.757667 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:01.757786 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:01.758124 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:01.758127 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:01.758136 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 17:09:01.758269 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:01.758300 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.759130 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.759134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:01.760299 (+ 1165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:01.760311 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.760763 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.760767 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:01.760860 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:01.760920 (+ 60us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 17:09:01.761215 (+ 295us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 17:09:01.761222 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 17:09:01.761293 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 17:09:01.761387 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":183,"threads_started":1}
I20260811 17:09:01.767694 18880 raft_consensus.cc:1261] T f1c535eda99b4d26a43cd40175047192 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 1 FOLLOWER]: Refusing update from remote peer b43ac4cbb8f2463980c032920066085d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:09:01.767758 18631 raft_consensus.cc:1261] T f1c535eda99b4d26a43cd40175047192 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 1 FOLLOWER]: Refusing update from remote peer b43ac4cbb8f2463980c032920066085d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:09:01.768165 19394 consensus_queue.cc:1035] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb44dd7038fb4b2f93f90652f9bcfae0" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 33001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:09:01.768344 19261 consensus_queue.cc:1035] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3e66afb9f7c4e1099b947435d9b8ce4" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 45395 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:09:01.787345 19424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:01.783616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:45501 (local address 127.4.146.193:41165)
0811 17:09:01.783970 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:01.783986 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:01.784132 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:01.784536 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:01.784538 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:01.784546 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 17:09:01.784636 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:01.784641 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.785357 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.785359 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:01.785994 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:01.786005 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.786585 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.786588 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:01.786656 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:01.786685 (+ 29us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 17:09:01.786988 (+ 303us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 17:09:01.786997 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 17:09:01.787123 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 17:09:01.787212 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":156,"threads_started":1}
I20260811 17:09:01.787341 19397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:01.783672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:41165 (local address 127.4.146.195:45501)
0811 17:09:01.783823 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:01.783828 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:01.784084 (+ 256us) server_negotiation.cc:407] Connection header received
0811 17:09:01.784240 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:01.784245 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:01.784308 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:01.784408 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:09:01.784741 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.785256 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.786162 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:01.786460 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:01.786589 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:01.786815 (+ 226us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:09:01.786898 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:09:01.786981 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:01.787136 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 17:09:01.787191 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 17:09:01.808885 18341 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:09:01.809090 18341 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:09:01.811741 18341 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c8ac038d5cae4b1eb3e03a9bba7e7d33: Sending DeleteTablet for 3 replicas of tablet f1c535eda99b4d26a43cd40175047192
I20260811 17:09:01.812562 18837 tablet_service.cc:1514] Processing DeleteTablet for tablet f1c535eda99b4d26a43cd40175047192 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:09:01 UTC) from {username='oryx', principal='oryx/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:50882
I20260811 17:09:01.812587 18590 tablet_service.cc:1514] Processing DeleteTablet for tablet f1c535eda99b4d26a43cd40175047192 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:09:01 UTC) from {username='oryx', principal='oryx/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:51766
I20260811 17:09:01.812834 19354 tablet_replica.cc:330] T f1c535eda99b4d26a43cd40175047192 P c3e66afb9f7c4e1099b947435d9b8ce4: stopping tablet replica
I20260811 17:09:01.812862 19089 tablet_service.cc:1514] Processing DeleteTablet for tablet f1c535eda99b4d26a43cd40175047192 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:09:01 UTC) from {username='oryx', principal='oryx/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:58158
I20260811 17:09:01.812985 19354 raft_consensus.cc:2229] T f1c535eda99b4d26a43cd40175047192 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:09:01.813000 19353 tablet_replica.cc:330] T f1c535eda99b4d26a43cd40175047192 P eb44dd7038fb4b2f93f90652f9bcfae0: stopping tablet replica
I20260811 17:09:01.813119 19354 raft_consensus.cc:2258] T f1c535eda99b4d26a43cd40175047192 P c3e66afb9f7c4e1099b947435d9b8ce4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:09:01.813158 19353 raft_consensus.cc:2229] T f1c535eda99b4d26a43cd40175047192 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:09:01.813313 19357 tablet_replica.cc:330] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d: stopping tablet replica
I20260811 17:09:01.813323 19353 raft_consensus.cc:2258] T f1c535eda99b4d26a43cd40175047192 P eb44dd7038fb4b2f93f90652f9bcfae0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:09:01.813442 19357 raft_consensus.cc:2229] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d [term 1 LEADER]: Raft consensus shutting down.
I20260811 17:09:01.813712 19357 raft_consensus.cc:2258] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:09:01.814172 19353 ts_tablet_manager.cc:1905] T f1c535eda99b4d26a43cd40175047192 P eb44dd7038fb4b2f93f90652f9bcfae0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:09:01.814211 19354 ts_tablet_manager.cc:1905] T f1c535eda99b4d26a43cd40175047192 P c3e66afb9f7c4e1099b947435d9b8ce4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:09:01.814481 19357 ts_tablet_manager.cc:1905] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:09:01.816581 19353 ts_tablet_manager.cc:1918] T f1c535eda99b4d26a43cd40175047192 P eb44dd7038fb4b2f93f90652f9bcfae0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 17:09:01.816643 19353 log.cc:1196] T f1c535eda99b4d26a43cd40175047192 P eb44dd7038fb4b2f93f90652f9bcfae0: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-0/wal/wals/f1c535eda99b4d26a43cd40175047192
I20260811 17:09:01.816839 19353 ts_tablet_manager.cc:1939] T f1c535eda99b4d26a43cd40175047192 P eb44dd7038fb4b2f93f90652f9bcfae0: Deleting consensus metadata
I20260811 17:09:01.817418 19357 ts_tablet_manager.cc:1918] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 17:09:01.817418 19354 ts_tablet_manager.cc:1918] T f1c535eda99b4d26a43cd40175047192 P c3e66afb9f7c4e1099b947435d9b8ce4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 17:09:01.817514 19354 log.cc:1196] T f1c535eda99b4d26a43cd40175047192 P c3e66afb9f7c4e1099b947435d9b8ce4: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-1/wal/wals/f1c535eda99b4d26a43cd40175047192
I20260811 17:09:01.817525 19357 log.cc:1196] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/f1c535eda99b4d26a43cd40175047192
I20260811 17:09:01.817585 18320 catalog_manager.cc:4841] TS eb44dd7038fb4b2f93f90652f9bcfae0 (127.4.146.193:33001): tablet f1c535eda99b4d26a43cd40175047192 (table test-table [id=88e1df6fd64840b7adb7257d61e0ac3a]) successfully deleted
I20260811 17:09:01.817819 19357 ts_tablet_manager.cc:1939] T f1c535eda99b4d26a43cd40175047192 P b43ac4cbb8f2463980c032920066085d: Deleting consensus metadata
I20260811 17:09:01.817826 19354 ts_tablet_manager.cc:1939] T f1c535eda99b4d26a43cd40175047192 P c3e66afb9f7c4e1099b947435d9b8ce4: Deleting consensus metadata
I20260811 17:09:01.818578 18325 catalog_manager.cc:4841] TS b43ac4cbb8f2463980c032920066085d (127.4.146.195:45501): tablet f1c535eda99b4d26a43cd40175047192 (table test-table [id=88e1df6fd64840b7adb7257d61e0ac3a]) successfully deleted
I20260811 17:09:01.818760 18325 catalog_manager.cc:4841] TS c3e66afb9f7c4e1099b947435d9b8ce4 (127.4.146.194:45395): tablet f1c535eda99b4d26a43cd40175047192 (table test-table [id=88e1df6fd64840b7adb7257d61e0ac3a]) successfully deleted
I20260811 17:09:01.819108 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 18469
I20260811 17:09:01.838593 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 18727
I20260811 17:09:01.858409 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 18973
I20260811 17:09:01.881908 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 18283
2026-08-11T17:09:01Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (4403 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:09:01 dist-test-slave-7vjv krb5kdc[19432](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:09:01 dist-test-slave-7vjv krb5kdc[19432](info): set up 2 sockets
Aug 11 17:09:01 dist-test-slave-7vjv krb5kdc[19432](info): commencing operation
krb5kdc: starting...
W20260811 17:09:03.205617 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.287s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:09:03 dist-test-slave-7vjv krb5kdc[19432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468143, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:09:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:09:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:09:03.351823 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:42781
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:46875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:42781
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:09:03.476321 19453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:09:03.476686 19453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:09:03.476768 19453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:09:03.480978 19453 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:09:03.481091 19453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:09:03.481128 19453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:09:03.481176 19453 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:09:03.481218 19453 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:09:03.487080 19453 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:46875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:42781
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:42781
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19453
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:09:03.488435 19453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:09:03.489634 19453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:09:03.498857 19464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:03.498859 19462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:03.498914 19453 server_base.cc:1034] running on GCE node
W20260811 17:09:03.498950 19467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:03.499787 19453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:09:03.501081 19453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:09:03.502282 19453 hybrid_clock.cc:648] HybridClock initialized: now 1786468143502244 us; error 52 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T17:09:03Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1626 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:09:03 dist-test-slave-7vjv krb5kdc[19473](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:09:03 dist-test-slave-7vjv krb5kdc[19473](info): set up 2 sockets
Aug 11 17:09:03 dist-test-slave-7vjv krb5kdc[19473](info): commencing operation
krb5kdc: starting...
W20260811 17:09:04.848644 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.304s user 0.007s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:09:04 dist-test-slave-7vjv krb5kdc[19473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468144, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:09:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:09:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:09:04.996318 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:34869
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:44711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:34869
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:09:05.118286 19493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:09:05.118650 19493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:09:05.118742 19493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:09:05.122988 19493 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:09:05.123118 19493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:09:05.123162 19493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:09:05.123245 19493 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:09:05.123304 19493 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:09:05.129813 19493 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:44711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:34869
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:34869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19493
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:09:05.131033 19493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:09:05.132200 19493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:09:05.142086 19499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:05.142246 19493 server_base.cc:1034] running on GCE node
W20260811 17:09:05.142092 19501 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:05.142092 19505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:05.143263 19493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:09:05.144755 19493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:09:05.146008 19493 hybrid_clock.cc:648] HybridClock initialized: now 1786468145145977 us; error 49 us; skew 500 ppm
Aug 11 17:09:05 dist-test-slave-7vjv krb5kdc[19473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468145, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:09:05.149333 19493 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:09:05.150347 19493 webserver.cc:460] Webserver started at http://127.4.146.254:38183/ using document root <none> and password file <none>
I20260811 17:09:05.150974 19493 fs_manager.cc:359] Metadata directory not provided
I20260811 17:09:05.151080 19493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:09:05.151343 19493 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:09:05.153657 19493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "3696833dfffc40bda1c82ba654d6b4b3"
format_stamp: "Formatted at 2026-08-11 17:09:05 on dist-test-slave-7vjv"
server_key: "c130115ea5732aa7879075f391627dd2"
server_key_iv: "e9501d20c08b82f54487fc2cf94dd75f"
server_key_version: "encryptionkey@0"
I20260811 17:09:05.154309 19493 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "3696833dfffc40bda1c82ba654d6b4b3"
format_stamp: "Formatted at 2026-08-11 17:09:05 on dist-test-slave-7vjv"
server_key: "c130115ea5732aa7879075f391627dd2"
server_key_iv: "e9501d20c08b82f54487fc2cf94dd75f"
server_key_version: "encryptionkey@0"
I20260811 17:09:05.158565 19493 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 17:09:05.161548 19521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:05.163017 19493 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 17:09:05.163219 19493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "3696833dfffc40bda1c82ba654d6b4b3"
format_stamp: "Formatted at 2026-08-11 17:09:05 on dist-test-slave-7vjv"
server_key: "c130115ea5732aa7879075f391627dd2"
server_key_iv: "e9501d20c08b82f54487fc2cf94dd75f"
server_key_version: "encryptionkey@0"
I20260811 17:09:05.163359 19493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:09:05.184774 19493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:09:05.188455 19493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:09:05.188700 19493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:09:05.197142 19493 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:34869
I20260811 17:09:05.197163 19608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:34869 every 8 connection(s)
I20260811 17:09:05.198244 19493 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:09:05.201493 19609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:09:05.205700 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 19493
I20260811 17:09:05.205845 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:09:05.206213 4683 external_mini_cluster.cc:1428] Setting key eb1a3b748f59008dadba5fd9bb4857f8
I20260811 17:09:05.208858 19609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3: Bootstrap starting.
I20260811 17:09:05.212142 19609 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3: Neither blocks nor log segments found. Creating new log.
I20260811 17:09:05.213201 19609 log.cc:824] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3: Log is configured to *not* fsync() on all Append() calls
I20260811 17:09:05.216239 19609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3: No bootstrap required, opened a new log
Aug 11 17:09:05 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468144, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:09:05.220235 19609 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3696833dfffc40bda1c82ba654d6b4b3" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34869 } }
I20260811 17:09:05.220563 19609 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:09:05.220655 19609 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3696833dfffc40bda1c82ba654d6b4b3, State: Initialized, Role: FOLLOWER
I20260811 17:09:05.221182 19609 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3696833dfffc40bda1c82ba654d6b4b3" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34869 } }
I20260811 17:09:05.221360 19609 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:09:05.221464 19609 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:09:05.221596 19609 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:09:05.222903 19609 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3696833dfffc40bda1c82ba654d6b4b3" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34869 } }
I20260811 17:09:05.223327 19609 leader_election.cc:302] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3696833dfffc40bda1c82ba654d6b4b3; no voters:
I20260811 17:09:05.223748 19609 leader_election.cc:288] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:09:05.223870 19617 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:09:05.224243 19617 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [term 1 LEADER]: Becoming Leader. State: Replica: 3696833dfffc40bda1c82ba654d6b4b3, State: Running, Role: LEADER
I20260811 17:09:05.224646 19617 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3696833dfffc40bda1c82ba654d6b4b3" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34869 } }
I20260811 17:09:05.225281 19609 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:09:05.225373 19613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:05.207850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34124 (local address 127.4.146.254:34869)
0811 17:09:05.208390 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:05.208411 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:05.208462 (+ 51us) server_negotiation.cc:407] Connection header received
0811 17:09:05.209466 (+ 1004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:05.209494 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:05.209989 (+ 495us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:05.210460 (+ 471us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:05.211240 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:05.212999 (+ 1759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:05.214181 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:05.214776 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:05.214932 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:05.218176 (+ 3244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:09:05.218182 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:09:05.218199 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:09:05.218233 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:09:05.221301 (+ 3068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:05.222063 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:05.222069 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:05.222075 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:05.222278 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:05.222656 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:05.222659 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:05.222660 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:05.223226 (+ 566us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:09:05.223395 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:05.223905 (+ 510us) server_negotiation.cc:299] Negotiation successful
0811 17:09:05.224319 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":194,"threads_started":1}
I20260811 17:09:05.225948 19620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3696833dfffc40bda1c82ba654d6b4b3. Latest consensus state: current_term: 1 leader_uuid: "3696833dfffc40bda1c82ba654d6b4b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3696833dfffc40bda1c82ba654d6b4b3" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34869 } } }
I20260811 17:09:05.226068 19620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [sys.catalog]: This master's current role is: LEADER
I20260811 17:09:05.226452 19629 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:09:05.227867 19624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3696833dfffc40bda1c82ba654d6b4b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3696833dfffc40bda1c82ba654d6b4b3" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34869 } } }
I20260811 17:09:05.228022 19624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [sys.catalog]: This master's current role is: LEADER
I20260811 17:09:05.230038 19629 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:09:05.235803 19629 catalog_manager.cc:1347] Generated new cluster ID: a0d73ea5ed0c4379acd768c5000430ab
I20260811 17:09:05.235890 19629 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:09:05.252846 19629 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:09:05.254267 19629 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:09:05.264123 19629 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3: Generated new TSK 0
I20260811 17:09:05.265057 19629 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
I20260811 17:09:05.317570 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:34869
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:44711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:09:05.441846 19665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:09:05.442139 19665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:09:05.442184 19665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:09:05.446501 19665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:09:05.446576 19665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:09:05.446640 19665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:09:05.453516 19665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:44711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:34869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:09:05.454623 19665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:09:05.455750 19665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:09:05.465760 19682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:05.465783 19685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:05.465762 19680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:05.466068 19665 server_base.cc:1034] running on GCE node
I20260811 17:09:05.466648 19665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:09:05.467428 19665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:09:05.468616 19665 hybrid_clock.cc:648] HybridClock initialized: now 1786468145468603 us; error 30 us; skew 500 ppm
Aug 11 17:09:05 dist-test-slave-7vjv krb5kdc[19473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468145, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:09:05.471567 19665 init.cc:377] Logged in from keytab as kudu/127.4.146.193@KRBTEST.COM (short username kudu)
I20260811 17:09:05.472644 19665 webserver.cc:460] Webserver started at http://127.4.146.193:39833/ using document root <none> and password file <none>
I20260811 17:09:05.473284 19665 fs_manager.cc:359] Metadata directory not provided
I20260811 17:09:05.473392 19665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:09:05.473666 19665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:09:05.475973 19665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "32a101c7e4a74a32b68a08b3b72a0c0c"
format_stamp: "Formatted at 2026-08-11 17:09:05 on dist-test-slave-7vjv"
server_key: "7dbecc8548717becb23cd7a38a37c470"
server_key_iv: "8e9e16eff31926a4adb13b33299453d1"
server_key_version: "encryptionkey@0"
I20260811 17:09:05.476720 19665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "32a101c7e4a74a32b68a08b3b72a0c0c"
format_stamp: "Formatted at 2026-08-11 17:09:05 on dist-test-slave-7vjv"
server_key: "7dbecc8548717becb23cd7a38a37c470"
server_key_iv: "8e9e16eff31926a4adb13b33299453d1"
server_key_version: "encryptionkey@0"
I20260811 17:09:05.481405 19665 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 17:09:05.484450 19695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:05.485852 19665 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:09:05.486027 19665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "32a101c7e4a74a32b68a08b3b72a0c0c"
format_stamp: "Formatted at 2026-08-11 17:09:05 on dist-test-slave-7vjv"
server_key: "7dbecc8548717becb23cd7a38a37c470"
server_key_iv: "8e9e16eff31926a4adb13b33299453d1"
server_key_version: "encryptionkey@0"
I20260811 17:09:05.486176 19665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:09:05.520191 19665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:09:05.523939 19665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:09:05.524212 19665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:09:05.524897 19665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:09:05.525904 19665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:09:05.526011 19665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:05.526087 19665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:09:05.526141 19665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:05.536185 19665 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:36325
I20260811 17:09:05.536217 19892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:36325 every 8 connection(s)
I20260811 17:09:05.537176 19665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:09:05.547596 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 19665
I20260811 17:09:05.547752 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
Aug 11 17:09:05 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468145, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:09:05.548225 4683 external_mini_cluster.cc:1428] Setting key 5794e6af625b51c69816fd89a01dee5a
I20260811 17:09:05.553496 19613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:05.539238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:39779 (local address 127.4.146.254:34869)
0811 17:09:05.539411 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:05.539415 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:05.540575 (+ 1160us) server_negotiation.cc:407] Connection header received
0811 17:09:05.541641 (+ 1066us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:05.541645 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:05.541714 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:05.541836 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:05.543207 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:05.543814 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:05.545168 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:05.545441 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:05.545613 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:05.548975 (+ 3362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:09:05.548979 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:09:05.548981 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:09:05.549010 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:09:05.550720 (+ 1710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:05.551453 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:05.551456 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:05.551457 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:05.551536 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:05.552022 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:05.552025 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:05.552026 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:05.552338 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:09:05.552486 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:05.553072 (+ 586us) server_negotiation.cc:299] Negotiation successful
0811 17:09:05.553239 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 17:09:05.554227 19899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:05.539561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.193:39779)
0811 17:09:05.540381 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:05.540430 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:05.541391 (+ 961us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:05.542045 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:05.542053 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:05.542474 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:05.543020 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:05.543039 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:05.543994 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:05.543997 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:05.545012 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:05.545023 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:05.545657 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:05.545662 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:05.545875 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:05.546617 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:05.546636 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:05.548744 (+ 2108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:09:05.550857 (+ 2113us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:09:05.550867 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:09:05.550890 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:09:05.551338 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:09:05.551636 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:09:05.551642 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:09:05.551647 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:09:05.551877 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:09:05.552488 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:09:05.552499 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:09:05.552794 (+ 295us) client_negotiation.cc:769] Sending connection context
0811 17:09:05.552961 (+ 167us) client_negotiation.cc:240] Negotiation successful
0811 17:09:05.553250 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":110,"threads_started":1}
I20260811 17:09:05.555605 19896 heartbeater.cc:347] Connected to a master server at 127.4.146.254:34869
I20260811 17:09:05.555913 19896 heartbeater.cc:464] Registering TS with master...
I20260811 17:09:05.556608 19896 heartbeater.cc:511] Master 127.4.146.254:34869 requested a full tablet report, sending...
I20260811 17:09:05.558303 19552 ts_manager.cc:194] Registered new tserver with Master: 32a101c7e4a74a32b68a08b3b72a0c0c (127.4.146.193:36325)
I20260811 17:09:05.559464 19552 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.193@KRBTEST.COM'} at 127.4.146.193:39779
WARNING: no policy specified for kudu/127.4.146.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
I20260811 17:09:05.583554 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:34869
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:44711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:09:05.703351 19911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:09:05.703663 19911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:09:05.703712 19911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:09:05.707868 19911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:09:05.707947 19911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:09:05.708009 19911 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:09:05.713572 19911 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:44711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:34869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19911
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:09:05.714872 19911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:09:05.715924 19911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:09:05.726882 19918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:05.726882 19922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:05.726984 19911 server_base.cc:1034] running on GCE node
W20260811 17:09:05.727176 19919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:05.727701 19911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:09:05.728603 19911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:09:05.729802 19911 hybrid_clock.cc:648] HybridClock initialized: now 1786468145729719 us; error 95 us; skew 500 ppm
Aug 11 17:09:05 dist-test-slave-7vjv krb5kdc[19473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468145, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:09:05.732995 19911 init.cc:377] Logged in from keytab as kudu/127.4.146.194@KRBTEST.COM (short username kudu)
I20260811 17:09:05.733906 19911 webserver.cc:460] Webserver started at http://127.4.146.194:42711/ using document root <none> and password file <none>
I20260811 17:09:05.734472 19911 fs_manager.cc:359] Metadata directory not provided
I20260811 17:09:05.734536 19911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:09:05.734716 19911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:09:05.736922 19911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "fc5a682d7ec541298c44f5763708a5bc"
format_stamp: "Formatted at 2026-08-11 17:09:05 on dist-test-slave-7vjv"
server_key: "c7b350b38ce6e10cafc55548b8f43c95"
server_key_iv: "4a883c0669f77c3b353aa386b9379def"
server_key_version: "encryptionkey@0"
I20260811 17:09:05.737556 19911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "fc5a682d7ec541298c44f5763708a5bc"
format_stamp: "Formatted at 2026-08-11 17:09:05 on dist-test-slave-7vjv"
server_key: "c7b350b38ce6e10cafc55548b8f43c95"
server_key_iv: "4a883c0669f77c3b353aa386b9379def"
server_key_version: "encryptionkey@0"
I20260811 17:09:05.741456 19911 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 17:09:05.743937 19934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:05.745261 19911 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260811 17:09:05.745394 19911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "fc5a682d7ec541298c44f5763708a5bc"
format_stamp: "Formatted at 2026-08-11 17:09:05 on dist-test-slave-7vjv"
server_key: "c7b350b38ce6e10cafc55548b8f43c95"
server_key_iv: "4a883c0669f77c3b353aa386b9379def"
server_key_version: "encryptionkey@0"
I20260811 17:09:05.745509 19911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:09:05.793949 19911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:09:05.797629 19911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:09:05.797863 19911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:09:05.798521 19911 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:09:05.799444 19911 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:09:05.799492 19911 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:05.799566 19911 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:09:05.799608 19911 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:05.809185 19911 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:34825
I20260811 17:09:05.809208 20131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:34825 every 8 connection(s)
I20260811 17:09:05.810181 19911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:09:05.812537 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 19911
I20260811 17:09:05.812672 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:09:05.813009 4683 external_mini_cluster.cc:1428] Setting key ed997a99a6cccb2685ef7f6292de16bf
Aug 11 17:09:05 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468145, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.146.195@KRBTEST.COM; defaulting to no policy
I20260811 17:09:05.826609 19613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:05.812198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:57731 (local address 127.4.146.254:34869)
0811 17:09:05.812386 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:05.812391 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:05.813755 (+ 1364us) server_negotiation.cc:407] Connection header received
0811 17:09:05.814830 (+ 1075us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:05.814833 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:05.814875 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:05.814948 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:05.816729 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:05.817329 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:05.819084 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:05.819525 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:05.819643 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:05.822366 (+ 2723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:09:05.822370 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:09:05.822372 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:09:05.822398 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:09:05.823926 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:05.824532 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:05.824535 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:05.824536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:05.824623 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:05.825052 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:05.825056 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:05.825058 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:05.825371 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:09:05.825485 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:05.826062 (+ 577us) server_negotiation.cc:299] Negotiation successful
0811 17:09:05.826433 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 17:09:05.827420 20134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:05.812680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.194:57731)
0811 17:09:05.813559 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:05.813626 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:05.814584 (+ 958us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:05.815158 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:05.815167 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:05.815770 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:05.816555 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:05.816580 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:05.817468 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:05.817473 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:05.818947 (+ 1474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:05.818958 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:05.819703 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:05.819706 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:05.819863 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:05.820541 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:05.820559 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:05.822171 (+ 1612us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:09:05.824062 (+ 1891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:09:05.824069 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:09:05.824115 (+ 46us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:09:05.824407 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:09:05.824721 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:09:05.824724 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:09:05.824726 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:09:05.824882 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:09:05.825485 (+ 603us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:09:05.825493 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:09:05.825781 (+ 288us) client_negotiation.cc:769] Sending connection context
0811 17:09:05.825981 (+ 200us) client_negotiation.cc:240] Negotiation successful
0811 17:09:05.826428 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":114,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.195@KRBTEST.COM" created.
I20260811 17:09:05.828821 20132 heartbeater.cc:347] Connected to a master server at 127.4.146.254:34869
I20260811 17:09:05.829097 20132 heartbeater.cc:464] Registering TS with master...
I20260811 17:09:05.829664 20132 heartbeater.cc:511] Master 127.4.146.254:34869 requested a full tablet report, sending...
I20260811 17:09:05.830858 19552 ts_manager.cc:194] Registered new tserver with Master: fc5a682d7ec541298c44f5763708a5bc (127.4.146.194:34825)
I20260811 17:09:05.831710 19552 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.194@KRBTEST.COM'} at 127.4.146.194:57731
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
I20260811 17:09:05.848405 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:34869
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:44711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:09:05.970628 20137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:09:05.970961 20137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:09:05.971040 20137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:09:05.975139 20137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:09:05.975260 20137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:09:05.975363 20137 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:09:05.981014 20137 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:44711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:34869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:09:05.982263 20137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:09:05.983359 20137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:09:05.993819 20144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:05.994071 20149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:05.993819 20151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:05.994227 20137 server_base.cc:1034] running on GCE node
I20260811 17:09:05.994812 20137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:09:05.995672 20137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:09:05.996888 20137 hybrid_clock.cc:648] HybridClock initialized: now 1786468145996877 us; error 34 us; skew 500 ppm
Aug 11 17:09:05 dist-test-slave-7vjv krb5kdc[19473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468145, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:09:05.999876 20137 init.cc:377] Logged in from keytab as kudu/127.4.146.195@KRBTEST.COM (short username kudu)
I20260811 17:09:06.001153 20137 webserver.cc:460] Webserver started at http://127.4.146.195:40009/ using document root <none> and password file <none>
I20260811 17:09:06.001806 20137 fs_manager.cc:359] Metadata directory not provided
I20260811 17:09:06.001910 20137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:09:06.002184 20137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:09:06.004470 20137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "591c4b6c755f4a71bcab81a41d022a69"
format_stamp: "Formatted at 2026-08-11 17:09:05 on dist-test-slave-7vjv"
server_key: "19cd5dbc6bdc6d23209eb37bda78f4e0"
server_key_iv: "61a74fbe28d135a136d43a9a4381d90e"
server_key_version: "encryptionkey@0"
I20260811 17:09:06.005174 20137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "591c4b6c755f4a71bcab81a41d022a69"
format_stamp: "Formatted at 2026-08-11 17:09:05 on dist-test-slave-7vjv"
server_key: "19cd5dbc6bdc6d23209eb37bda78f4e0"
server_key_iv: "61a74fbe28d135a136d43a9a4381d90e"
server_key_version: "encryptionkey@0"
I20260811 17:09:06.009444 20137 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 17:09:06.012575 20161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:06.014076 20137 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 17:09:06.014262 20137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "591c4b6c755f4a71bcab81a41d022a69"
format_stamp: "Formatted at 2026-08-11 17:09:05 on dist-test-slave-7vjv"
server_key: "19cd5dbc6bdc6d23209eb37bda78f4e0"
server_key_iv: "61a74fbe28d135a136d43a9a4381d90e"
server_key_version: "encryptionkey@0"
I20260811 17:09:06.014413 20137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:09:06.043553 20137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:09:06.047539 20137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:09:06.047819 20137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:09:06.048652 20137 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:09:06.049808 20137 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:09:06.049888 20137 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:06.049970 20137 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:09:06.050014 20137 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:06.060747 20137 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:36401
I20260811 17:09:06.060777 20357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:36401 every 8 connection(s)
I20260811 17:09:06.061805 20137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:09:06.067375 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 20137
I20260811 17:09:06.067548 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:09:06.067919 4683 external_mini_cluster.cc:1428] Setting key 33e7779641f647090ab49951f052deca
Aug 11 17:09:06 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468145, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:09:06.078119 19613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:06.063985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:36297 (local address 127.4.146.254:34869)
0811 17:09:06.064188 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:06.064192 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:06.065353 (+ 1161us) server_negotiation.cc:407] Connection header received
0811 17:09:06.066356 (+ 1003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:06.066360 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:06.066426 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:06.066538 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:06.068413 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.069203 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.070837 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.071061 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.071164 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:06.074142 (+ 2978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:09:06.074146 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:09:06.074148 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:09:06.074178 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:09:06.075638 (+ 1460us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:06.076290 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:06.076293 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:06.076294 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:06.076382 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:06.076782 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:06.076785 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:06.076787 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:06.077004 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:09:06.077094 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:06.077823 (+ 729us) server_negotiation.cc:299] Negotiation successful
0811 17:09:06.077975 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 17:09:06.079100 20362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:06.064395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.195:36297)
0811 17:09:06.065151 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:06.065202 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:06.066111 (+ 909us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:06.066773 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:06.066783 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:06.067377 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:06.068209 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:06.068235 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.069470 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.069474 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:06.070679 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:06.070690 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.071243 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.071246 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:06.071416 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:06.072252 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:06.072271 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:06.073948 (+ 1677us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:09:06.075773 (+ 1825us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:09:06.075779 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:09:06.075795 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:09:06.076161 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:09:06.076466 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:09:06.076468 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:09:06.076469 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:09:06.076650 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:09:06.077156 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:09:06.077163 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:09:06.077499 (+ 336us) client_negotiation.cc:769] Sending connection context
0811 17:09:06.077697 (+ 198us) client_negotiation.cc:240] Negotiation successful
0811 17:09:06.078050 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":130,"threads_started":1}
I20260811 17:09:06.080704 20358 heartbeater.cc:347] Connected to a master server at 127.4.146.254:34869
I20260811 17:09:06.081090 20358 heartbeater.cc:464] Registering TS with master...
I20260811 17:09:06.081877 20358 heartbeater.cc:511] Master 127.4.146.254:34869 requested a full tablet report, sending...
I20260811 17:09:06.083390 19552 ts_manager.cc:194] Registered new tserver with Master: 591c4b6c755f4a71bcab81a41d022a69 (127.4.146.195:36401)
I20260811 17:09:06.084164 19552 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.195@KRBTEST.COM'} at 127.4.146.195:36297
I20260811 17:09:06.098122 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.4.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.193.keytab.
Entry for principal oryx/127.4.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.193.keytab.
WARNING: no policy specified for oryx/127.4.146.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.194.keytab.
Entry for principal oryx/127.4.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.194.keytab.
WARNING: no policy specified for oryx/127.4.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.4.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.4.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.195.keytab.
Entry for principal oryx/127.4.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.195.keytab.
I20260811 17:09:06.193252 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 19665
I20260811 17:09:06.214540 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 19911
I20260811 17:09:06.253772 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 20137
I20260811 17:09:06.273859 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 19493
I20260811 17:09:06.292550 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:34869
--webserver_interface=127.4.146.254
--webserver_port=38183
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:44711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:34869
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:09:06.418604 20371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:09:06.418934 20371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:09:06.418979 20371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:09:06.423521 20371 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:09:06.423619 20371 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:09:06.423640 20371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:09:06.423657 20371 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:09:06.423674 20371 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:09:06.429490 20371 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:44711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:34869
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:34869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=38183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20371
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:09:06.430706 20371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:09:06.431836 20371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:09:06.441085 20381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:06.441120 20371 server_base.cc:1034] running on GCE node
W20260811 17:09:06.441064 20377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:06.441064 20379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:06.442052 20371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:09:06.443158 20371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:09:06.444317 20371 hybrid_clock.cc:648] HybridClock initialized: now 1786468146444284 us; error 48 us; skew 500 ppm
Aug 11 17:09:06 dist-test-slave-7vjv krb5kdc[19473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468146, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:09:06.447383 20371 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:09:06.448434 20371 webserver.cc:460] Webserver started at http://127.4.146.254:38183/ using document root <none> and password file <none>
I20260811 17:09:06.449048 20371 fs_manager.cc:359] Metadata directory not provided
I20260811 17:09:06.449134 20371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:09:06.453264 20371 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 17:09:06.456303 20392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:06.457824 20371 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:09:06.457950 20371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "3696833dfffc40bda1c82ba654d6b4b3"
format_stamp: "Formatted at 2026-08-11 17:09:05 on dist-test-slave-7vjv"
server_key: "c130115ea5732aa7879075f391627dd2"
server_key_iv: "e9501d20c08b82f54487fc2cf94dd75f"
server_key_version: "encryptionkey@0"
I20260811 17:09:06.458498 20371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:09:06.481487 20371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:09:06.484545 20371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:09:06.484722 20371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:09:06.492879 20371 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:34869
I20260811 17:09:06.492937 20489 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:34869 every 8 connection(s)
I20260811 17:09:06.494086 20371 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:09:06.498807 20493 sys_catalog.cc:263] Verifying existing consensus state
I20260811 17:09:06.500708 20493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3: Bootstrap starting.
I20260811 17:09:06.501081 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 20371
I20260811 17:09:06.501559 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:36325
--local_ip_for_outbound_sockets=127.4.146.193
--tserver_master_addrs=127.4.146.254:34869
--webserver_port=39833
--webserver_interface=127.4.146.193
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:44711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.4.146.193
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 17:09:06.524533 20493 log.cc:824] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3: Log is configured to *not* fsync() on all Append() calls
I20260811 17:09:06.534631 20493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 17:09:06.535221 20493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3: Bootstrap complete.
I20260811 17:09:06.542059 20493 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3696833dfffc40bda1c82ba654d6b4b3" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34869 } }
I20260811 17:09:06.542760 20493 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3696833dfffc40bda1c82ba654d6b4b3, State: Initialized, Role: FOLLOWER
I20260811 17:09:06.543450 20493 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3696833dfffc40bda1c82ba654d6b4b3" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34869 } }
I20260811 17:09:06.543696 20493 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:09:06.543787 20493 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:09:06.543902 20493 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [term 1 FOLLOWER]: Advancing to term 2
I20260811 17:09:06.547039 20493 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3696833dfffc40bda1c82ba654d6b4b3" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34869 } }
I20260811 17:09:06.547521 20493 leader_election.cc:302] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3696833dfffc40bda1c82ba654d6b4b3; no voters:
I20260811 17:09:06.547991 20493 leader_election.cc:288] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 17:09:06.548180 20497 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 17:09:06.548501 20497 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [term 2 LEADER]: Becoming Leader. State: Replica: 3696833dfffc40bda1c82ba654d6b4b3, State: Running, Role: LEADER
I20260811 17:09:06.548902 20497 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3696833dfffc40bda1c82ba654d6b4b3" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34869 } }
I20260811 17:09:06.549584 20493 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:09:06.550684 20498 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "3696833dfffc40bda1c82ba654d6b4b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3696833dfffc40bda1c82ba654d6b4b3" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34869 } } }
I20260811 17:09:06.550866 20498 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [sys.catalog]: This master's current role is: LEADER
I20260811 17:09:06.550684 20499 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3696833dfffc40bda1c82ba654d6b4b3. Latest consensus state: current_term: 2 leader_uuid: "3696833dfffc40bda1c82ba654d6b4b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3696833dfffc40bda1c82ba654d6b4b3" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34869 } } }
I20260811 17:09:06.550978 20499 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3 [sys.catalog]: This master's current role is: LEADER
I20260811 17:09:06.551367 20512 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:09:06.555464 20512 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:09:06.556429 20512 catalog_manager.cc:1259] Loaded cluster ID: a0d73ea5ed0c4379acd768c5000430ab
I20260811 17:09:06.556515 20512 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:09:06.558377 20512 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:09:06.558987 20512 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3696833dfffc40bda1c82ba654d6b4b3: Loaded TSK: 0
I20260811 17:09:06.559993 20512 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 17:09:06.659740 20495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:09:06.660041 20495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:09:06.660157 20495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:09:06.664698 20495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:09:06.664784 20495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:09:06.664878 20495 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:09:06.670831 20495 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:44711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.193.keytab
--principal=oryx/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:36325
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=39833
--tserver_master_addrs=127.4.146.254:34869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20495
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:09:06.671983 20495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:09:06.673082 20495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:09:06.683045 20533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:06.683202 20537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:06.683341 20495 server_base.cc:1034] running on GCE node
W20260811 17:09:06.683018 20532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:06.683856 20495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:09:06.684597 20495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:09:06.685801 20495 hybrid_clock.cc:648] HybridClock initialized: now 1786468146685773 us; error 48 us; skew 500 ppm
Aug 11 17:09:06 dist-test-slave-7vjv krb5kdc[19473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468146, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:09:06.688971 20495 init.cc:377] Logged in from keytab as oryx/127.4.146.193@KRBTEST.COM (short username oryx)
I20260811 17:09:06.690001 20495 webserver.cc:460] Webserver started at http://127.4.146.193:39833/ using document root <none> and password file <none>
I20260811 17:09:06.690590 20495 fs_manager.cc:359] Metadata directory not provided
I20260811 17:09:06.690671 20495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:09:06.695087 20495 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 17:09:06.697600 20550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:06.699028 20495 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 17:09:06.699168 20495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "32a101c7e4a74a32b68a08b3b72a0c0c"
format_stamp: "Formatted at 2026-08-11 17:09:05 on dist-test-slave-7vjv"
server_key: "7dbecc8548717becb23cd7a38a37c470"
server_key_iv: "8e9e16eff31926a4adb13b33299453d1"
server_key_version: "encryptionkey@0"
I20260811 17:09:06.699757 20495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:09:06.712311 20495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:09:06.715881 20495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:09:06.716150 20495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:09:06.716861 20495 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:09:06.717770 20495 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:09:06.717820 20495 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:06.717895 20495 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:09:06.717926 20495 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:06.729735 20495 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:36325
I20260811 17:09:06.729786 20735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:36325 every 8 connection(s)
I20260811 17:09:06.731024 20495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:09:06.731738 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 20495
I20260811 17:09:06.732389 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:34825
--local_ip_for_outbound_sockets=127.4.146.194
--tserver_master_addrs=127.4.146.254:34869
--webserver_port=42711
--webserver_interface=127.4.146.194
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:44711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.4.146.194
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 17:09:06 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:06 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 17:09:06.745736 20738 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:06.733555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:41203 (local address 127.4.146.254:34869)
0811 17:09:06.734183 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:06.734212 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:06.734816 (+ 604us) server_negotiation.cc:407] Connection header received
0811 17:09:06.735975 (+ 1159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:06.735986 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:06.736372 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:06.736718 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:06.737966 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.739095 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.740414 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.740902 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.741096 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:06.744929 (+ 3833us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.193:41203: BlockingRecv error: recv got EOF from 127.4.146.193:41203 (error 108)
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":135,"threads_started":1}
I20260811 17:09:06.745744 20740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:06.733567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.193:41203)
0811 17:09:06.734601 (+ 1034us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:06.734664 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:06.735521 (+ 857us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:06.736813 (+ 1292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:06.736822 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:06.737280 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:06.737767 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:06.737782 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.739247 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.739253 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:06.740281 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:06.740291 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.741094 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.741098 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:06.741303 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:06.741961 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:06.741979 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:06.744672 (+ 2693us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":802,"thread_start_us":143,"threads_started":1}
W20260811 17:09:06.746658 20736 heartbeater.cc:644] Failed to heartbeat to 127.4.146.254:34869 (0 consecutive failures): Not authorized: Failed to ping master at 127.4.146.254:34869: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Aug 11 17:09:06 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:06 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:06.752936 20740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:06.747141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.193:60953)
0811 17:09:06.747267 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:06.747284 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:06.747399 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:06.747680 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:06.747683 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:06.747861 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:06.747960 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:06.747966 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.748780 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.748785 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:06.749401 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:06.749411 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.749941 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.749944 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:06.750035 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:06.750593 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:06.750612 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:06.752745 (+ 2133us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 17:09:06.752971 20738 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:06.747295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:60953 (local address 127.4.146.254:34869)
0811 17:09:06.747446 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:06.747453 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:06.747468 (+ 15us) server_negotiation.cc:407] Connection header received
0811 17:09:06.747519 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:06.747521 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:06.747563 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:06.747660 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:06.748084 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.748666 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.749523 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.749819 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.749927 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:06.752876 (+ 2949us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.193:60953: BlockingRecv error: recv got EOF from 127.4.146.193:60953 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 11 17:09:06 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:06 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:06.759665 20740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:06.753580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.193:48507)
0811 17:09:06.753697 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:06.753714 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:06.753790 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:06.754233 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:06.754235 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:06.754363 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:06.754447 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:06.754451 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.755641 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.755644 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:06.756265 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:06.756275 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.756983 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.756986 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:06.757050 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:06.757590 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:06.757604 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:06.759494 (+ 1890us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 17:09:06.759759 20738 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:06.753780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:48507 (local address 127.4.146.254:34869)
0811 17:09:06.753953 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:06.753961 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:06.753984 (+ 23us) server_negotiation.cc:407] Connection header received
0811 17:09:06.754044 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:06.754048 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:06.754103 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:06.754220 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:06.754564 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.755479 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.756404 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.756840 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.756989 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:06.759628 (+ 2639us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.193:48507: BlockingRecv error: recv got EOF from 127.4.146.193:48507 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260811 17:09:06.760269 20736 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 17:09:06.862851 20741 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:09:06.863202 20741 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:09:06.863299 20741 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:09:06.867488 20741 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:09:06.867568 20741 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:09:06.867666 20741 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:09:06.873211 20741 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:44711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.194.keytab
--principal=oryx/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:34825
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=42711
--tserver_master_addrs=127.4.146.254:34869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20741
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:09:06.874352 20741 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:09:06.875442 20741 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:09:06.885488 20750 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:06.885496 20746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:06.885502 20748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:06.885805 20741 server_base.cc:1034] running on GCE node
I20260811 17:09:06.886248 20741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:09:06.886826 20741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:09:06.888029 20741 hybrid_clock.cc:648] HybridClock initialized: now 1786468146887986 us; error 53 us; skew 500 ppm
Aug 11 17:09:06 dist-test-slave-7vjv krb5kdc[19473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468146, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:09:06.891243 20741 init.cc:377] Logged in from keytab as oryx/127.4.146.194@KRBTEST.COM (short username oryx)
I20260811 17:09:06.892347 20741 webserver.cc:460] Webserver started at http://127.4.146.194:42711/ using document root <none> and password file <none>
I20260811 17:09:06.892917 20741 fs_manager.cc:359] Metadata directory not provided
I20260811 17:09:06.892997 20741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:09:06.897177 20741 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:09:06.899384 20761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:06.900754 20741 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:09:06.900863 20741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "fc5a682d7ec541298c44f5763708a5bc"
format_stamp: "Formatted at 2026-08-11 17:09:05 on dist-test-slave-7vjv"
server_key: "c7b350b38ce6e10cafc55548b8f43c95"
server_key_iv: "4a883c0669f77c3b353aa386b9379def"
server_key_version: "encryptionkey@0"
I20260811 17:09:06.901432 20741 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:09:06.924024 20741 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:09:06.927500 20741 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:09:06.927758 20741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:09:06.928597 20741 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:09:06.929461 20741 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:09:06.929512 20741 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:06.929554 20741 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:09:06.929569 20741 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:06.939236 20741 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:34825
I20260811 17:09:06.939255 20947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:34825 every 8 connection(s)
I20260811 17:09:06.940452 20741 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:09:06.942452 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 20741
I20260811 17:09:06.942967 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:36401
--local_ip_for_outbound_sockets=127.4.146.195
--tserver_master_addrs=127.4.146.254:34869
--webserver_port=40009
--webserver_interface=127.4.146.195
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:44711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.4.146.195
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 17:09:06 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:06 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 17:09:06.954973 20738 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:06.942459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:60949 (local address 127.4.146.254:34869)
0811 17:09:06.942615 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:06.942622 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:06.943961 (+ 1339us) server_negotiation.cc:407] Connection header received
0811 17:09:06.945052 (+ 1091us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:06.945057 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:06.945133 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:06.945227 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:06.946943 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.947468 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.949419 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.949664 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.949756 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:06.954854 (+ 5098us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.194:60949: BlockingRecv error: recv got EOF from 127.4.146.194:60949 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 17:09:06.956169 20952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:06.943031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.194:60949)
0811 17:09:06.943790 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:06.943834 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:06.944721 (+ 887us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:06.945458 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:06.945470 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:06.946026 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:06.946762 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:06.946795 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.947616 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.947622 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:06.949279 (+ 1657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:06.949297 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.949872 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.949880 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:06.950167 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:06.950865 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:06.950894 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:06.954728 (+ 3834us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":161,"threads_started":1}
W20260811 17:09:06.956768 20948 heartbeater.cc:644] Failed to heartbeat to 127.4.146.254:34869 (0 consecutive failures): Not authorized: Failed to ping master at 127.4.146.254:34869: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Aug 11 17:09:06 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:06 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:06.963730 20952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:06.957288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.194:42493)
0811 17:09:06.957413 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:06.957430 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:06.957520 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:06.957854 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:06.957856 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:06.958045 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:06.958159 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:06.958164 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.959271 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.959274 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:06.959869 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:06.959879 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.960580 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.960583 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:06.960668 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:06.961261 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:06.961274 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:06.963520 (+ 2246us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 17:09:06.963755 20738 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:06.957431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:42493 (local address 127.4.146.254:34869)
0811 17:09:06.957578 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:06.957603 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:06.957619 (+ 16us) server_negotiation.cc:407] Connection header received
0811 17:09:06.957673 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:06.957675 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:06.957723 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:06.957815 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:06.958280 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.959139 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.960020 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.960420 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.960532 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:06.963655 (+ 3123us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.194:42493: BlockingRecv error: recv got EOF from 127.4.146.194:42493 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 11 17:09:06 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:06 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:06.969907 20952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:06.964462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.194:54087)
0811 17:09:06.964600 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:06.964615 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:06.964694 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:06.964901 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:06.964903 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:06.965078 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:06.965173 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:06.965179 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.965904 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.965907 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:06.966810 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:06.966821 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.967258 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.967262 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:06.967346 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:06.967798 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:06.967813 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:06.969807 (+ 1994us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 17:09:06.970162 20948 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 17:09:06.970209 20738 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:06.964580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:54087 (local address 127.4.146.254:34869)
0811 17:09:06.964693 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:06.964696 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:06.964709 (+ 13us) server_negotiation.cc:407] Connection header received
0811 17:09:06.964765 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:06.964767 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:06.964804 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:06.964861 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:06.965280 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.965803 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.966934 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:06.967146 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:06.967226 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:06.969969 (+ 2743us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.194:54087: BlockingRecv error: recv got EOF from 127.4.146.194:54087 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260811 17:09:07.070452 20953 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:09:07.070767 20953 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:09:07.070814 20953 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:09:07.075155 20953 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:09:07.075251 20953 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:09:07.075348 20953 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:09:07.081174 20953 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:44711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/krb5kdc/oryx_127.4.146.195.keytab
--principal=oryx/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:36401
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=40009
--tserver_master_addrs=127.4.146.254:34869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20953
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:09:07.082404 20953 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:09:07.083555 20953 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:09:07.094174 20964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:07.094141 20961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:07.094411 20953 server_base.cc:1034] running on GCE node
W20260811 17:09:07.094215 20960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:07.094986 20953 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:09:07.095721 20953 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:09:07.096923 20953 hybrid_clock.cc:648] HybridClock initialized: now 1786468147096859 us; error 79 us; skew 500 ppm
Aug 11 17:09:07 dist-test-slave-7vjv krb5kdc[19473](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468147, etypes {rep=17 tkt=17 ses=17}, oryx/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:09:07.100221 20953 init.cc:377] Logged in from keytab as oryx/127.4.146.195@KRBTEST.COM (short username oryx)
I20260811 17:09:07.101178 20953 webserver.cc:460] Webserver started at http://127.4.146.195:40009/ using document root <none> and password file <none>
I20260811 17:09:07.101818 20953 fs_manager.cc:359] Metadata directory not provided
I20260811 17:09:07.101898 20953 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:09:07.106437 20953 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 17:09:07.108816 20982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:07.110244 20953 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:09:07.110368 20953 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "591c4b6c755f4a71bcab81a41d022a69"
format_stamp: "Formatted at 2026-08-11 17:09:05 on dist-test-slave-7vjv"
server_key: "19cd5dbc6bdc6d23209eb37bda78f4e0"
server_key_iv: "61a74fbe28d135a136d43a9a4381d90e"
server_key_version: "encryptionkey@0"
I20260811 17:09:07.110962 20953 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:09:07.134701 20953 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:09:07.138849 20953 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:09:07.139104 20953 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:09:07.139791 20953 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:09:07.140803 20953 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:09:07.140879 20953 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:07.140954 20953 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:09:07.141006 20953 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:07.150538 20953 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:36401
I20260811 17:09:07.150599 21188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:36401 every 8 connection(s)
I20260811 17:09:07.151845 20953 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:09:07.152513 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 20953
Aug 11 17:09:07 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:07 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:07.165659 20738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:07.153347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34126 (local address 127.4.146.254:34869)
0811 17:09:07.153515 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:07.153520 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:07.153733 (+ 213us) server_negotiation.cc:407] Connection header received
0811 17:09:07.153925 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:07.153930 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:07.153992 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:07.154120 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:07.155135 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:07.156201 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:07.157312 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:07.157667 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:07.157800 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:07.159944 (+ 2144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:09:07.159954 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:09:07.159977 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:09:07.160022 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:09:07.162542 (+ 2520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:07.163323 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:07.163333 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:07.163341 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:07.163530 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:07.163950 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:07.163954 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:07.163957 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:07.164499 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:09:07.164740 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:07.165075 (+ 335us) server_negotiation.cc:299] Negotiation successful
0811 17:09:07.165418 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260811 17:09:07.166936 21192 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:07.154367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:42157 (local address 127.4.146.254:34869)
0811 17:09:07.154625 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:07.154628 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:07.155893 (+ 1265us) server_negotiation.cc:407] Connection header received
0811 17:09:07.157060 (+ 1167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:07.157064 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:07.157123 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:07.157253 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:07.158857 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:07.159826 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:07.162021 (+ 2195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:07.162330 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:07.162440 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:07.166794 (+ 4354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.195:42157: BlockingRecv error: recv got EOF from 127.4.146.195:42157 (error 108)
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":101,"threads_started":1}
I20260811 17:09:07.167728 21193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:07.154643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.195:42157)
0811 17:09:07.155671 (+ 1028us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:07.155734 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:07.156818 (+ 1084us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:07.157517 (+ 699us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:07.157527 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:07.158097 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:07.158653 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:07.158668 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:07.159991 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:07.159996 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:07.161790 (+ 1794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:07.161812 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:07.162537 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:07.162542 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:07.162777 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:07.163428 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:07.163450 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:07.166618 (+ 3168us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":753,"thread_start_us":190,"threads_started":1}
W20260811 17:09:07.168443 21189 heartbeater.cc:644] Failed to heartbeat to 127.4.146.254:34869 (0 consecutive failures): Not authorized: Failed to ping master at 127.4.146.254:34869: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Aug 11 17:09:07 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:07 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:07.175046 21193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:07.169149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.195:57619)
0811 17:09:07.169293 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:07.169418 (+ 125us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:07.169544 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:07.169850 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:07.169853 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:07.170066 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:07.170179 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:07.170185 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:07.171031 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:07.171036 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:07.171659 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:07.171668 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:07.172246 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:07.172251 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:07.172361 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:07.172870 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:07.172882 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:07.174878 (+ 1996us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 17:09:07.175148 21192 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:07.169203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:57619 (local address 127.4.146.254:34869)
0811 17:09:07.169324 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:07.169332 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:07.169487 (+ 155us) server_negotiation.cc:407] Connection header received
0811 17:09:07.169671 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:07.169674 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:07.169732 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:07.169826 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:07.170308 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:07.170900 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:07.171796 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:07.172063 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:07.172247 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:07.175016 (+ 2769us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.195:57619: BlockingRecv error: recv got EOF from 127.4.146.195:57619 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 11 17:09:07 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:07 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:07.181593 21193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:07.175858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.195:45491)
0811 17:09:07.176032 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:07.176044 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:07.176157 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:07.176520 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:07.176523 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:07.176692 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:07.176769 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:07.176774 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:07.177572 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:07.177575 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:07.178090 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:07.178097 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:07.178552 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:07.178556 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:07.178639 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:07.179124 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:07.179136 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:07.181422 (+ 2286us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116}
W20260811 17:09:07.181789 21192 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:07.176070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:45491 (local address 127.4.146.254:34869)
0811 17:09:07.176316 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:07.176319 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:07.176330 (+ 11us) server_negotiation.cc:407] Connection header received
0811 17:09:07.176364 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:07.176366 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:07.176404 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:07.176496 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:07.176884 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:07.177425 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:07.178208 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:07.178435 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:07.178549 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:07.181550 (+ 3001us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.195:45491: BlockingRecv error: recv got EOF from 127.4.146.195:45491 (error 108)
Metrics: {"server-negotiator.queue_time_us":165}
W20260811 17:09:07.181938 21189 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 17:09:07 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:07 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:07.767442 21194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:07.761030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.193:55859)
0811 17:09:07.761373 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:07.761389 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:07.761493 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:07.761881 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:07.761884 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:07.762116 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:07.762221 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:07.762227 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:07.763139 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:07.763142 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:07.763717 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:07.763725 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:07.764259 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:07.764262 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:07.764327 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:07.764930 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:07.764943 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:07.767310 (+ 2367us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":126,"threads_started":1}
W20260811 17:09:07.767601 21195 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:07.761217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:55859 (local address 127.4.146.254:34869)
0811 17:09:07.761447 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:07.761451 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:07.761467 (+ 16us) server_negotiation.cc:407] Connection header received
0811 17:09:07.761675 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:07.761680 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:07.761730 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:07.761818 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:07.762361 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:07.763006 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:07.763822 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:07.764051 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:07.764234 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:07.767429 (+ 3195us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.193:55859: BlockingRecv error: recv got EOF from 127.4.146.193:55859 (error 108)
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":72,"threads_started":1}
Aug 11 17:09:07 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:07 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:07.980852 21196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:07.971018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.194:47021)
0811 17:09:07.971338 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:07.971362 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:07.971464 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:07.971774 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:07.971776 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:07.972014 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:07.972272 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:07.972286 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:07.973018 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:07.973021 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:07.973638 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:07.973647 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:07.974083 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:07.974120 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:07.974211 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:07.978443 (+ 4232us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:07.978457 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:07.980663 (+ 2206us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":84,"threads_started":1}
W20260811 17:09:07.980935 21195 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:07.971110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:47021 (local address 127.4.146.254:34869)
0811 17:09:07.971324 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:07.971331 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:07.971441 (+ 110us) server_negotiation.cc:407] Connection header received
0811 17:09:07.971568 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:07.971571 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:07.971631 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:07.971702 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:07.972389 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:07.972919 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:07.973756 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:07.973980 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:07.974061 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:07.980816 (+ 6755us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.194:47021: BlockingRecv error: recv got EOF from 127.4.146.194:47021 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Aug 11 17:09:08 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:08 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:08.189034 21199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:08.182766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.195:53915)
0811 17:09:08.183236 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:08.183255 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:08.183422 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:08.183732 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:08.183735 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:08.183964 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:08.184065 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:08.184071 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:08.184892 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:08.184898 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:08.185491 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:08.185500 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:08.186011 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:08.186015 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:08.186105 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:08.186738 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:08.186750 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:08.188906 (+ 2156us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":97,"threads_started":1}
W20260811 17:09:08.189200 21195 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:08.182942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:53915 (local address 127.4.146.254:34869)
0811 17:09:08.183238 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:08.183245 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:08.183353 (+ 108us) server_negotiation.cc:407] Connection header received
0811 17:09:08.183538 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:08.183541 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:08.183602 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:08.183705 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:08.184225 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:08.184773 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:08.185624 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:08.185877 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:08.185989 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:08.189061 (+ 3072us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.195:53915: BlockingRecv error: recv got EOF from 127.4.146.195:53915 (error 108)
Metrics: {"server-negotiator.queue_time_us":192}
Aug 11 17:09:08 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:08 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:08.778893 21202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:08.768487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.193:56819)
0811 17:09:08.768868 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:08.768887 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:08.769017 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:08.769365 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:08.769368 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:08.769583 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:08.769706 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:08.769712 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:08.770565 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:08.770568 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:08.771176 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:08.771185 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:08.771751 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:08.771755 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:08.771835 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:08.776191 (+ 4356us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:08.776206 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:08.778677 (+ 2471us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":86,"threads_started":1}
W20260811 17:09:08.779152 21206 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:08.768736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:56819 (local address 127.4.146.254:34869)
0811 17:09:08.769046 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:08.769050 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:08.769065 (+ 15us) server_negotiation.cc:407] Connection header received
0811 17:09:08.769111 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:08.769113 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:08.769176 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:08.769272 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:08.769857 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:08.770439 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:08.771326 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:08.771571 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:08.771686 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:08.778973 (+ 7287us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.193:56819: BlockingRecv error: recv got EOF from 127.4.146.193:56819 (error 108)
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":108,"threads_started":1}
Aug 11 17:09:08 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:08 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:08.988514 21208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:08.981907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.194:52303)
0811 17:09:08.982302 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:08.982320 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:08.982486 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:08.982804 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:08.982808 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:08.983037 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:08.983145 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:08.983151 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:08.984068 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:08.984073 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:08.984783 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:08.984793 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:08.985267 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:08.985271 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:08.985359 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:08.985895 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:08.985911 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:08.988291 (+ 2380us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":133,"threads_started":1}
W20260811 17:09:08.988610 21206 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:08.982079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:52303 (local address 127.4.146.254:34869)
0811 17:09:08.982281 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:08.982286 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:08.982419 (+ 133us) server_negotiation.cc:407] Connection header received
0811 17:09:08.982613 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:08.982616 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:08.982683 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:08.982777 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:08.983275 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:08.983947 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:08.984916 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:08.985146 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:08.985261 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:08.988466 (+ 3205us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.194:52303: BlockingRecv error: recv got EOF from 127.4.146.194:52303 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 11 17:09:09 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:09 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:09.196316 21209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:09.190017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.195:42701)
0811 17:09:09.190390 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:09.190409 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:09.190560 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:09.190878 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:09.190881 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:09.191163 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:09.191305 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:09.191312 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:09.192253 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:09.192269 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:09.193012 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:09.193022 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:09.193498 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:09.193501 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:09.193587 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:09.194136 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:09.194148 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:09.196162 (+ 2014us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":133,"threads_started":1}
W20260811 17:09:09.196485 21206 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:09.190244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:42701 (local address 127.4.146.254:34869)
0811 17:09:09.190421 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:09.190429 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:09.190497 (+ 68us) server_negotiation.cc:407] Connection header received
0811 17:09:09.190693 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:09.190697 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:09.190752 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:09.190849 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:09.191438 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:09.192150 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:09.193145 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:09.193381 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:09.193493 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:09.196323 (+ 2830us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.195:42701: BlockingRecv error: recv got EOF from 127.4.146.195:42701 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 11 17:09:09 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:09 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:09.785621 21211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:09.779881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.193:51121)
0811 17:09:09.780234 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:09.780250 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:09.780347 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:09.780618 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:09.780620 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:09.780817 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:09.780927 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:09.780933 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:09.781704 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:09.781707 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:09.782286 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:09.782294 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:09.782753 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:09.782755 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:09.782816 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:09.783348 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:09.783362 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:09.785431 (+ 2069us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":95,"threads_started":1}
W20260811 17:09:09.785734 21213 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:09.779911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:51121 (local address 127.4.146.254:34869)
0811 17:09:09.780317 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:09.780320 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:09.780335 (+ 15us) server_negotiation.cc:407] Connection header received
0811 17:09:09.780439 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:09.780441 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:09.780487 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:09.780569 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:09.781034 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:09.781603 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:09.782405 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:09.782647 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:09.782730 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:09.785587 (+ 2857us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.193:51121: BlockingRecv error: recv got EOF from 127.4.146.193:51121 (error 108)
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":86,"threads_started":1}
Aug 11 17:09:09 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:09 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:09.995380 21214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:09.989567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.194:43591)
0811 17:09:09.989888 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:09.989903 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:09.990035 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:09.990316 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:09.990318 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:09.990535 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:09.990639 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:09.990645 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:09.991550 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:09.991553 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:09.992201 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:09.992211 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:09.992683 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:09.992686 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:09.992762 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:09.993321 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:09.993340 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:09.995243 (+ 1903us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":102,"threads_started":1}
W20260811 17:09:09.995589 21213 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:09.989626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:43591 (local address 127.4.146.254:34869)
0811 17:09:09.989794 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:09.989801 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:09.990042 (+ 241us) server_negotiation.cc:407] Connection header received
0811 17:09:09.990112 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:09.990114 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:09.990173 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:09.990251 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:09.990750 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:09.991437 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:09.992315 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:09.992546 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:09.992630 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:09.995444 (+ 2814us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.194:43591: BlockingRecv error: recv got EOF from 127.4.146.194:43591 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 11 17:09:10 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:10 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:10.203511 21215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:10.197220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.195:56355)
0811 17:09:10.197528 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:10.197547 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:10.197653 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:10.197934 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:10.197937 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:10.198166 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:10.198272 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:10.198278 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:10.199110 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:10.199113 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:10.199729 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:10.199738 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:10.200361 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:10.200365 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:10.200447 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:10.201015 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:10.201028 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:10.203371 (+ 2343us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":124,"threads_started":1}
W20260811 17:09:10.203755 21213 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:10.197294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:56355 (local address 127.4.146.254:34869)
0811 17:09:10.197451 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:10.197455 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:10.197651 (+ 196us) server_negotiation.cc:407] Connection header received
0811 17:09:10.197721 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:10.197723 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:10.197774 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:10.197851 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:10.198422 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:10.198961 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:10.199893 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:10.200213 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:10.200310 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:10.203587 (+ 3277us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.195:56355: BlockingRecv error: recv got EOF from 127.4.146.195:56355 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 11 17:09:10 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:10 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:10.793164 21217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:10.786677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.193:58287)
0811 17:09:10.787165 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:10.787183 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:10.787292 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:10.787574 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:10.787576 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:10.787781 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:10.787891 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:10.787896 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:10.788709 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:10.788712 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:10.789373 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:10.789382 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:10.789873 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:10.789876 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:10.789955 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:10.790523 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:10.790538 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:10.792982 (+ 2444us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":97,"threads_started":1}
W20260811 17:09:10.793262 21220 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:10.786918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:58287 (local address 127.4.146.254:34869)
0811 17:09:10.787230 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:10.787234 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:10.787250 (+ 16us) server_negotiation.cc:407] Connection header received
0811 17:09:10.787392 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:10.787395 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:10.787440 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:10.787523 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:10.788011 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:10.788591 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:10.789499 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:10.789742 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:10.789825 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:10.793126 (+ 3301us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.193:58287: BlockingRecv error: recv got EOF from 127.4.146.193:58287 (error 108)
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":91,"threads_started":1}
Aug 11 17:09:10 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:10 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:11.002869 21221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:10.996450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.194:51705)
0811 17:09:10.996896 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:10.996920 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:10.997083 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:10.997387 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:10.997390 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:10.997621 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:10.997723 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:10.997729 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:10.998568 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:10.998573 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:10.999371 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:10.999384 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:10.999875 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:10.999879 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:10.999969 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:11.000575 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:11.000588 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:11.002744 (+ 2156us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":139,"threads_started":1}
W20260811 17:09:11.003113 21220 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:10.996637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:51705 (local address 127.4.146.254:34869)
0811 17:09:10.996864 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:10.996870 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:10.997013 (+ 143us) server_negotiation.cc:407] Connection header received
0811 17:09:10.997195 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:10.997199 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:10.997256 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:10.997353 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:10.997860 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:10.998442 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:10.999501 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:10.999748 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:10.999866 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:11.002953 (+ 3087us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.194:51705: BlockingRecv error: recv got EOF from 127.4.146.194:51705 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
Aug 11 17:09:11 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:11 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:11.211074 21223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:11.204660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.195:33825)
0811 17:09:11.205065 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:11.205085 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:11.205219 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:11.205505 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:11.205507 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:11.205723 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:11.205904 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:11.205911 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:11.206824 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:11.206831 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:11.207412 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:11.207421 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:11.208031 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:11.208035 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:11.208176 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:11.208786 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:11.208799 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:11.210899 (+ 2100us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":114,"threads_started":1}
W20260811 17:09:11.211197 21220 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:11.204807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:33825 (local address 127.4.146.254:34869)
0811 17:09:11.205047 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:11.205051 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:11.205226 (+ 175us) server_negotiation.cc:407] Connection header received
0811 17:09:11.205295 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:11.205297 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:11.205350 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:11.205434 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:11.206061 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:11.206698 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:11.207561 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:11.207892 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:11.208010 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:11.211065 (+ 3055us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.195:33825: BlockingRecv error: recv got EOF from 127.4.146.195:33825 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 11 17:09:11 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:11 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 17:09:11.800964 21226 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:11.794367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:40579 (local address 127.4.146.254:34869)
0811 17:09:11.794685 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:11.794690 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:11.794704 (+ 14us) server_negotiation.cc:407] Connection header received
0811 17:09:11.794801 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:11.794804 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:11.794858 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:11.794954 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:11.795436 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:11.795986 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:11.796888 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:11.797142 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:11.797263 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:11.800850 (+ 3587us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.193:40579: BlockingRecv error: recv got EOF from 127.4.146.193:40579 (error 108)
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":133,"threads_started":1}
I20260811 17:09:11.800976 21224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:11.794266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.193:40579)
0811 17:09:11.794579 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:11.794597 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:11.794703 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:11.794979 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:11.794982 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:11.795204 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:11.795303 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:11.795309 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:11.796140 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:11.796145 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:11.796758 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:11.796767 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:11.797279 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:11.797283 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:11.797371 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:11.798056 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:11.798071 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:11.800702 (+ 2631us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":90,"threads_started":1}
Aug 11 17:09:12 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:12 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:12.010349 21228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:12.003944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.194:59289)
0811 17:09:12.004277 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:12.004303 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:12.004512 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:12.004784 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:12.004786 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:12.004996 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:12.005103 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:12.005108 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:12.005953 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:12.005957 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:12.006752 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:12.006764 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:12.007251 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:12.007255 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:12.007324 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:12.007876 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:12.007891 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:12.010218 (+ 2327us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":150,"threads_started":1}
W20260811 17:09:12.010510 21226 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:12.004206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:59289 (local address 127.4.146.254:34869)
0811 17:09:12.004354 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:12.004358 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:12.004454 (+ 96us) server_negotiation.cc:407] Connection header received
0811 17:09:12.004600 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:12.004603 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:12.004658 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:12.004736 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:12.005242 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:12.005838 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:12.006870 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:12.007099 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:12.007197 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:12.010380 (+ 3183us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.194:59289: BlockingRecv error: recv got EOF from 127.4.146.194:59289 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 11 17:09:12 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:12 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:12.218277 21229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:12.212146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.195:44883)
0811 17:09:12.212458 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:12.212472 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:12.212614 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:12.212900 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:12.212903 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:12.213148 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:12.213247 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:12.213253 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:12.214059 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:12.214063 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:12.214715 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:12.214725 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:12.215202 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:12.215205 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:12.215294 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:12.215952 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:12.215964 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:12.218080 (+ 2116us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":94,"threads_started":1}
W20260811 17:09:12.218353 21226 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:12.212232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:44883 (local address 127.4.146.254:34869)
0811 17:09:12.212406 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:12.212411 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:12.212556 (+ 145us) server_negotiation.cc:407] Connection header received
0811 17:09:12.212729 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:12.212738 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:12.212788 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:12.212877 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:12.213372 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:12.213930 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:12.214837 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:12.215075 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:12.215184 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:12.218237 (+ 3053us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.195:44883: BlockingRecv error: recv got EOF from 127.4.146.195:44883 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 11 17:09:12 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:12 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:12.808663 21232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:12.802157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.193:60585)
0811 17:09:12.802447 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:12.802465 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:12.802582 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:12.802960 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:12.802962 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:12.803200 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:12.803328 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:12.803334 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:12.804244 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:12.804247 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:12.804888 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:12.804898 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:12.805355 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:12.805358 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:12.805490 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:12.806125 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:12.806139 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:12.808460 (+ 2321us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":101,"threads_started":1}
W20260811 17:09:12.808820 21235 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:12.802264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:60585 (local address 127.4.146.254:34869)
0811 17:09:12.802670 (+ 406us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:12.802674 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:12.802689 (+ 15us) server_negotiation.cc:407] Connection header received
0811 17:09:12.802734 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:12.802736 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:12.802781 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:12.802875 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:12.803479 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:12.804050 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:12.804990 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:12.805235 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:12.805322 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:12.808668 (+ 3346us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.193:60585: BlockingRecv error: recv got EOF from 127.4.146.193:60585 (error 108)
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":237,"threads_started":1}
Aug 11 17:09:13 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:13 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:13.017690 21236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:13.011397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.194:39005)
0811 17:09:13.011818 (+ 421us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:13.011832 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:13.011981 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:13.012325 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:13.012328 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:13.012529 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:13.012632 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:13.012638 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:13.013468 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:13.013471 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:13.014092 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:13.014105 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:13.014726 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:13.014730 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:13.014849 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:13.015517 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:13.015529 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:13.017561 (+ 2032us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":154,"threads_started":1}
W20260811 17:09:13.017910 21235 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:13.011568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:39005 (local address 127.4.146.254:34869)
0811 17:09:13.011766 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:13.011771 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:13.011985 (+ 214us) server_negotiation.cc:407] Connection header received
0811 17:09:13.012079 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:13.012098 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:13.012192 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:13.012288 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:13.012770 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:13.013343 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:13.014230 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:13.014560 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:13.014696 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:13.017781 (+ 3085us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.194:39005: BlockingRecv error: recv got EOF from 127.4.146.194:39005 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 11 17:09:13 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:13 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:13.225790 21238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:13.219244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.195:52365)
0811 17:09:13.219713 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:13.219731 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:13.219895 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:13.220239 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:13.220242 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:13.220467 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:13.220573 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:13.220578 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:13.221409 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:13.221415 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:13.221982 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:13.221990 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:13.222578 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:13.222582 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:13.222693 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:13.223386 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:13.223398 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:13.225663 (+ 2265us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":100,"threads_started":1}
W20260811 17:09:13.226136 21235 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:13.219409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:52365 (local address 127.4.146.254:34869)
0811 17:09:13.219701 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:13.219707 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:13.219826 (+ 119us) server_negotiation.cc:407] Connection header received
0811 17:09:13.220023 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:13.220026 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:13.220086 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:13.220208 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:13.220707 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:13.221281 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:13.222116 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:13.222391 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:13.222497 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:13.225891 (+ 3394us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.195:52365: BlockingRecv error: recv got EOF from 127.4.146.195:52365 (error 108)
Metrics: {"server-negotiator.queue_time_us":168}
Aug 11 17:09:13 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:13 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:13.820000 21240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:13.809689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.193:42513)
0811 17:09:13.810124 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:13.810139 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:13.810273 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:13.810532 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:13.810534 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:13.810740 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:13.810840 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:13.810845 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:13.811789 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:13.811792 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:13.812425 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:13.812435 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:13.812912 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:13.812915 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:13.812983 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:13.816698 (+ 3715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:13.816723 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:13.819818 (+ 3095us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":95,"threads_started":1}
W20260811 17:09:13.820168 21241 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:13.809832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:42513 (local address 127.4.146.254:34869)
0811 17:09:13.810140 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:13.810144 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:13.810223 (+ 79us) server_negotiation.cc:407] Connection header received
0811 17:09:13.810348 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:13.810350 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:13.810395 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:13.810479 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:13.810955 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:13.811654 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:13.812548 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:13.812791 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:13.812876 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:13.819979 (+ 7103us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.193:42513: BlockingRecv error: recv got EOF from 127.4.146.193:42513 (error 108)
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":93,"threads_started":1}
Aug 11 17:09:14 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:14 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:14.025058 21242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:14.018688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.194:56531)
0811 17:09:14.019020 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:14.019043 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:14.019178 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:14.019509 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:14.019512 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:14.019767 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:14.019877 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:14.019883 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:14.020756 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:14.020759 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:14.021382 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:14.021391 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:14.021909 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:14.021913 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:14.021991 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:14.022566 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:14.022579 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:14.024919 (+ 2340us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":98,"threads_started":1}
W20260811 17:09:14.025393 21241 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:14.018790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:56531 (local address 127.4.146.254:34869)
0811 17:09:14.018960 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:14.018964 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:14.019145 (+ 181us) server_negotiation.cc:407] Connection header received
0811 17:09:14.019267 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:14.019270 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:14.019318 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:14.019401 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:14.020044 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:14.020637 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:14.021515 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:14.021764 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:14.021852 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:14.025236 (+ 3384us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.194:56531: BlockingRecv error: recv got EOF from 127.4.146.194:56531 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
Aug 11 17:09:14 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:14 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:14.232944 21244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:14.226758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.195:40769)
0811 17:09:14.227220 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:14.227238 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:14.227401 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:14.227704 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:14.227706 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:14.227960 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:14.228062 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:14.228068 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:14.228886 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:14.228891 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:14.229456 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:14.229464 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:14.229950 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:14.229953 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:14.230043 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:14.230647 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:14.230659 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:14.232745 (+ 2086us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":197,"threads_started":1}
W20260811 17:09:14.233028 21241 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:14.226950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:40769 (local address 127.4.146.254:34869)
0811 17:09:14.227203 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:14.227208 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:14.227332 (+ 124us) server_negotiation.cc:407] Connection header received
0811 17:09:14.227521 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:14.227526 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:14.227580 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:14.227676 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:14.228225 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:14.228769 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:14.229584 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:14.229824 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:14.229940 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:14.232903 (+ 2963us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.195:40769: BlockingRecv error: recv got EOF from 127.4.146.195:40769 (error 108)
Metrics: {"server-negotiator.queue_time_us":121}
Aug 11 17:09:14 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:14 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:14.827370 21247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:14.821115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.193:48161)
0811 17:09:14.821423 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:14.821441 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:14.821560 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:14.821917 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:14.821920 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:14.822194 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:14.822331 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:14.822338 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:14.823359 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:14.823362 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:14.823951 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:14.823960 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:14.824560 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:14.824563 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:14.824640 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:14.825250 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:14.825263 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:14.827243 (+ 1980us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":117,"threads_started":1}
W20260811 17:09:14.827680 21248 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:14.821293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:48161 (local address 127.4.146.254:34869)
0811 17:09:14.821566 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:14.821573 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:14.821593 (+ 20us) server_negotiation.cc:407] Connection header received
0811 17:09:14.821712 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:14.821715 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:14.821773 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:14.821855 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:14.822503 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:14.823217 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:14.824148 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:14.824430 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:14.824527 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:14.827518 (+ 2991us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.193:48161: BlockingRecv error: recv got EOF from 127.4.146.193:48161 (error 108)
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":76,"threads_started":1}
Aug 11 17:09:15 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:15 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:15.033686 21249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:15.026340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.194:48219)
0811 17:09:15.026659 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:15.026702 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:15.026832 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:15.027401 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:15.027405 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:15.027637 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:15.027765 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:15.027771 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:15.028979 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:15.028983 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:15.029731 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:15.029748 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:15.030362 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:15.030366 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:15.030447 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:15.031144 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:15.031159 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:15.033542 (+ 2383us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":115,"threads_started":1}
W20260811 17:09:15.033979 21248 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:15.026473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:48219 (local address 127.4.146.254:34869)
0811 17:09:15.026660 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:15.026667 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:15.026805 (+ 138us) server_negotiation.cc:407] Connection header received
0811 17:09:15.027030 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:15.027033 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:15.027183 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:15.027293 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:15.027897 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:15.028803 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:15.029901 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:15.030202 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:15.030303 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:15.033843 (+ 3540us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.194:48219: BlockingRecv error: recv got EOF from 127.4.146.194:48219 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 11 17:09:15 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:15 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:15.240317 21251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:15.234081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.195:38287)
0811 17:09:15.234392 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:15.234406 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:15.234514 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:15.234811 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:15.234813 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:15.235011 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:15.235116 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:15.235140 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:15.236213 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:15.236218 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:15.236848 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:15.236858 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:15.237372 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:15.237375 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:15.237469 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:15.238087 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:15.238100 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:15.240143 (+ 2043us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":100,"threads_started":1}
W20260811 17:09:15.240439 21248 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:15.234269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:38287 (local address 127.4.146.254:34869)
0811 17:09:15.234468 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:15.234472 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:15.234489 (+ 17us) server_negotiation.cc:407] Connection header received
0811 17:09:15.234615 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:15.234617 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:15.234680 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:15.234756 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:15.235277 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:15.236017 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:15.236986 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:15.237240 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:15.237366 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:15.240314 (+ 2948us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.195:38287: BlockingRecv error: recv got EOF from 127.4.146.195:38287 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
Aug 11 17:09:15 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:15 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:15.834448 21255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:15.828361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.193:48867)
0811 17:09:15.828672 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:15.828688 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:15.828783 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:15.829049 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:15.829053 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:15.829257 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:15.829358 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:15.829364 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:15.830173 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:15.830177 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:15.830772 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:15.830782 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:15.831336 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:15.831339 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:15.831406 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:15.832034 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:15.832049 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:15.834317 (+ 2268us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":117,"threads_started":1}
W20260811 17:09:15.834653 21257 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:15.828468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:48867 (local address 127.4.146.254:34869)
0811 17:09:15.828719 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:15.828723 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:15.828739 (+ 16us) server_negotiation.cc:407] Connection header received
0811 17:09:15.828873 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:15.828876 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:15.828921 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:15.829008 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:15.829471 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:15.830057 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:15.830896 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:15.831213 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:15.831316 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:15.834473 (+ 3157us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.193:48867: BlockingRecv error: recv got EOF from 127.4.146.193:48867 (error 108)
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":87,"threads_started":1}
Aug 11 17:09:16 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:16 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:16.041442 21258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:16.034777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.194:37029)
0811 17:09:16.035120 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:16.035142 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:16.035259 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:16.035541 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:16.035544 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:16.035759 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:16.035870 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:16.035876 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:16.036680 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:16.036684 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:16.037454 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:16.037467 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:16.038036 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:16.038039 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:16.038107 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:16.038774 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:16.038794 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:16.041313 (+ 2519us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":112,"threads_started":1}
W20260811 17:09:16.041661 21257 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:16.034896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:37029 (local address 127.4.146.254:34869)
0811 17:09:16.035095 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:16.035099 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:16.035225 (+ 126us) server_negotiation.cc:407] Connection header received
0811 17:09:16.035353 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:16.035356 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:16.035409 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:16.035497 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:16.035990 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:16.036539 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:16.037574 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:16.037897 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:16.038018 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:16.041517 (+ 3499us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.194:37029: BlockingRecv error: recv got EOF from 127.4.146.194:37029 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 11 17:09:16 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:16 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:16.248143 21263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:16.241341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.195:37901)
0811 17:09:16.241648 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:16.241663 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:16.241769 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:16.242106 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:16.242109 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:16.242312 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:16.242416 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:16.242421 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:16.243245 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:16.243248 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:16.243874 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:16.243885 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:16.244518 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:16.244522 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:16.244608 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:16.245165 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:16.245177 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:16.247912 (+ 2735us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":118,"threads_started":1}
W20260811 17:09:16.248229 21257 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:16.241531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:37901 (local address 127.4.146.254:34869)
0811 17:09:16.241675 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:16.241679 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:16.241721 (+ 42us) server_negotiation.cc:407] Connection header received
0811 17:09:16.241898 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:16.241901 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:16.241957 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:16.242039 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:16.242534 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:16.243081 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:16.244033 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:16.244384 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:16.244484 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:16.248055 (+ 3571us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.195:37901: BlockingRecv error: recv got EOF from 127.4.146.195:37901 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Aug 11 17:09:16 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:16 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:16.841542 21264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:16.835425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.193:60965)
0811 17:09:16.835730 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:16.835746 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:16.835867 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:16.836234 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:16.836238 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:16.836466 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:16.836565 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:16.836571 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:16.837329 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:16.837332 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:16.837899 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:16.837907 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:16.838440 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:16.838444 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:16.838522 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:16.839041 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:16.839054 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:16.841418 (+ 2364us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":115,"threads_started":1}
W20260811 17:09:16.841768 21265 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:16.835512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:60965 (local address 127.4.146.254:34869)
0811 17:09:16.835824 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:16.835828 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:16.835852 (+ 24us) server_negotiation.cc:407] Connection header received
0811 17:09:16.836002 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:16.836005 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:16.836059 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:16.836210 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:16.836674 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:16.837236 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:16.838022 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:16.838287 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:16.838395 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:16.841603 (+ 3208us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.193:60965: BlockingRecv error: recv got EOF from 127.4.146.193:60965 (error 108)
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":83,"threads_started":1}
Aug 11 17:09:17 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:17 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:17.048566 21269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:17.042355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.194:51327)
0811 17:09:17.042734 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:17.042751 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:17.042904 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:17.043218 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:17.043221 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:17.043452 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:17.043559 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:17.043566 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:17.044418 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:17.044424 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:17.045009 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:17.045019 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:17.045557 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:17.045560 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:17.045664 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:17.046322 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:17.046335 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:17.048435 (+ 2100us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":93,"threads_started":1}
W20260811 17:09:17.048841 21265 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:17.042514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:51327 (local address 127.4.146.254:34869)
0811 17:09:17.042726 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:17.042731 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:17.042844 (+ 113us) server_negotiation.cc:407] Connection header received
0811 17:09:17.043010 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:17.043014 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:17.043070 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:17.043187 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:17.043688 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:17.044299 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:17.045144 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:17.045391 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:17.045521 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:17.048714 (+ 3193us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.194:51327: BlockingRecv error: recv got EOF from 127.4.146.194:51327 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 11 17:09:17 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:17 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:17.255097 21270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:17.249131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.195:35585)
0811 17:09:17.249467 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:17.249482 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:17.249589 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:17.249879 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:17.249881 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:17.250162 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:17.250271 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:17.250277 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:17.251132 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:17.251135 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:17.251709 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:17.251718 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:17.252266 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:17.252269 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:17.252338 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:17.252955 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:17.252967 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:17.254973 (+ 2006us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":107,"threads_started":1}
W20260811 17:09:17.255273 21265 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:17.249349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:35585 (local address 127.4.146.254:34869)
0811 17:09:17.249492 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:17.249496 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:17.249553 (+ 57us) server_negotiation.cc:407] Connection header received
0811 17:09:17.249723 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:17.249725 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:17.249773 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:17.249833 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:17.250385 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:17.251009 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:17.251829 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:17.252147 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:17.252253 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:17.255145 (+ 2892us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.195:35585: BlockingRecv error: recv got EOF from 127.4.146.195:35585 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 11 17:09:17 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:17 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:17.848992 21271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:17.842462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.193:50493)
0811 17:09:17.842820 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:17.842836 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:17.842947 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:17.843295 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:17.843297 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:17.843492 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:17.843596 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:17.843600 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:17.844494 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:17.844497 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:17.845066 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:17.845074 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:17.845606 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:17.845609 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:17.845684 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:17.846262 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:17.846274 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:17.848814 (+ 2540us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":95,"threads_started":1}
W20260811 17:09:17.849097 21273 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:17.842632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:50493 (local address 127.4.146.254:34869)
0811 17:09:17.842901 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:17.842905 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:17.842921 (+ 16us) server_negotiation.cc:407] Connection header received
0811 17:09:17.843099 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:17.843102 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:17.843157 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:17.843250 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:17.843757 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:17.844381 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:17.845221 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:17.845480 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:17.845585 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:17.848956 (+ 3371us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.193:50493: BlockingRecv error: recv got EOF from 127.4.146.193:50493 (error 108)
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":87,"threads_started":1}
Aug 11 17:09:18 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:18 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:18.055837 21274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:18.049651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.194:54041)
0811 17:09:18.049953 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:18.049968 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:18.050077 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:18.050415 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:18.050418 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:18.050628 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:18.050771 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:18.050777 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:18.051732 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:18.051736 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:18.052485 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:18.052500 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:18.052992 (+ 492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:18.052995 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:18.053071 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:18.053633 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:18.053646 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:18.055642 (+ 1996us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":96,"threads_started":1}
W20260811 17:09:18.056052 21273 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:18.049641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:54041 (local address 127.4.146.254:34869)
0811 17:09:18.049793 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:18.049797 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:18.050076 (+ 279us) server_negotiation.cc:407] Connection header received
0811 17:09:18.050176 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:18.050178 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:18.050226 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:18.050307 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:18.050904 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:18.051570 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:18.052614 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:18.052852 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:18.052943 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:18.055854 (+ 2911us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.194:54041: BlockingRecv error: recv got EOF from 127.4.146.194:54041 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 11 17:09:18 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:18 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:18.262641 21277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:18.256253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.195:44193)
0811 17:09:18.256577 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:18.256591 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:18.256733 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:18.257044 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:18.257047 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:18.257233 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:18.257340 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:18.257345 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:18.258236 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:18.258239 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:18.258891 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:18.258901 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:18.259493 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:18.259497 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:18.259574 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:18.260183 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:18.260196 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:18.262489 (+ 2293us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":92,"threads_started":1}
W20260811 17:09:18.262853 21273 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:18.256266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:44193 (local address 127.4.146.254:34869)
0811 17:09:18.256433 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:18.256439 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:18.256679 (+ 240us) server_negotiation.cc:407] Connection header received
0811 17:09:18.256849 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:18.256852 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:18.256910 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:18.257013 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:18.257536 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:18.258098 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:18.259094 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:18.259336 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:18.259432 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:18.262703 (+ 3271us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.195:44193: BlockingRecv error: recv got EOF from 127.4.146.195:44193 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 11 17:09:18 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:18 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:18.860469 21283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:18.849974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.193:53461)
0811 17:09:18.850346 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:18.850372 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:18.850479 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:18.850862 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:18.850866 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:18.851191 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:18.851310 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:18.851317 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:18.852367 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:18.852370 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:18.852960 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:18.852969 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:18.853516 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:18.853519 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:18.853622 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:18.857649 (+ 4027us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:18.857674 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:18.860339 (+ 2665us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":135,"threads_started":1}
W20260811 17:09:18.860671 21284 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:18.850181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:53461 (local address 127.4.146.254:34869)
0811 17:09:18.850471 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:18.850475 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:18.850511 (+ 36us) server_negotiation.cc:407] Connection header received
0811 17:09:18.850629 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:18.850631 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:18.850678 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:18.850776 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:18.851472 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:18.852223 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:18.853114 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:18.853374 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:18.853472 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:18.860519 (+ 7047us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.193:53461: BlockingRecv error: recv got EOF from 127.4.146.193:53461 (error 108)
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":94,"threads_started":1}
Aug 11 17:09:19 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:19 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:19.062351 21287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:19.056724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.194:60573)
0811 17:09:19.057118 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:19.057136 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:19.057310 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:19.057638 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:19.057641 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:19.057831 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:19.057932 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:19.057937 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:19.058676 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:19.058678 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:19.059251 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:19.059260 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:19.059674 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:19.059686 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:19.059747 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:19.060279 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:19.060291 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:19.062233 (+ 1942us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":118,"threads_started":1}
W20260811 17:09:19.062590 21284 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:19.056903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:60573 (local address 127.4.146.254:34869)
0811 17:09:19.057120 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:19.057126 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:19.057228 (+ 102us) server_negotiation.cc:407] Connection header received
0811 17:09:19.057449 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:19.057451 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:19.057501 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:19.057571 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:19.058038 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:19.058567 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:19.059358 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:19.059575 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:19.059654 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:19.062379 (+ 2725us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.194:60573: BlockingRecv error: recv got EOF from 127.4.146.194:60573 (error 108)
Metrics: {"server-negotiator.queue_time_us":110}
Aug 11 17:09:19 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:19 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:19.269333 21288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:19.263537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.195:33051)
0811 17:09:19.263806 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:19.263820 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:19.263923 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:19.264203 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:19.264205 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:19.264399 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:19.264521 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:19.264527 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:19.265697 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:19.265700 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:19.266267 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:19.266275 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:19.266734 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:19.266737 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:19.266799 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:19.267327 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:19.267339 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:19.269211 (+ 1872us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":90,"threads_started":1}
W20260811 17:09:19.269681 21284 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:19.263606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:33051 (local address 127.4.146.254:34869)
0811 17:09:19.263776 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:19.263780 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:19.263897 (+ 117us) server_negotiation.cc:407] Connection header received
0811 17:09:19.263999 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:19.264001 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:19.264062 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:19.264173 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:19.264685 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:19.265569 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:19.266396 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:19.266627 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:19.266716 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:19.269513 (+ 2797us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.195:33051: BlockingRecv error: recv got EOF from 127.4.146.195:33051 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 11 17:09:19 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:19 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:19.867297 21289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:19.861460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.193:54263)
0811 17:09:19.861841 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:19.861858 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:19.861979 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:19.862290 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:19.862294 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:19.862552 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:19.862694 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:19.862701 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:19.863478 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:19.863481 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:19.864117 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:19.864126 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:19.864595 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:19.864598 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:19.864682 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:19.865276 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:19.865288 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:19.867179 (+ 1891us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":86,"threads_started":1}
W20260811 17:09:19.867496 21292 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:19.861583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:54263 (local address 127.4.146.254:34869)
0811 17:09:19.861842 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:19.861848 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:19.861916 (+ 68us) server_negotiation.cc:407] Connection header received
0811 17:09:19.862092 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:19.862095 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:19.862149 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:19.862230 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:19.862817 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:19.863371 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:19.864220 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:19.864463 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:19.864540 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:19.867349 (+ 2809us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.193:54263: BlockingRecv error: recv got EOF from 127.4.146.193:54263 (error 108)
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":101,"threads_started":1}
Aug 11 17:09:20 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:20 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:20.069845 21296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:20.063403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.194:42723)
0811 17:09:20.063726 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:20.063751 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:20.063858 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:20.064294 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:20.064298 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:20.064513 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:20.064623 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:20.064636 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:20.065443 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:20.065446 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:20.066061 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:20.066070 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:20.066581 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:20.066584 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:20.066653 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:20.067426 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:20.067440 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:20.069715 (+ 2275us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":143,"threads_started":1}
W20260811 17:09:20.070036 21292 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:20.063566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:42723 (local address 127.4.146.254:34869)
0811 17:09:20.063766 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:20.063771 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:20.063810 (+ 39us) server_negotiation.cc:407] Connection header received
0811 17:09:20.064004 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:20.064007 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:20.064063 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:20.064225 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:20.064775 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:20.065328 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:20.066224 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:20.066469 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:20.066573 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:20.069882 (+ 3309us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.194:42723: BlockingRecv error: recv got EOF from 127.4.146.194:42723 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 11 17:09:20 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:20 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:20.276356 21301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:20.270332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.195:54569)
0811 17:09:20.270620 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:20.270634 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:20.270766 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:20.271143 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:20.271146 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:20.271338 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:20.271438 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:20.271444 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:20.272286 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:20.272289 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:20.272896 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:20.272905 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:20.273409 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:20.273413 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:20.273502 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:20.274072 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:20.274086 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:20.276222 (+ 2136us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":100,"threads_started":1}
W20260811 17:09:20.276573 21292 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:20.270390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:54569 (local address 127.4.146.254:34869)
0811 17:09:20.270558 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:20.270564 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:20.270736 (+ 172us) server_negotiation.cc:407] Connection header received
0811 17:09:20.270916 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:20.270919 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:20.271015 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:20.271097 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:20.271575 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:20.272173 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:20.273036 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:20.273284 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:20.273403 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:20.276407 (+ 3004us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.195:54569: BlockingRecv error: recv got EOF from 127.4.146.195:54569 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 11 17:09:20 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:20 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:20.874804 21302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:20.868480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.193:39287)
0811 17:09:20.869143 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:20.869160 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:20.869290 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:20.869634 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:20.869637 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:20.869872 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:20.869972 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:20.869978 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:20.870872 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:20.870877 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:20.871470 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:20.871478 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:20.871987 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:20.871991 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:20.872080 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:20.872647 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:20.872659 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:20.874681 (+ 2022us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":144,"threads_started":1}
W20260811 17:09:20.875032 21304 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:20.868598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:39287 (local address 127.4.146.254:34869)
0811 17:09:20.868969 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:20.868974 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:20.869259 (+ 285us) server_negotiation.cc:407] Connection header received
0811 17:09:20.869414 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:20.869417 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:20.869480 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:20.869608 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:20.870119 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:20.870752 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:20.871615 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:20.871858 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:20.871967 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:20.874836 (+ 2869us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.193:39287: BlockingRecv error: recv got EOF from 127.4.146.193:39287 (error 108)
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":98,"threads_started":1}
Aug 11 17:09:21 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:21 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:21.077164 21305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:21.070853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.194:37829)
0811 17:09:21.071206 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:21.071220 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:21.071332 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:21.071667 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:21.071670 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:21.071888 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:21.072038 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:21.072045 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:21.073007 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:21.073010 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:21.073599 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:21.073609 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:21.074158 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:21.074162 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:21.074230 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:21.074870 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:21.074884 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:21.076997 (+ 2113us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":113,"threads_started":1}
W20260811 17:09:21.077360 21304 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:21.070963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:37829 (local address 127.4.146.254:34869)
0811 17:09:21.071199 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:21.071204 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:21.071302 (+ 98us) server_negotiation.cc:407] Connection header received
0811 17:09:21.071424 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:21.071426 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:21.071479 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:21.071575 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:21.072218 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:21.072848 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:21.073741 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:21.073992 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:21.074105 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:21.077181 (+ 3076us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.194:37829: BlockingRecv error: recv got EOF from 127.4.146.194:37829 (error 108)
Metrics: {"server-negotiator.queue_time_us":128}
Aug 11 17:09:21 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:21 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.195@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:21.283630 21306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:21.277271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.195:38149)
0811 17:09:21.277675 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:21.277692 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:21.277851 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:21.278184 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:21.278187 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:21.278421 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:21.278522 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:21.278527 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:21.279343 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:21.279348 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:21.279967 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:21.279976 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:21.280512 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:21.280516 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:21.280614 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:21.281226 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:21.281241 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:21.283460 (+ 2219us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":96,"threads_started":1}
W20260811 17:09:21.283816 21304 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:21.277422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:38149 (local address 127.4.146.254:34869)
0811 17:09:21.277606 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:21.277611 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:21.277784 (+ 173us) server_negotiation.cc:407] Connection header received
0811 17:09:21.277965 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:21.277968 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:21.278027 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:21.278160 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:21.278670 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:21.279223 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:21.280132 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:21.280382 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:21.280504 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:21.283689 (+ 3185us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.195:38149: BlockingRecv error: recv got EOF from 127.4.146.195:38149 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 11 17:09:21 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:21 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.193@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:21.882028 21307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:21.875881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.193:48793)
0811 17:09:21.876353 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:21.876372 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:21.876507 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:21.876832 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:21.876836 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:21.877139 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:21.877248 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:21.877254 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:21.878187 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:21.878190 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:21.878817 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:21.878827 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:21.879318 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:21.879321 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:21.879384 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:21.879880 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:21.879892 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:21.881839 (+ 1947us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":91,"threads_started":1}
W20260811 17:09:21.882099 21309 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:21.876030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:48793 (local address 127.4.146.254:34869)
0811 17:09:21.876318 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:21.876322 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:21.876472 (+ 150us) server_negotiation.cc:407] Connection header received
0811 17:09:21.876619 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:21.876622 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:21.876681 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:21.876770 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:21.877371 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:21.878086 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:21.878937 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:21.879215 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:21.879298 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:21.881969 (+ 2671us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.193:48793: BlockingRecv error: recv got EOF from 127.4.146.193:48793 (error 108)
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":95,"threads_started":1}
Aug 11 17:09:22 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 17:09:22 dist-test-slave-7vjv krb5kdc[19473](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.4.146.194@KRBTEST.COM for oryx/127.4.146.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 17:09:22.085196 21311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:22.078236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34869 (local address 127.4.146.194:60929)
0811 17:09:22.078596 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:22.078612 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:22.078729 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:22.079040 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:22.079043 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:22.079267 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:22.079433 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:22.079441 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:22.080781 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:22.080784 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:22.081392 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:22.081404 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:22.081897 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:22.081900 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:22.081970 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:22.082612 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:22.082626 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:22.085024 (+ 2398us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.4.146.254:34869: Server oryx/127.4.146.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":93,"threads_started":1}
W20260811 17:09:22.085410 21309 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:22.078383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:60929 (local address 127.4.146.254:34869)
0811 17:09:22.078551 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:22.078558 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:22.078726 (+ 168us) server_negotiation.cc:407] Connection header received
0811 17:09:22.078827 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:22.078830 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:22.078883 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:22.078954 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:22.079605 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:22.080628 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:22.081534 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:22.081777 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:22.081878 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:22.085238 (+ 3360us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.4.146.194:60929: BlockingRecv error: recv got EOF from 127.4.146.194:60929 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 17:09:22.159096 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 20495
I20260811 17:09:22.179245 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 20741
I20260811 17:09:22.211993 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 20953
I20260811 17:09:22.231073 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 20371
2026-08-11T17:09:22Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18716 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T17:09:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:09:22Z Disabled control of system clock
I20260811 17:09:22.271061 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:43575
--webserver_interface=127.4.146.254
--webserver_port=0
--builtin_ntp_servers=127.4.146.212:35371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:43575
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 17:09:22.400354 21316 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:09:22.400701 21316 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:09:22.400741 21316 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:09:22.405601 21316 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:09:22.405717 21316 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:09:22.405735 21316 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:09:22.405753 21316 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:09:22.405771 21316 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:09:22.411406 21316 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:35371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:43575
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:43575
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21316
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:09:22.412828 21316 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:09:22.414469 21316 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:09:22.424012 21323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:22.424054 21324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:22.424014 21329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:22.424149 21316 server_base.cc:1034] running on GCE node
I20260811 17:09:22.425104 21316 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:09:22.426564 21316 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:09:22.427826 21316 hybrid_clock.cc:648] HybridClock initialized: now 1786468162427753 us; error 94 us; skew 500 ppm
I20260811 17:09:22.430239 21316 webserver.cc:460] Webserver started at http://127.4.146.254:33859/ using document root <none> and password file <none>
I20260811 17:09:22.430907 21316 fs_manager.cc:359] Metadata directory not provided
I20260811 17:09:22.431015 21316 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:09:22.431272 21316 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:09:22.433602 21316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "fd5e3f98ec1f42b3b8894dba59c6fa0e"
format_stamp: "Formatted at 2026-08-11 17:09:22 on dist-test-slave-7vjv"
server_key: "de320f5e604d212e7ce04b0ba529637d"
server_key_iv: "d8c2125fe7f07d7245d440573480ec68"
server_key_version: "encryptionkey@0"
I20260811 17:09:22.434226 21316 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "fd5e3f98ec1f42b3b8894dba59c6fa0e"
format_stamp: "Formatted at 2026-08-11 17:09:22 on dist-test-slave-7vjv"
server_key: "de320f5e604d212e7ce04b0ba529637d"
server_key_iv: "d8c2125fe7f07d7245d440573480ec68"
server_key_version: "encryptionkey@0"
I20260811 17:09:22.438299 21316 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 17:09:22.441023 21338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:22.442360 21316 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:09:22.442523 21316 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "fd5e3f98ec1f42b3b8894dba59c6fa0e"
format_stamp: "Formatted at 2026-08-11 17:09:22 on dist-test-slave-7vjv"
server_key: "de320f5e604d212e7ce04b0ba529637d"
server_key_iv: "d8c2125fe7f07d7245d440573480ec68"
server_key_version: "encryptionkey@0"
I20260811 17:09:22.442662 21316 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:09:22.464560 21316 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:09:22.465396 21316 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:09:22.465634 21316 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:09:22.474179 21316 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:43575
I20260811 17:09:22.474210 21420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:43575 every 8 connection(s)
I20260811 17:09:22.475309 21316 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:09:22.478543 21421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:09:22.478796 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 21316
I20260811 17:09:22.478925 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:09:22.479280 4683 external_mini_cluster.cc:1428] Setting key f41825744a670b0456ca61218f034957
I20260811 17:09:22.486174 21421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd5e3f98ec1f42b3b8894dba59c6fa0e: Bootstrap starting.
I20260811 17:09:22.489236 21421 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd5e3f98ec1f42b3b8894dba59c6fa0e: Neither blocks nor log segments found. Creating new log.
I20260811 17:09:22.489255 21431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:22.480828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58644 (local address 127.4.146.254:43575)
0811 17:09:22.481501 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:22.481518 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:22.481556 (+ 38us) server_negotiation.cc:407] Connection header received
0811 17:09:22.482289 (+ 733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:22.482308 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:22.482722 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:22.483010 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:22.483447 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:22.484532 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:22.485753 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:22.486230 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:22.486426 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:22.487302 (+ 876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:09:22.487307 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:09:22.487319 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:09:22.487712 (+ 393us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:09:22.487767 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:09:22.487786 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:09:22.487866 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:22.488177 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 17:09:22.488475 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":151,"threads_started":1}
I20260811 17:09:22.490322 21421 log.cc:824] T 00000000000000000000000000000000 P fd5e3f98ec1f42b3b8894dba59c6fa0e: Log is configured to *not* fsync() on all Append() calls
I20260811 17:09:22.492650 21421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd5e3f98ec1f42b3b8894dba59c6fa0e: No bootstrap required, opened a new log
I20260811 17:09:22.496556 21421 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd5e3f98ec1f42b3b8894dba59c6fa0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd5e3f98ec1f42b3b8894dba59c6fa0e" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 43575 } }
I20260811 17:09:22.496843 21421 raft_consensus.cc:374] T 00000000000000000000000000000000 P fd5e3f98ec1f42b3b8894dba59c6fa0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:09:22.496881 21421 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd5e3f98ec1f42b3b8894dba59c6fa0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd5e3f98ec1f42b3b8894dba59c6fa0e, State: Initialized, Role: FOLLOWER
I20260811 17:09:22.497318 21421 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd5e3f98ec1f42b3b8894dba59c6fa0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd5e3f98ec1f42b3b8894dba59c6fa0e" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 43575 } }
I20260811 17:09:22.497440 21421 raft_consensus.cc:388] T 00000000000000000000000000000000 P fd5e3f98ec1f42b3b8894dba59c6fa0e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:09:22.497483 21421 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd5e3f98ec1f42b3b8894dba59c6fa0e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:09:22.497561 21421 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd5e3f98ec1f42b3b8894dba59c6fa0e [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:09:22.498565 21421 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd5e3f98ec1f42b3b8894dba59c6fa0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd5e3f98ec1f42b3b8894dba59c6fa0e" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 43575 } }
I20260811 17:09:22.498908 21421 leader_election.cc:302] T 00000000000000000000000000000000 P fd5e3f98ec1f42b3b8894dba59c6fa0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd5e3f98ec1f42b3b8894dba59c6fa0e; no voters:
I20260811 17:09:22.499212 21421 leader_election.cc:288] T 00000000000000000000000000000000 P fd5e3f98ec1f42b3b8894dba59c6fa0e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:09:22.499444 21435 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd5e3f98ec1f42b3b8894dba59c6fa0e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:09:22.499743 21435 raft_consensus.cc:686] T 00000000000000000000000000000000 P fd5e3f98ec1f42b3b8894dba59c6fa0e [term 1 LEADER]: Becoming Leader. State: Replica: fd5e3f98ec1f42b3b8894dba59c6fa0e, State: Running, Role: LEADER
I20260811 17:09:22.500133 21435 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd5e3f98ec1f42b3b8894dba59c6fa0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd5e3f98ec1f42b3b8894dba59c6fa0e" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 43575 } }
I20260811 17:09:22.500710 21421 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd5e3f98ec1f42b3b8894dba59c6fa0e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:09:22.501945 21436 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd5e3f98ec1f42b3b8894dba59c6fa0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd5e3f98ec1f42b3b8894dba59c6fa0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd5e3f98ec1f42b3b8894dba59c6fa0e" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 43575 } } }
I20260811 17:09:22.502097 21436 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd5e3f98ec1f42b3b8894dba59c6fa0e [sys.catalog]: This master's current role is: LEADER
I20260811 17:09:22.502517 21448 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:09:22.503068 21438 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd5e3f98ec1f42b3b8894dba59c6fa0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd5e3f98ec1f42b3b8894dba59c6fa0e. Latest consensus state: current_term: 1 leader_uuid: "fd5e3f98ec1f42b3b8894dba59c6fa0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd5e3f98ec1f42b3b8894dba59c6fa0e" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 43575 } } }
I20260811 17:09:22.503178 21438 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd5e3f98ec1f42b3b8894dba59c6fa0e [sys.catalog]: This master's current role is: LEADER
I20260811 17:09:22.506049 21448 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:09:22.512596 21448 catalog_manager.cc:1347] Generated new cluster ID: 090107a49db6443980f53895c17e7e57
I20260811 17:09:22.512719 21448 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:09:22.529183 21448 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:09:22.530648 21448 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:09:22.537523 21448 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fd5e3f98ec1f42b3b8894dba59c6fa0e: Generated new TSK 0
I20260811 17:09:22.538486 21448 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:09:22.549997 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:43575
--builtin_ntp_servers=127.4.146.212:35371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 17:09:22.681217 21465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:09:22.681543 21465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:09:22.681591 21465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:09:22.685940 21465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:09:22.686023 21465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:09:22.686084 21465 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:09:22.691246 21465 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:35371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:43575
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:09:22.692545 21465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:09:22.694026 21465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:09:22.704506 21479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:22.704557 21472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:22.704506 21477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:22.704893 21465 server_base.cc:1034] running on GCE node
I20260811 17:09:22.705384 21465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:09:22.706131 21465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:09:22.707337 21465 hybrid_clock.cc:648] HybridClock initialized: now 1786468162707325 us; error 33 us; skew 500 ppm
I20260811 17:09:22.709338 21465 webserver.cc:460] Webserver started at http://127.4.146.193:44573/ using document root <none> and password file <none>
I20260811 17:09:22.709952 21465 fs_manager.cc:359] Metadata directory not provided
I20260811 17:09:22.710073 21465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:09:22.710325 21465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:09:22.712664 21465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "c34aa40db62d471bafbdd527eb098173"
format_stamp: "Formatted at 2026-08-11 17:09:22 on dist-test-slave-7vjv"
server_key: "b22d4c2c78b7d17e6e0b370e00125751"
server_key_iv: "bb99998307749372574089521d85e6f7"
server_key_version: "encryptionkey@0"
I20260811 17:09:22.713305 21465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "c34aa40db62d471bafbdd527eb098173"
format_stamp: "Formatted at 2026-08-11 17:09:22 on dist-test-slave-7vjv"
server_key: "b22d4c2c78b7d17e6e0b370e00125751"
server_key_iv: "bb99998307749372574089521d85e6f7"
server_key_version: "encryptionkey@0"
I20260811 17:09:22.717697 21465 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 17:09:22.720664 21490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:22.722164 21465 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 17:09:22.722347 21465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "c34aa40db62d471bafbdd527eb098173"
format_stamp: "Formatted at 2026-08-11 17:09:22 on dist-test-slave-7vjv"
server_key: "b22d4c2c78b7d17e6e0b370e00125751"
server_key_iv: "bb99998307749372574089521d85e6f7"
server_key_version: "encryptionkey@0"
I20260811 17:09:22.722493 21465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:09:22.744803 21465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:09:22.745776 21465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:09:22.746027 21465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:09:22.746848 21465 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:09:22.748000 21465 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:09:22.748076 21465 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:22.748205 21465 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:09:22.748258 21465 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:22.758253 21465 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:35947
I20260811 17:09:22.758281 21700 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:35947 every 8 connection(s)
I20260811 17:09:22.759318 21465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:09:22.759989 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 21465
I20260811 17:09:22.760149 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
I20260811 17:09:22.760617 4683 external_mini_cluster.cc:1428] Setting key 98076606529dfb5444211d242a387d7b
I20260811 17:09:22.763108 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:43575
--builtin_ntp_servers=127.4.146.212:35371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 17:09:22.771034 21431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:22.761791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:57867 (local address 127.4.146.254:43575)
0811 17:09:22.761942 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:22.761947 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:22.763281 (+ 1334us) server_negotiation.cc:407] Connection header received
0811 17:09:22.765150 (+ 1869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:22.765156 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:22.765227 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:22.765336 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:22.766347 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:22.767227 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:22.768564 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:22.769000 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:22.769157 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:22.770391 (+ 1234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:09:22.770397 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:09:22.770402 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:09:22.770423 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:09:22.770449 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:09:22.770464 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:09:22.770548 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:22.770716 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 17:09:22.770807 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 17:09:22.771875 21707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:22.762306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:43575 (local address 127.4.146.193:57867)
0811 17:09:22.763078 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:22.763125 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:22.764835 (+ 1710us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:22.765550 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:22.765557 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:22.765650 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:22.766184 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:22.766198 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:22.767388 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:22.767391 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:22.768425 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:22.768436 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:22.769207 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:22.769211 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:22.769370 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:22.770070 (+ 700us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 17:09:22.770072 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:22.770116 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 17:09:22.770213 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:09:22.770568 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:09:22.770576 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:09:22.770580 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 17:09:22.770679 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 17:09:22.770932 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":148,"threads_started":1}
I20260811 17:09:22.773303 21703 heartbeater.cc:347] Connected to a master server at 127.4.146.254:43575
I20260811 17:09:22.773578 21703 heartbeater.cc:464] Registering TS with master...
I20260811 17:09:22.774170 21703 heartbeater.cc:511] Master 127.4.146.254:43575 requested a full tablet report, sending...
I20260811 17:09:22.775789 21366 ts_manager.cc:194] Registered new tserver with Master: c34aa40db62d471bafbdd527eb098173 (127.4.146.193:35947)
I20260811 17:09:22.777021 21366 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.146.193:57867
W20260811 17:09:22.885128 21711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:09:22.885432 21711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:09:22.885471 21711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:09:22.889683 21711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:09:22.889760 21711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:09:22.889818 21711 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:09:22.894893 21711 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:35371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:43575
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21711
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:09:22.896168 21711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:09:22.897634 21711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:09:22.908468 21723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:22.908491 21724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:22.908499 21727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:22.908661 21711 server_base.cc:1034] running on GCE node
I20260811 17:09:22.909341 21711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:09:22.910084 21711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:09:22.911284 21711 hybrid_clock.cc:648] HybridClock initialized: now 1786468162911246 us; error 55 us; skew 500 ppm
I20260811 17:09:22.913409 21711 webserver.cc:460] Webserver started at http://127.4.146.194:34587/ using document root <none> and password file <none>
I20260811 17:09:22.914311 21711 fs_manager.cc:359] Metadata directory not provided
I20260811 17:09:22.914409 21711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:09:22.914681 21711 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:09:22.917104 21711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "31b47f08033246a18b01e3c886ef8158"
format_stamp: "Formatted at 2026-08-11 17:09:22 on dist-test-slave-7vjv"
server_key: "aabade238bb62fb148897aa29822efcf"
server_key_iv: "ce3ecd41ff0b7ec930c3020dd0e1e841"
server_key_version: "encryptionkey@0"
I20260811 17:09:22.917725 21711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "31b47f08033246a18b01e3c886ef8158"
format_stamp: "Formatted at 2026-08-11 17:09:22 on dist-test-slave-7vjv"
server_key: "aabade238bb62fb148897aa29822efcf"
server_key_iv: "ce3ecd41ff0b7ec930c3020dd0e1e841"
server_key_version: "encryptionkey@0"
I20260811 17:09:22.921896 21711 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260811 17:09:22.924710 21733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:22.926097 21711 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:09:22.926247 21711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "31b47f08033246a18b01e3c886ef8158"
format_stamp: "Formatted at 2026-08-11 17:09:22 on dist-test-slave-7vjv"
server_key: "aabade238bb62fb148897aa29822efcf"
server_key_iv: "ce3ecd41ff0b7ec930c3020dd0e1e841"
server_key_version: "encryptionkey@0"
I20260811 17:09:22.926381 21711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:09:22.945808 21711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:09:22.946625 21711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:09:22.946877 21711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:09:22.947597 21711 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:09:22.948699 21711 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:09:22.948781 21711 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:22.948855 21711 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:09:22.948904 21711 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:22.958526 21711 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:35949
I20260811 17:09:22.958554 21941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:35949 every 8 connection(s)
I20260811 17:09:22.959509 21711 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:09:22.962057 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 21711
I20260811 17:09:22.962162 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:09:22.962544 4683 external_mini_cluster.cc:1428] Setting key 8090f409a19c059b62a35088b208c5e5
I20260811 17:09:22.964977 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:43575
--builtin_ntp_servers=127.4.146.212:35371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 17:09:22.970621 21431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:22.961527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:53631 (local address 127.4.146.254:43575)
0811 17:09:22.961690 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:22.961695 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:22.963108 (+ 1413us) server_negotiation.cc:407] Connection header received
0811 17:09:22.965085 (+ 1977us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:22.965089 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:22.965173 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:22.965281 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:22.966594 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:22.967184 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:22.968500 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:22.968732 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:22.968849 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:22.970081 (+ 1232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:09:22.970090 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:09:22.970092 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:09:22.970107 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:09:22.970127 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:09:22.970135 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:09:22.970214 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:22.970393 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 17:09:22.970467 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 17:09:22.971599 21946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:22.962037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:43575 (local address 127.4.146.194:53631)
0811 17:09:22.962936 (+ 899us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:22.962994 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:22.964741 (+ 1747us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:22.965487 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:22.965500 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:22.965627 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:22.966404 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:22.966429 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:22.967335 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:22.967341 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:22.968367 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:22.968377 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:22.968899 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:22.968903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:22.969080 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:22.969776 (+ 696us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 17:09:22.969778 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:22.969823 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 17:09:22.969896 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:09:22.970229 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:09:22.970241 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:09:22.970254 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 17:09:22.970389 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 17:09:22.970742 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":147,"threads_started":1}
I20260811 17:09:22.972924 21942 heartbeater.cc:347] Connected to a master server at 127.4.146.254:43575
I20260811 17:09:22.973198 21942 heartbeater.cc:464] Registering TS with master...
I20260811 17:09:22.973760 21942 heartbeater.cc:511] Master 127.4.146.254:43575 requested a full tablet report, sending...
I20260811 17:09:22.974959 21366 ts_manager.cc:194] Registered new tserver with Master: 31b47f08033246a18b01e3c886ef8158 (127.4.146.194:35949)
I20260811 17:09:22.975872 21366 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.146.194:53631
W20260811 17:09:23.087520 21949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:09:23.087815 21949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:09:23.087854 21949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:09:23.091995 21949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:09:23.092067 21949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:09:23.092197 21949 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:09:23.097144 21949 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:35371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:43575
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21949
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:09:23.098264 21949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:09:23.099671 21949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:09:23.110459 21956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:23.110453 21958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:23.110453 21955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:23.111102 21949 server_base.cc:1034] running on GCE node
I20260811 17:09:23.111646 21949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:09:23.112457 21949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:09:23.113652 21949 hybrid_clock.cc:648] HybridClock initialized: now 1786468163113623 us; error 40 us; skew 500 ppm
I20260811 17:09:23.115793 21949 webserver.cc:460] Webserver started at http://127.4.146.195:40601/ using document root <none> and password file <none>
I20260811 17:09:23.116511 21949 fs_manager.cc:359] Metadata directory not provided
I20260811 17:09:23.116585 21949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:09:23.116830 21949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:09:23.119066 21949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "16886e5ae2fd43ba9ea648f9db2d940c"
format_stamp: "Formatted at 2026-08-11 17:09:23 on dist-test-slave-7vjv"
server_key: "46c730d772b23e49dc5a209b2faebb28"
server_key_iv: "ef2709ec5db1f1ed42d4e0ce49103058"
server_key_version: "encryptionkey@0"
I20260811 17:09:23.119695 21949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "16886e5ae2fd43ba9ea648f9db2d940c"
format_stamp: "Formatted at 2026-08-11 17:09:23 on dist-test-slave-7vjv"
server_key: "46c730d772b23e49dc5a209b2faebb28"
server_key_iv: "ef2709ec5db1f1ed42d4e0ce49103058"
server_key_version: "encryptionkey@0"
I20260811 17:09:23.123695 21949 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260811 17:09:23.126807 21970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:23.128324 21949 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:09:23.128443 21949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "16886e5ae2fd43ba9ea648f9db2d940c"
format_stamp: "Formatted at 2026-08-11 17:09:23 on dist-test-slave-7vjv"
server_key: "46c730d772b23e49dc5a209b2faebb28"
server_key_iv: "ef2709ec5db1f1ed42d4e0ce49103058"
server_key_version: "encryptionkey@0"
I20260811 17:09:23.128604 21949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:09:23.149763 21949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:09:23.150658 21949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:09:23.150916 21949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:09:23.151669 21949 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:09:23.152912 21949 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:09:23.152982 21949 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:23.153057 21949 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:09:23.153098 21949 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:23.163968 21949 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:45979
I20260811 17:09:23.164002 22185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:45979 every 8 connection(s)
I20260811 17:09:23.165153 21949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:09:23.174003 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 21949
I20260811 17:09:23.174201 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:09:23.174678 4683 external_mini_cluster.cc:1428] Setting key 6ced1afd58981463f6700ab105849102
I20260811 17:09:23.175979 21431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:23.167340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:48485 (local address 127.4.146.254:43575)
0811 17:09:23.167489 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:23.167494 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:23.168782 (+ 1288us) server_negotiation.cc:407] Connection header received
0811 17:09:23.170325 (+ 1543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:23.170329 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:23.170409 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:23.170524 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:23.171567 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:23.172173 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:23.173416 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:23.173681 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:23.173801 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:23.175356 (+ 1555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:09:23.175360 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:09:23.175362 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:09:23.175379 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:09:23.175405 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:09:23.175417 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:09:23.175520 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:23.175737 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 17:09:23.175814 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 17:09:23.177217 22188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:23.167719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:43575 (local address 127.4.146.195:48485)
0811 17:09:23.168598 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:23.168648 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:23.170047 (+ 1399us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:23.170742 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:23.170750 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:23.170847 (+ 97us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:23.171399 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:23.171413 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:23.172332 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:23.172335 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:23.173270 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:23.173281 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:23.173858 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:23.173862 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:23.174044 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:23.174918 (+ 874us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 17:09:23.174920 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:23.174967 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 17:09:23.175043 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:09:23.175534 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:09:23.175546 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:09:23.175554 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 17:09:23.175705 (+ 151us) client_negotiation.cc:240] Negotiation successful
0811 17:09:23.176036 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":141,"threads_started":1}
I20260811 17:09:23.178614 22186 heartbeater.cc:347] Connected to a master server at 127.4.146.254:43575
I20260811 17:09:23.178880 22186 heartbeater.cc:464] Registering TS with master...
I20260811 17:09:23.179457 22186 heartbeater.cc:511] Master 127.4.146.254:43575 requested a full tablet report, sending...
I20260811 17:09:23.180670 21366 ts_manager.cc:194] Registered new tserver with Master: 16886e5ae2fd43ba9ea648f9db2d940c (127.4.146.195:45979)
I20260811 17:09:23.181229 21366 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.146.195:48485
I20260811 17:09:23.189508 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 17:09:23.192768 21431 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:23.191622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58660 (local address 127.4.146.254:43575)
0811 17:09:23.191782 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:23.191787 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:23.191970 (+ 183us) server_negotiation.cc:407] Connection header received
0811 17:09:23.192071 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:23.192073 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:23.192176 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:23.192256 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:23.192586 (+ 330us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58660: BlockingRecv error: recv got EOF from 127.0.0.1:58660 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 17:09:23.192793 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 21465
I20260811 17:09:23.205087 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 21711
I20260811 17:09:23.221421 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 21949
I20260811 17:09:23.265828 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 21316
2026-08-11T17:09:23Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (1034 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T17:09:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:09:23Z Disabled control of system clock
I20260811 17:09:23.307467 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:44851
--webserver_interface=127.4.146.254
--webserver_port=0
--builtin_ntp_servers=127.4.146.212:41555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:44851
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 17:09:23.426893 22203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:09:23.427258 22203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:09:23.427336 22203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:09:23.431466 22203 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:09:23.431587 22203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:09:23.431619 22203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:09:23.431649 22203 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:09:23.431691 22203 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:09:23.437106 22203 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:41555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:44851
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:44851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:09:23.438323 22203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:09:23.439829 22203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:09:23.449236 22215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:23.449406 22203 server_base.cc:1034] running on GCE node
W20260811 17:09:23.449234 22217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:23.449596 22213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:23.450207 22203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:09:23.451555 22203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:09:23.452804 22203 hybrid_clock.cc:648] HybridClock initialized: now 1786468163452760 us; error 52 us; skew 500 ppm
I20260811 17:09:23.455161 22203 webserver.cc:460] Webserver started at http://127.4.146.254:34875/ using document root <none> and password file <none>
I20260811 17:09:23.455814 22203 fs_manager.cc:359] Metadata directory not provided
I20260811 17:09:23.455921 22203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:09:23.456280 22203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:09:23.458564 22203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "b466797051ef47afbff101381db3e35b"
format_stamp: "Formatted at 2026-08-11 17:09:23 on dist-test-slave-7vjv"
server_key: "c2c978cd2aea7102f104c577fc07f3e1"
server_key_iv: "e6759acdaf7aeb785259d6b5dcdf0aad"
server_key_version: "encryptionkey@0"
I20260811 17:09:23.459187 22203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "b466797051ef47afbff101381db3e35b"
format_stamp: "Formatted at 2026-08-11 17:09:23 on dist-test-slave-7vjv"
server_key: "c2c978cd2aea7102f104c577fc07f3e1"
server_key_iv: "e6759acdaf7aeb785259d6b5dcdf0aad"
server_key_version: "encryptionkey@0"
I20260811 17:09:23.463418 22203 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 17:09:23.467059 22227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:23.468572 22203 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:09:23.468765 22203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "b466797051ef47afbff101381db3e35b"
format_stamp: "Formatted at 2026-08-11 17:09:23 on dist-test-slave-7vjv"
server_key: "c2c978cd2aea7102f104c577fc07f3e1"
server_key_iv: "e6759acdaf7aeb785259d6b5dcdf0aad"
server_key_version: "encryptionkey@0"
I20260811 17:09:23.468909 22203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:09:23.473855 22203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:09:23.474499 22203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:09:23.474701 22203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:09:23.482215 22203 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:44851
I20260811 17:09:23.482242 22325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:44851 every 8 connection(s)
I20260811 17:09:23.483237 22203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:09:23.484879 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 22203
I20260811 17:09:23.485009 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:09:23.485350 4683 external_mini_cluster.cc:1428] Setting key e8e352e700c05b28db2eef5dd62dd9cb
I20260811 17:09:23.487255 22327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:09:23.491328 22332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:23.486851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42248 (local address 127.4.146.254:44851)
0811 17:09:23.487627 (+ 776us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:23.487644 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:23.487682 (+ 38us) server_negotiation.cc:407] Connection header received
0811 17:09:23.488436 (+ 754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:23.488455 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:23.488824 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:23.489221 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:23.490000 (+ 779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:09:23.490005 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:09:23.490016 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:09:23.490026 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:09:23.490079 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:09:23.490101 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:09:23.490264 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:23.490335 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 17:09:23.490609 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":174,"threads_started":1}
I20260811 17:09:23.494021 22327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b466797051ef47afbff101381db3e35b: Bootstrap starting.
I20260811 17:09:23.496649 22327 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b466797051ef47afbff101381db3e35b: Neither blocks nor log segments found. Creating new log.
I20260811 17:09:23.497454 22327 log.cc:824] T 00000000000000000000000000000000 P b466797051ef47afbff101381db3e35b: Log is configured to *not* fsync() on all Append() calls
I20260811 17:09:23.499585 22327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b466797051ef47afbff101381db3e35b: No bootstrap required, opened a new log
I20260811 17:09:23.503866 22327 raft_consensus.cc:348] T 00000000000000000000000000000000 P b466797051ef47afbff101381db3e35b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b466797051ef47afbff101381db3e35b" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 44851 } }
I20260811 17:09:23.504230 22327 raft_consensus.cc:374] T 00000000000000000000000000000000 P b466797051ef47afbff101381db3e35b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:09:23.504281 22327 raft_consensus.cc:729] T 00000000000000000000000000000000 P b466797051ef47afbff101381db3e35b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b466797051ef47afbff101381db3e35b, State: Initialized, Role: FOLLOWER
I20260811 17:09:23.504786 22327 consensus_queue.cc:260] T 00000000000000000000000000000000 P b466797051ef47afbff101381db3e35b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b466797051ef47afbff101381db3e35b" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 44851 } }
I20260811 17:09:23.504917 22327 raft_consensus.cc:388] T 00000000000000000000000000000000 P b466797051ef47afbff101381db3e35b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:09:23.504992 22327 raft_consensus.cc:482] T 00000000000000000000000000000000 P b466797051ef47afbff101381db3e35b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:09:23.505102 22327 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b466797051ef47afbff101381db3e35b [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:09:23.506214 22327 raft_consensus.cc:504] T 00000000000000000000000000000000 P b466797051ef47afbff101381db3e35b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b466797051ef47afbff101381db3e35b" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 44851 } }
I20260811 17:09:23.506718 22327 leader_election.cc:302] T 00000000000000000000000000000000 P b466797051ef47afbff101381db3e35b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b466797051ef47afbff101381db3e35b; no voters:
I20260811 17:09:23.507207 22327 leader_election.cc:288] T 00000000000000000000000000000000 P b466797051ef47afbff101381db3e35b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:09:23.507336 22334 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b466797051ef47afbff101381db3e35b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:09:23.507606 22334 raft_consensus.cc:686] T 00000000000000000000000000000000 P b466797051ef47afbff101381db3e35b [term 1 LEADER]: Becoming Leader. State: Replica: b466797051ef47afbff101381db3e35b, State: Running, Role: LEADER
I20260811 17:09:23.508035 22334 consensus_queue.cc:237] T 00000000000000000000000000000000 P b466797051ef47afbff101381db3e35b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b466797051ef47afbff101381db3e35b" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 44851 } }
I20260811 17:09:23.508761 22327 sys_catalog.cc:564] T 00000000000000000000000000000000 P b466797051ef47afbff101381db3e35b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:09:23.510027 22338 sys_catalog.cc:455] T 00000000000000000000000000000000 P b466797051ef47afbff101381db3e35b [sys.catalog]: SysCatalogTable state changed. Reason: New leader b466797051ef47afbff101381db3e35b. Latest consensus state: current_term: 1 leader_uuid: "b466797051ef47afbff101381db3e35b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b466797051ef47afbff101381db3e35b" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 44851 } } }
I20260811 17:09:23.510172 22338 sys_catalog.cc:458] T 00000000000000000000000000000000 P b466797051ef47afbff101381db3e35b [sys.catalog]: This master's current role is: LEADER
I20260811 17:09:23.510787 22345 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:09:23.510787 22335 sys_catalog.cc:455] T 00000000000000000000000000000000 P b466797051ef47afbff101381db3e35b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b466797051ef47afbff101381db3e35b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b466797051ef47afbff101381db3e35b" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 44851 } } }
I20260811 17:09:23.510958 22335 sys_catalog.cc:458] T 00000000000000000000000000000000 P b466797051ef47afbff101381db3e35b [sys.catalog]: This master's current role is: LEADER
I20260811 17:09:23.514328 22345 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:09:23.520390 22345 catalog_manager.cc:1347] Generated new cluster ID: 09c2a4bc0373487eafaf315e55b06780
I20260811 17:09:23.520517 22345 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:09:23.533275 22345 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:09:23.533722 22345 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:09:23.541644 22345 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b466797051ef47afbff101381db3e35b: Generated new TSK 0
I20260811 17:09:23.542603 22345 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:09:23.553182 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:44851
--builtin_ntp_servers=127.4.146.212:41555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 17:09:23.689656 22363 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:09:23.690021 22363 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:09:23.690104 22363 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:09:23.694569 22363 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:09:23.694693 22363 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:09:23.694795 22363 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:09:23.700021 22363 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:41555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:44851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22363
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:09:23.701377 22363 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:09:23.702901 22363 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:09:23.713155 22373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:23.713212 22375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:23.713436 22363 server_base.cc:1034] running on GCE node
W20260811 17:09:23.713184 22383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:23.714008 22363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:09:23.714736 22363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:09:23.715929 22363 hybrid_clock.cc:648] HybridClock initialized: now 1786468163715909 us; error 36 us; skew 500 ppm
I20260811 17:09:23.718137 22363 webserver.cc:460] Webserver started at http://127.4.146.193:41351/ using document root <none> and password file <none>
I20260811 17:09:23.718779 22363 fs_manager.cc:359] Metadata directory not provided
I20260811 17:09:23.718849 22363 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:09:23.719137 22363 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:09:23.721405 22363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "afdf67f7cdd44481833928eb5e96c5fc"
format_stamp: "Formatted at 2026-08-11 17:09:23 on dist-test-slave-7vjv"
server_key: "3e3f10a8cad0cd7768355d0f70720f97"
server_key_iv: "2b187e7af7d14b3cf7ed04f191aca08a"
server_key_version: "encryptionkey@0"
I20260811 17:09:23.722020 22363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "afdf67f7cdd44481833928eb5e96c5fc"
format_stamp: "Formatted at 2026-08-11 17:09:23 on dist-test-slave-7vjv"
server_key: "3e3f10a8cad0cd7768355d0f70720f97"
server_key_iv: "2b187e7af7d14b3cf7ed04f191aca08a"
server_key_version: "encryptionkey@0"
I20260811 17:09:23.726158 22363 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 17:09:23.729136 22395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:23.730636 22363 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:09:23.730782 22363 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "afdf67f7cdd44481833928eb5e96c5fc"
format_stamp: "Formatted at 2026-08-11 17:09:23 on dist-test-slave-7vjv"
server_key: "3e3f10a8cad0cd7768355d0f70720f97"
server_key_iv: "2b187e7af7d14b3cf7ed04f191aca08a"
server_key_version: "encryptionkey@0"
I20260811 17:09:23.730914 22363 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:09:23.736007 22363 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:09:23.736884 22363 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:09:23.737116 22363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:09:23.737850 22363 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:09:23.738907 22363 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:09:23.738960 22363 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:23.739034 22363 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:09:23.739068 22363 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:23.748800 22363 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:43517
I20260811 17:09:23.748821 22602 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:43517 every 8 connection(s)
I20260811 17:09:23.749770 22363 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:09:23.752621 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 22363
I20260811 17:09:23.752774 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
I20260811 17:09:23.753140 4683 external_mini_cluster.cc:1428] Setting key 14153a82e0fae75d421f77255a5825bd
I20260811 17:09:23.755424 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:44851
--builtin_ntp_servers=127.4.146.212:41555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 17:09:23.756768 22332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:23.751729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:53707 (local address 127.4.146.254:44851)
0811 17:09:23.751872 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:23.751876 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:23.753222 (+ 1346us) server_negotiation.cc:407] Connection header received
0811 17:09:23.754819 (+ 1597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:23.754822 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:23.754864 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:23.754947 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:23.756260 (+ 1313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:09:23.756264 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:09:23.756267 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:09:23.756281 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:09:23.756313 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:09:23.756321 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:09:23.756423 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:23.756576 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 17:09:23.756633 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 17:09:23.757692 22606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:23.752199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:44851 (local address 127.4.146.193:53707)
0811 17:09:23.753026 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:23.753070 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:23.754600 (+ 1530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:23.755127 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:23.755135 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:23.755230 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:23.755899 (+ 669us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 17:09:23.755900 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:23.755946 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 17:09:23.756021 (+ 75us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:09:23.756410 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:09:23.756420 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:09:23.756426 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 17:09:23.756627 (+ 201us) client_negotiation.cc:240] Negotiation successful
0811 17:09:23.756897 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":172,"threads_started":1}
I20260811 17:09:23.759125 22604 heartbeater.cc:347] Connected to a master server at 127.4.146.254:44851
I20260811 17:09:23.759382 22604 heartbeater.cc:464] Registering TS with master...
I20260811 17:09:23.759922 22604 heartbeater.cc:511] Master 127.4.146.254:44851 requested a full tablet report, sending...
I20260811 17:09:23.761775 22262 ts_manager.cc:194] Registered new tserver with Master: afdf67f7cdd44481833928eb5e96c5fc (127.4.146.193:43517)
W20260811 17:09:23.876015 22608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:09:23.876415 22608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:09:23.876459 22608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:09:23.880795 22608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:09:23.880877 22608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:09:23.880939 22608 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:09:23.885967 22608 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:41555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:44851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:09:23.887180 22608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:09:23.888751 22608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:09:23.898842 22626 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:23.898826 22625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:23.898826 22632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:23.899339 22608 server_base.cc:1034] running on GCE node
I20260811 17:09:23.899796 22608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:09:23.900547 22608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:09:23.901749 22608 hybrid_clock.cc:648] HybridClock initialized: now 1786468163901728 us; error 35 us; skew 500 ppm
I20260811 17:09:23.913998 22608 webserver.cc:460] Webserver started at http://127.4.146.194:35709/ using document root <none> and password file <none>
I20260811 17:09:23.914708 22608 fs_manager.cc:359] Metadata directory not provided
I20260811 17:09:23.914824 22608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:09:23.915102 22608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:09:23.917424 22608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "78bd42cc61724e319fd29646263edc7f"
format_stamp: "Formatted at 2026-08-11 17:09:23 on dist-test-slave-7vjv"
server_key: "b44dce9ce54957195f9738b90060f846"
server_key_iv: "ab3b2185fa089b45f6eed871f436d9e8"
server_key_version: "encryptionkey@0"
I20260811 17:09:23.918044 22608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "78bd42cc61724e319fd29646263edc7f"
format_stamp: "Formatted at 2026-08-11 17:09:23 on dist-test-slave-7vjv"
server_key: "b44dce9ce54957195f9738b90060f846"
server_key_iv: "ab3b2185fa089b45f6eed871f436d9e8"
server_key_version: "encryptionkey@0"
I20260811 17:09:23.922289 22608 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 17:09:23.925185 22646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:23.926529 22608 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:09:23.926717 22608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "78bd42cc61724e319fd29646263edc7f"
format_stamp: "Formatted at 2026-08-11 17:09:23 on dist-test-slave-7vjv"
server_key: "b44dce9ce54957195f9738b90060f846"
server_key_iv: "ab3b2185fa089b45f6eed871f436d9e8"
server_key_version: "encryptionkey@0"
I20260811 17:09:23.926851 22608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:09:23.931715 22608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:09:23.932394 22608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:09:23.932597 22608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:09:23.933175 22608 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:09:23.934141 22608 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:09:23.934212 22608 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:23.934273 22608 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:09:23.934314 22608 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:23.943508 22608 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:34357
I20260811 17:09:23.943531 22844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:34357 every 8 connection(s)
I20260811 17:09:23.944532 22608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:09:23.944876 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 22608
I20260811 17:09:23.945024 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:09:23.945401 4683 external_mini_cluster.cc:1428] Setting key 9e67e4b6cf637d3375bd12932a4ad26c
I20260811 17:09:23.947712 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:44851
--builtin_ntp_servers=127.4.146.212:41555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 17:09:23.951479 22332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:23.946550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:47275 (local address 127.4.146.254:44851)
0811 17:09:23.946698 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:23.946702 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:23.948059 (+ 1357us) server_negotiation.cc:407] Connection header received
0811 17:09:23.949459 (+ 1400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:23.949465 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:23.949521 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:23.949631 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:23.951016 (+ 1385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:09:23.951019 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:09:23.951022 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:09:23.951034 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:09:23.951055 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:09:23.951063 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:09:23.951145 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:23.951325 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 17:09:23.951367 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 17:09:23.952751 22854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:23.947137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:44851 (local address 127.4.146.194:47275)
0811 17:09:23.947904 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:23.947958 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:23.949232 (+ 1274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:23.949862 (+ 630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:23.949875 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:23.950002 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:23.950652 (+ 650us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 17:09:23.950656 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:23.950724 (+ 68us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 17:09:23.950830 (+ 106us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:09:23.951158 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:09:23.951170 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:09:23.951180 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 17:09:23.951367 (+ 187us) client_negotiation.cc:240] Negotiation successful
0811 17:09:23.951628 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":146,"threads_started":1}
I20260811 17:09:23.954152 22847 heartbeater.cc:347] Connected to a master server at 127.4.146.254:44851
I20260811 17:09:23.954434 22847 heartbeater.cc:464] Registering TS with master...
I20260811 17:09:23.954903 22847 heartbeater.cc:511] Master 127.4.146.254:44851 requested a full tablet report, sending...
I20260811 17:09:23.956247 22262 ts_manager.cc:194] Registered new tserver with Master: 78bd42cc61724e319fd29646263edc7f (127.4.146.194:34357)
W20260811 17:09:24.076056 22856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:09:24.076539 22856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:09:24.076654 22856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:09:24.081037 22856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:09:24.081157 22856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:09:24.081255 22856 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:09:24.086661 22856 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:41555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:44851
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22856
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:09:24.087965 22856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:09:24.089560 22856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:09:24.100735 22871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:24.100737 22866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:24.100787 22856 server_base.cc:1034] running on GCE node
W20260811 17:09:24.100761 22863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:24.101567 22856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:09:24.102499 22856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:09:24.103755 22856 hybrid_clock.cc:648] HybridClock initialized: now 1786468164103711 us; error 61 us; skew 500 ppm
I20260811 17:09:24.106014 22856 webserver.cc:460] Webserver started at http://127.4.146.195:45547/ using document root <none> and password file <none>
I20260811 17:09:24.106667 22856 fs_manager.cc:359] Metadata directory not provided
I20260811 17:09:24.106772 22856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:09:24.107033 22856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:09:24.109547 22856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "e4f35ffc3aee48ed9c0de1ad5ec11fe5"
format_stamp: "Formatted at 2026-08-11 17:09:24 on dist-test-slave-7vjv"
server_key: "2054e1c065d5c535b3569cc75599151b"
server_key_iv: "2c7b2eda11f798412ada597d6cb8729c"
server_key_version: "encryptionkey@0"
I20260811 17:09:24.110278 22856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "e4f35ffc3aee48ed9c0de1ad5ec11fe5"
format_stamp: "Formatted at 2026-08-11 17:09:24 on dist-test-slave-7vjv"
server_key: "2054e1c065d5c535b3569cc75599151b"
server_key_iv: "2c7b2eda11f798412ada597d6cb8729c"
server_key_version: "encryptionkey@0"
I20260811 17:09:24.114763 22856 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 17:09:24.117724 22891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:24.119282 22856 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 17:09:24.119450 22856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "e4f35ffc3aee48ed9c0de1ad5ec11fe5"
format_stamp: "Formatted at 2026-08-11 17:09:24 on dist-test-slave-7vjv"
server_key: "2054e1c065d5c535b3569cc75599151b"
server_key_iv: "2c7b2eda11f798412ada597d6cb8729c"
server_key_version: "encryptionkey@0"
I20260811 17:09:24.119591 22856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:09:24.124691 22856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:09:24.125396 22856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:09:24.125597 22856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:09:24.126189 22856 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:09:24.127170 22856 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:09:24.127243 22856 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:24.127316 22856 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:09:24.127369 22856 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:24.137276 22856 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:43251
I20260811 17:09:24.137300 23099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:43251 every 8 connection(s)
I20260811 17:09:24.138389 22856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:09:24.146281 22332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:24.140814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:53253 (local address 127.4.146.254:44851)
0811 17:09:24.141050 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:24.141055 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:24.142330 (+ 1275us) server_negotiation.cc:407] Connection header received
0811 17:09:24.143957 (+ 1627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:24.143962 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:24.144022 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:24.144147 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:24.145699 (+ 1552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:09:24.145703 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:09:24.145705 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:09:24.145729 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:09:24.145753 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:09:24.145762 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:09:24.145900 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:24.146059 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 17:09:24.146118 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 17:09:24.147099 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 22856
I20260811 17:09:24.147226 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:09:24.147564 4683 external_mini_cluster.cc:1428] Setting key 0a7ecbea4fffef1f997cb6ed7fb33f31
I20260811 17:09:24.147578 23103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:24.141202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:44851 (local address 127.4.146.195:53253)
0811 17:09:24.142098 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:24.142165 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:24.143661 (+ 1496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:24.144363 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:24.144372 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:24.144486 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:24.145345 (+ 859us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 17:09:24.145347 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:24.145398 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 17:09:24.145483 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:09:24.145880 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:09:24.145892 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:09:24.145899 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 17:09:24.146117 (+ 218us) client_negotiation.cc:240] Negotiation successful
0811 17:09:24.146433 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":152,"threads_started":1}
I20260811 17:09:24.149227 23100 heartbeater.cc:347] Connected to a master server at 127.4.146.254:44851
I20260811 17:09:24.149546 23100 heartbeater.cc:464] Registering TS with master...
I20260811 17:09:24.150092 23100 heartbeater.cc:511] Master 127.4.146.254:44851 requested a full tablet report, sending...
I20260811 17:09:24.151324 22262 ts_manager.cc:194] Registered new tserver with Master: e4f35ffc3aee48ed9c0de1ad5ec11fe5 (127.4.146.195:43251)
I20260811 17:09:24.162568 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 17:09:24.165974 22332 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:09:24.165011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42254 (local address 127.4.146.254:44851)
0811 17:09:24.165194 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:24.165198 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:24.165271 (+ 73us) server_negotiation.cc:407] Connection header received
0811 17:09:24.165379 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:24.165381 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:24.165417 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:24.165490 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:24.165811 (+ 321us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42254: BlockingRecv error: recv got EOF from 127.0.0.1:42254 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 17:09:24.166015 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 22363
I20260811 17:09:24.222589 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 22608
I20260811 17:09:24.240490 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 22856
I20260811 17:09:24.254715 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 22203
2026-08-11T17:09:24Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (991 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:09:24 dist-test-slave-7vjv krb5kdc[23113](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:09:24 dist-test-slave-7vjv krb5kdc[23113](info): set up 2 sockets
Aug 11 17:09:24 dist-test-slave-7vjv krb5kdc[23113](info): commencing operation
krb5kdc: starting...
W20260811 17:09:25.615368 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.328s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:09:25 dist-test-slave-7vjv krb5kdc[23113](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:09:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:09:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:09:25.764489 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:46807
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:46807
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:09:25.885330 23129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:09:25.885720 23129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:09:25.885815 23129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:09:25.890101 23129 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:09:25.890220 23129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:09:25.890257 23129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:09:25.890301 23129 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:09:25.890334 23129 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:09:25.896441 23129 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:46807
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:46807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23129
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:09:25.897889 23129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:09:25.899204 23129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:09:25.909854 23136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:25.909853 23139 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:25.910037 23129 server_base.cc:1034] running on GCE node
W20260811 17:09:25.910288 23137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:25.911190 23129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:09:25.912645 23129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:09:25.913856 23129 hybrid_clock.cc:648] HybridClock initialized: now 1786468165913811 us; error 64 us; skew 500 ppm
Aug 11 17:09:25 dist-test-slave-7vjv krb5kdc[23113](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468165, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:09:25.917462 23129 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:09:25.918645 23129 webserver.cc:460] Webserver started at http://127.4.146.254:43625/ using document root <none> and password file <none>
I20260811 17:09:25.919301 23129 fs_manager.cc:359] Metadata directory not provided
I20260811 17:09:25.919380 23129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:09:25.919579 23129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:09:25.922040 23129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "da999842274248f6aeb7b08abf4a6575"
format_stamp: "Formatted at 2026-08-11 17:09:25 on dist-test-slave-7vjv"
server_key: "8da1b8676238af9ed09774f483cb7701"
server_key_iv: "9ad6c60933de6d6c9f3047b97925488f"
server_key_version: "encryptionkey@0"
I20260811 17:09:25.922838 23129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "da999842274248f6aeb7b08abf4a6575"
format_stamp: "Formatted at 2026-08-11 17:09:25 on dist-test-slave-7vjv"
server_key: "8da1b8676238af9ed09774f483cb7701"
server_key_iv: "9ad6c60933de6d6c9f3047b97925488f"
server_key_version: "encryptionkey@0"
I20260811 17:09:25.927554 23129 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 17:09:25.930817 23155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:25.932646 23129 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:09:25.932840 23129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "da999842274248f6aeb7b08abf4a6575"
format_stamp: "Formatted at 2026-08-11 17:09:25 on dist-test-slave-7vjv"
server_key: "8da1b8676238af9ed09774f483cb7701"
server_key_iv: "9ad6c60933de6d6c9f3047b97925488f"
server_key_version: "encryptionkey@0"
I20260811 17:09:25.933024 23129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:09:25.951562 23129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:09:25.955200 23129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:09:25.955457 23129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:09:25.963261 23129 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:46807
I20260811 17:09:25.963605 23251 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:46807 every 8 connection(s)
I20260811 17:09:25.964406 23129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:09:25.967355 23254 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:09:25.973327 23254 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da999842274248f6aeb7b08abf4a6575: Bootstrap starting.
I20260811 17:09:25.973459 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 23129
I20260811 17:09:25.973587 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:09:25.973886 4683 external_mini_cluster.cc:1428] Setting key a78b924d481285b4fabd5edea9e15d2b
I20260811 17:09:25.976373 23254 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da999842274248f6aeb7b08abf4a6575: Neither blocks nor log segments found. Creating new log.
I20260811 17:09:25.977200 23254 log.cc:824] T 00000000000000000000000000000000 P da999842274248f6aeb7b08abf4a6575: Log is configured to *not* fsync() on all Append() calls
I20260811 17:09:25.979595 23254 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da999842274248f6aeb7b08abf4a6575: No bootstrap required, opened a new log
Aug 11 17:09:25 dist-test-slave-7vjv krb5kdc[23113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:09:25.984891 23254 raft_consensus.cc:348] T 00000000000000000000000000000000 P da999842274248f6aeb7b08abf4a6575 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da999842274248f6aeb7b08abf4a6575" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 46807 } }
I20260811 17:09:25.985205 23254 raft_consensus.cc:374] T 00000000000000000000000000000000 P da999842274248f6aeb7b08abf4a6575 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:09:25.985291 23254 raft_consensus.cc:729] T 00000000000000000000000000000000 P da999842274248f6aeb7b08abf4a6575 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da999842274248f6aeb7b08abf4a6575, State: Initialized, Role: FOLLOWER
I20260811 17:09:25.985844 23254 consensus_queue.cc:260] T 00000000000000000000000000000000 P da999842274248f6aeb7b08abf4a6575 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da999842274248f6aeb7b08abf4a6575" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 46807 } }
I20260811 17:09:25.986059 23254 raft_consensus.cc:388] T 00000000000000000000000000000000 P da999842274248f6aeb7b08abf4a6575 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:09:25.986169 23254 raft_consensus.cc:482] T 00000000000000000000000000000000 P da999842274248f6aeb7b08abf4a6575 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:09:25.986307 23254 raft_consensus.cc:3037] T 00000000000000000000000000000000 P da999842274248f6aeb7b08abf4a6575 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:09:25.987335 23254 raft_consensus.cc:504] T 00000000000000000000000000000000 P da999842274248f6aeb7b08abf4a6575 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da999842274248f6aeb7b08abf4a6575" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 46807 } }
I20260811 17:09:25.987723 23254 leader_election.cc:302] T 00000000000000000000000000000000 P da999842274248f6aeb7b08abf4a6575 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da999842274248f6aeb7b08abf4a6575; no voters:
I20260811 17:09:25.988186 23254 leader_election.cc:288] T 00000000000000000000000000000000 P da999842274248f6aeb7b08abf4a6575 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:09:25.988263 23262 raft_consensus.cc:2781] T 00000000000000000000000000000000 P da999842274248f6aeb7b08abf4a6575 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:09:25.988485 23262 raft_consensus.cc:686] T 00000000000000000000000000000000 P da999842274248f6aeb7b08abf4a6575 [term 1 LEADER]: Becoming Leader. State: Replica: da999842274248f6aeb7b08abf4a6575, State: Running, Role: LEADER
I20260811 17:09:25.988822 23262 consensus_queue.cc:237] T 00000000000000000000000000000000 P da999842274248f6aeb7b08abf4a6575 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da999842274248f6aeb7b08abf4a6575" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 46807 } }
I20260811 17:09:25.989663 23254 sys_catalog.cc:564] T 00000000000000000000000000000000 P da999842274248f6aeb7b08abf4a6575 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:09:25.992154 23266 sys_catalog.cc:455] T 00000000000000000000000000000000 P da999842274248f6aeb7b08abf4a6575 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "da999842274248f6aeb7b08abf4a6575" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da999842274248f6aeb7b08abf4a6575" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 46807 } } }
I20260811 17:09:25.992292 23266 sys_catalog.cc:458] T 00000000000000000000000000000000 P da999842274248f6aeb7b08abf4a6575 [sys.catalog]: This master's current role is: LEADER
I20260811 17:09:25.990146 23262 sys_catalog.cc:455] T 00000000000000000000000000000000 P da999842274248f6aeb7b08abf4a6575 [sys.catalog]: SysCatalogTable state changed. Reason: New leader da999842274248f6aeb7b08abf4a6575. Latest consensus state: current_term: 1 leader_uuid: "da999842274248f6aeb7b08abf4a6575" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da999842274248f6aeb7b08abf4a6575" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 46807 } } }
I20260811 17:09:25.992470 23262 sys_catalog.cc:458] T 00000000000000000000000000000000 P da999842274248f6aeb7b08abf4a6575 [sys.catalog]: This master's current role is: LEADER
I20260811 17:09:25.993104 23258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:25.975683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40732 (local address 127.4.146.254:46807)
0811 17:09:25.976221 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:25.976238 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:25.976277 (+ 39us) server_negotiation.cc:407] Connection header received
0811 17:09:25.977028 (+ 751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:25.977048 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:25.977470 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:25.977878 (+ 408us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:25.978780 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:25.979861 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:25.981186 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:25.981762 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:25.981901 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:25.985224 (+ 3323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:09:25.985232 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:09:25.985256 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:09:25.985297 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:09:25.987741 (+ 2444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:25.988755 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:25.988762 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:25.988770 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:25.988994 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:25.989363 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:25.989367 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:25.989369 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:25.989949 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:09:25.990945 (+ 996us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:25.991127 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 17:09:25.991507 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":183,"threads_started":1}
W20260811 17:09:25.995993 23286 catalog_manager.cc:1558] T 00000000000000000000000000000000 P da999842274248f6aeb7b08abf4a6575: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 17:09:25.996142 23286 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 17:09:25.996227 23284 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:09:25.997036 23284 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:09:26.003639 23284 catalog_manager.cc:1347] Generated new cluster ID: be0eab5b06b54a54b43b8f00aa2586c4
I20260811 17:09:26.003732 23284 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:09:26.024448 23284 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:09:26.025637 23284 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:09:26.037618 23284 catalog_manager.cc:5868] T 00000000000000000000000000000000 P da999842274248f6aeb7b08abf4a6575: Generated new TSK 0
I20260811 17:09:26.038616 23284 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
I20260811 17:09:26.084573 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:46807
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:09:26.234901 23301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:09:26.235283 23301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:09:26.235379 23301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:09:26.240046 23301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:09:26.240203 23301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:09:26.240299 23301 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:09:26.246793 23301 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:46807
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23301
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:09:26.248159 23301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:09:26.249305 23301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:09:26.260076 23314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:26.260076 23312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:26.260078 23316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:26.260560 23301 server_base.cc:1034] running on GCE node
I20260811 17:09:26.261035 23301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:09:26.261734 23301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:09:26.262931 23301 hybrid_clock.cc:648] HybridClock initialized: now 1786468166262890 us; error 53 us; skew 500 ppm
Aug 11 17:09:26 dist-test-slave-7vjv krb5kdc[23113](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468166, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:09:26.266149 23301 init.cc:377] Logged in from keytab as kudu/127.4.146.193@KRBTEST.COM (short username kudu)
I20260811 17:09:26.267067 23301 webserver.cc:460] Webserver started at http://127.4.146.193:35223/ using document root <none> and password file <none>
I20260811 17:09:26.267619 23301 fs_manager.cc:359] Metadata directory not provided
I20260811 17:09:26.267691 23301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:09:26.267869 23301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:09:26.270010 23301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "be79162553d44694a674670fa478d93e"
format_stamp: "Formatted at 2026-08-11 17:09:26 on dist-test-slave-7vjv"
server_key: "a2e5615c7b27ccf26456cc4e9c108cd0"
server_key_iv: "695e26470cd3355f811aa17e7fb47868"
server_key_version: "encryptionkey@0"
I20260811 17:09:26.270537 23301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "be79162553d44694a674670fa478d93e"
format_stamp: "Formatted at 2026-08-11 17:09:26 on dist-test-slave-7vjv"
server_key: "a2e5615c7b27ccf26456cc4e9c108cd0"
server_key_iv: "695e26470cd3355f811aa17e7fb47868"
server_key_version: "encryptionkey@0"
I20260811 17:09:26.274503 23301 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 17:09:26.277216 23325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:26.278631 23301 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:09:26.278779 23301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "be79162553d44694a674670fa478d93e"
format_stamp: "Formatted at 2026-08-11 17:09:26 on dist-test-slave-7vjv"
server_key: "a2e5615c7b27ccf26456cc4e9c108cd0"
server_key_iv: "695e26470cd3355f811aa17e7fb47868"
server_key_version: "encryptionkey@0"
I20260811 17:09:26.278888 23301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:09:26.299401 23301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:09:26.303294 23301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:09:26.303480 23301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:09:26.304180 23301 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:09:26.305235 23301 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:09:26.305315 23301 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:26.305387 23301 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:09:26.305440 23301 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:26.315086 23301 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:35607
I20260811 17:09:26.315155 23534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:35607 every 8 connection(s)
I20260811 17:09:26.316351 23301 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:09:26.325182 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 23301
I20260811 17:09:26.325335 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
I20260811 17:09:26.325690 4683 external_mini_cluster.cc:1428] Setting key 88cf4b76510de6d84e7ce664b63aa6fa
Aug 11 17:09:26 dist-test-slave-7vjv krb5kdc[23113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468166, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:09:26.333504 23258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:26.318853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:52579 (local address 127.4.146.254:46807)
0811 17:09:26.319059 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:26.319064 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:26.320048 (+ 984us) server_negotiation.cc:407] Connection header received
0811 17:09:26.321570 (+ 1522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:26.321573 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:26.321627 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:26.321719 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:26.323208 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.323766 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.325181 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.325583 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.325722 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:26.328998 (+ 3276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:09:26.329006 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:09:26.329013 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:09:26.329055 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:09:26.330875 (+ 1820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:26.331653 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:26.331656 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:26.331658 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:26.331751 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:26.332208 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:26.332211 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:26.332213 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:26.332428 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:09:26.332544 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:26.333157 (+ 613us) server_negotiation.cc:299] Negotiation successful
0811 17:09:26.333322 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260811 17:09:26.334409 23538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:26.319273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:46807 (local address 127.4.146.193:52579)
0811 17:09:26.319848 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:26.319900 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:26.321282 (+ 1382us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:26.321941 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:26.321952 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:26.322386 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:26.322966 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:26.322982 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.323929 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.323933 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:26.324980 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:26.324992 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.325952 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.325956 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:26.326156 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:26.326935 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:26.326954 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:26.328786 (+ 1832us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:09:26.331171 (+ 2385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:09:26.331178 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:09:26.331199 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:09:26.331512 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:09:26.331862 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:09:26.331865 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:09:26.331867 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:09:26.332035 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:09:26.332545 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:09:26.332555 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:09:26.332884 (+ 329us) client_negotiation.cc:769] Sending connection context
0811 17:09:26.333105 (+ 221us) client_negotiation.cc:240] Negotiation successful
0811 17:09:26.333490 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":143,"threads_started":1}
I20260811 17:09:26.336311 23536 heartbeater.cc:347] Connected to a master server at 127.4.146.254:46807
I20260811 17:09:26.336889 23536 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.4.146.194@KRBTEST.COM; defaulting to no policy
I20260811 17:09:26.338155 23536 heartbeater.cc:511] Master 127.4.146.254:46807 requested a full tablet report, sending...
I20260811 17:09:26.340642 23193 ts_manager.cc:194] Registered new tserver with Master: be79162553d44694a674670fa478d93e (127.4.146.193:35607)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.194@KRBTEST.COM" created.
I20260811 17:09:26.342412 23193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.193@KRBTEST.COM'} at 127.4.146.193:52579
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
I20260811 17:09:26.363870 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:46807
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:09:26.494278 23541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:09:26.494664 23541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:09:26.494764 23541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:09:26.499279 23541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:09:26.499429 23541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:09:26.499532 23541 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:09:26.505808 23541 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:46807
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23541
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:09:26.507156 23541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:09:26.508695 23541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:09:26.521667 23552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:26.521874 23541 server_base.cc:1034] running on GCE node
W20260811 17:09:26.521693 23556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:26.521653 23551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:26.522603 23541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:09:26.523440 23541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:09:26.524646 23541 hybrid_clock.cc:648] HybridClock initialized: now 1786468166524607 us; error 65 us; skew 500 ppm
Aug 11 17:09:26 dist-test-slave-7vjv krb5kdc[23113](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468166, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:09:26.528586 23541 init.cc:377] Logged in from keytab as kudu/127.4.146.194@KRBTEST.COM (short username kudu)
I20260811 17:09:26.529961 23541 webserver.cc:460] Webserver started at http://127.4.146.194:38159/ using document root <none> and password file <none>
I20260811 17:09:26.530771 23541 fs_manager.cc:359] Metadata directory not provided
I20260811 17:09:26.530894 23541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:09:26.531210 23541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:09:26.534850 23541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "ec704bd63db74be5930e96e14a87b154"
format_stamp: "Formatted at 2026-08-11 17:09:26 on dist-test-slave-7vjv"
server_key: "59e5fec235e8a1f7f1ae89c7a959b406"
server_key_iv: "455ae73408f5cc10514d1e987e0599b5"
server_key_version: "encryptionkey@0"
I20260811 17:09:26.535809 23541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "ec704bd63db74be5930e96e14a87b154"
format_stamp: "Formatted at 2026-08-11 17:09:26 on dist-test-slave-7vjv"
server_key: "59e5fec235e8a1f7f1ae89c7a959b406"
server_key_iv: "455ae73408f5cc10514d1e987e0599b5"
server_key_version: "encryptionkey@0"
I20260811 17:09:26.541314 23541 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 17:09:26.544525 23567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:26.546382 23541 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 17:09:26.546691 23541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "ec704bd63db74be5930e96e14a87b154"
format_stamp: "Formatted at 2026-08-11 17:09:26 on dist-test-slave-7vjv"
server_key: "59e5fec235e8a1f7f1ae89c7a959b406"
server_key_iv: "455ae73408f5cc10514d1e987e0599b5"
server_key_version: "encryptionkey@0"
I20260811 17:09:26.546917 23541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:09:26.570225 23541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:09:26.574784 23541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:09:26.575062 23541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:09:26.575819 23541 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:09:26.576860 23541 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:09:26.576941 23541 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:26.577018 23541 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:09:26.577060 23541 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:26.587807 23541 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:36559
I20260811 17:09:26.587826 23791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:36559 every 8 connection(s)
I20260811 17:09:26.588935 23541 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:09:26.593605 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 23541
I20260811 17:09:26.593760 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:09:26.594087 4683 external_mini_cluster.cc:1428] Setting key 73cfd4e81fc28bdddb84a3ed83739e2c
Aug 11 17:09:26 dist-test-slave-7vjv krb5kdc[23113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468166, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.146.195@KRBTEST.COM; defaulting to no policy
I20260811 17:09:26.609289 23258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:26.591295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:43731 (local address 127.4.146.254:46807)
0811 17:09:26.591481 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:26.591485 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:26.592678 (+ 1193us) server_negotiation.cc:407] Connection header received
0811 17:09:26.594354 (+ 1676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:26.594358 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:26.594423 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:26.594551 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:26.596354 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.597198 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.599096 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.599331 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.599444 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:26.603229 (+ 3785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:09:26.603241 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:09:26.603244 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:09:26.603278 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:09:26.605307 (+ 2029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:26.606748 (+ 1441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:26.606755 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:26.606758 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:26.606890 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:26.607476 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:26.607479 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:26.607480 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:26.607788 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:09:26.607945 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:26.608853 (+ 908us) server_negotiation.cc:299] Negotiation successful
0811 17:09:26.609049 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 17:09:26.610841 23797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:26.591783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:46807 (local address 127.4.146.194:43731)
0811 17:09:26.592476 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:26.592527 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:26.594049 (+ 1522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:26.594803 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:26.594810 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:26.595416 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:26.596170 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:26.596194 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.597371 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.597374 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:26.598901 (+ 1527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:26.598921 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.599545 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.599549 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:26.599855 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:26.600709 (+ 854us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:26.600730 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:26.602963 (+ 2233us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:09:26.605488 (+ 2525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:09:26.605497 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:09:26.605520 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:09:26.606478 (+ 958us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:09:26.607063 (+ 585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:09:26.607066 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:09:26.607068 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:09:26.607295 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:09:26.607944 (+ 649us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:09:26.607955 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:09:26.608527 (+ 572us) client_negotiation.cc:769] Sending connection context
0811 17:09:26.608772 (+ 245us) client_negotiation.cc:240] Negotiation successful
0811 17:09:26.609273 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":178,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.195@KRBTEST.COM" created.
I20260811 17:09:26.612795 23792 heartbeater.cc:347] Connected to a master server at 127.4.146.254:46807
I20260811 17:09:26.613252 23792 heartbeater.cc:464] Registering TS with master...
I20260811 17:09:26.613986 23792 heartbeater.cc:511] Master 127.4.146.254:46807 requested a full tablet report, sending...
I20260811 17:09:26.615756 23193 ts_manager.cc:194] Registered new tserver with Master: ec704bd63db74be5930e96e14a87b154 (127.4.146.194:36559)
I20260811 17:09:26.616585 23193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.194@KRBTEST.COM'} at 127.4.146.194:43731
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
I20260811 17:09:26.633325 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:46807
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:09:26.770118 23803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:09:26.770499 23803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:09:26.770547 23803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:09:26.775009 23803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:09:26.775108 23803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:09:26.775187 23803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:09:26.781021 23803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:46807
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23803
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:09:26.782398 23803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:09:26.783625 23803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:09:26.795718 23813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:09:26.795710 23812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:26.795948 23803 server_base.cc:1034] running on GCE node
W20260811 17:09:26.795707 23815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:09:26.796612 23803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:09:26.797482 23803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:09:26.798733 23803 hybrid_clock.cc:648] HybridClock initialized: now 1786468166798700 us; error 40 us; skew 500 ppm
Aug 11 17:09:26 dist-test-slave-7vjv krb5kdc[23113](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468166, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:09:26.802228 23803 init.cc:377] Logged in from keytab as kudu/127.4.146.195@KRBTEST.COM (short username kudu)
I20260811 17:09:26.803366 23803 webserver.cc:460] Webserver started at http://127.4.146.195:33727/ using document root <none> and password file <none>
I20260811 17:09:26.804030 23803 fs_manager.cc:359] Metadata directory not provided
I20260811 17:09:26.804183 23803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:09:26.804447 23803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:09:26.806764 23803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "6c72dd4b54cb457da6857c91a545de6e"
format_stamp: "Formatted at 2026-08-11 17:09:26 on dist-test-slave-7vjv"
server_key: "b2631e0e3b8e6fc26d229075629ef0f1"
server_key_iv: "d73b3d0a9385e6826c0da448725ddf6a"
server_key_version: "encryptionkey@0"
I20260811 17:09:26.807423 23803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "6c72dd4b54cb457da6857c91a545de6e"
format_stamp: "Formatted at 2026-08-11 17:09:26 on dist-test-slave-7vjv"
server_key: "b2631e0e3b8e6fc26d229075629ef0f1"
server_key_iv: "d73b3d0a9385e6826c0da448725ddf6a"
server_key_version: "encryptionkey@0"
I20260811 17:09:26.812810 23803 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260811 17:09:26.815948 23834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:26.817607 23803 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:09:26.817838 23803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "6c72dd4b54cb457da6857c91a545de6e"
format_stamp: "Formatted at 2026-08-11 17:09:26 on dist-test-slave-7vjv"
server_key: "b2631e0e3b8e6fc26d229075629ef0f1"
server_key_iv: "d73b3d0a9385e6826c0da448725ddf6a"
server_key_version: "encryptionkey@0"
I20260811 17:09:26.818039 23803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:09:26.841552 23803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:09:26.845793 23803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:09:26.846060 23803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:09:26.846853 23803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:09:26.848333 23803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:09:26.848395 23803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:26.848446 23803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:09:26.848464 23803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:09:26.859126 23803 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:43805
I20260811 17:09:26.859160 24021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:43805 every 8 connection(s)
I20260811 17:09:26.860292 23803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:09:26.863932 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 23803
I20260811 17:09:26.864132 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:09:26.864554 4683 external_mini_cluster.cc:1428] Setting key 9849342411a445e84708ba5f48b4dadb
Aug 11 17:09:26 dist-test-slave-7vjv krb5kdc[23113](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468166, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:09:26.876793 23258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:26.862377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:54021 (local address 127.4.146.254:46807)
0811 17:09:26.862529 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:26.862532 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:26.863391 (+ 859us) server_negotiation.cc:407] Connection header received
0811 17:09:26.865347 (+ 1956us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:26.865351 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:26.865415 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:26.865526 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:26.867145 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.867737 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.869087 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.869354 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.869451 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:26.872614 (+ 3163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:09:26.872618 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:09:26.872620 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:09:26.872656 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:09:26.874402 (+ 1746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:26.874997 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:26.875000 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:26.875002 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:26.875091 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:26.875500 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:26.875503 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:26.875504 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:26.875714 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:09:26.875796 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:26.876527 (+ 731us) server_negotiation.cc:299] Negotiation successful
0811 17:09:26.876653 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 17:09:26.877781 24025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:26.862713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:46807 (local address 127.4.146.195:54021)
0811 17:09:26.863221 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:26.863269 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:26.865040 (+ 1771us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:26.865742 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:26.865752 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:26.866343 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:09:26.866967 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:26.866991 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.867886 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.867889 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:26.868941 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:26.868952 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.869567 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.869570 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:26.869739 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:26.870403 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:09:26.870421 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:09:26.872378 (+ 1957us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:09:26.874553 (+ 2175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:09:26.874560 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:09:26.874577 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:09:26.874882 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:09:26.875207 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:09:26.875210 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:09:26.875212 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:09:26.875395 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:09:26.875831 (+ 436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:09:26.875837 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:09:26.876262 (+ 425us) client_negotiation.cc:769] Sending connection context
0811 17:09:26.876453 (+ 191us) client_negotiation.cc:240] Negotiation successful
0811 17:09:26.876760 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":113,"threads_started":1}
I20260811 17:09:26.879181 24022 heartbeater.cc:347] Connected to a master server at 127.4.146.254:46807
I20260811 17:09:26.879508 24022 heartbeater.cc:464] Registering TS with master...
I20260811 17:09:26.880080 24022 heartbeater.cc:511] Master 127.4.146.254:46807 requested a full tablet report, sending...
I20260811 17:09:26.881294 23193 ts_manager.cc:194] Registered new tserver with Master: 6c72dd4b54cb457da6857c91a545de6e (127.4.146.195:43805)
I20260811 17:09:26.881888 23193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.195@KRBTEST.COM'} at 127.4.146.195:54021
I20260811 17:09:26.892206 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 17:09:26.903054 23258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:26.894465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40740 (local address 127.4.146.254:46807)
0811 17:09:26.894668 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:26.894672 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:26.894774 (+ 102us) server_negotiation.cc:407] Connection header received
0811 17:09:26.894889 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:26.894891 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:26.894940 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:26.895017 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:09:26.895760 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.896426 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.897868 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.898128 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.898231 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:26.899635 (+ 1404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:09:26.899638 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:09:26.899641 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:09:26.899671 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:09:26.901392 (+ 1721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:26.901842 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:26.901845 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:26.901846 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:26.901932 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:09:26.902226 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:09:26.902229 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:09:26.902230 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:09:26.902487 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:09:26.902602 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:26.902804 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 17:09:26.902916 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 17:09:26.906689 23193 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40740:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 17:09:26.910348 23193 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:09:26.927469 24044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:26.920216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:35607 (local address 127.0.0.1:46118)
0811 17:09:26.921189 (+ 973us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:26.921251 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:26.921491 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:26.922426 (+ 935us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:26.922430 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:26.922494 (+ 64us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:09:26.922675 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:26.922683 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.923955 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.923964 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:26.925629 (+ 1665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:26.925640 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.926751 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.926755 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:26.926891 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:26.926941 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 17:09:26.927085 (+ 144us) client_negotiation.cc:240] Negotiation successful
0811 17:09:26.927252 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":755,"spinlock_wait_cycles":1280,"thread_start_us":122,"threads_started":1}
I20260811 17:09:26.928149 24037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:26.920431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:36559 (local address 127.0.0.1:45760)
0811 17:09:26.921349 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:26.921363 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:26.921491 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:26.922616 (+ 1125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:26.922620 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:26.922642 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:09:26.922719 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:26.922729 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.924393 (+ 1664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.924397 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:26.926279 (+ 1882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:26.926293 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.927673 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.927678 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:26.927787 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:26.927815 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 17:09:26.927870 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 17:09:26.927959 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":852,"mutex_wait_us":223,"spinlock_wait_cycles":13952,"thread_start_us":135,"threads_started":1}
I20260811 17:09:26.928565 24040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:26.920623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:43805 (local address 127.0.0.1:47956)
0811 17:09:26.921565 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:26.921582 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:26.921753 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:26.922328 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:26.922335 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:26.922360 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:09:26.922548 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:26.922560 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.924348 (+ 1788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.924355 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:26.926279 (+ 1924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:26.926293 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.927522 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.927526 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:26.927931 (+ 405us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:26.927961 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 17:09:26.928020 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 17:09:26.928158 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":875,"mutex_wait_us":280,"thread_start_us":94,"threads_started":1}
I20260811 17:09:26.928640 24039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:26.920301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46118 (local address 127.4.146.193:35607)
0811 17:09:26.920711 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:26.920718 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:26.921357 (+ 639us) server_negotiation.cc:407] Connection header received
0811 17:09:26.921748 (+ 391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:26.921757 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:26.922007 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:26.922207 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:09:26.922880 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.923818 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.925801 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.926594 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.926728 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:26.926920 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:26.927236 (+ 316us) server_negotiation.cc:299] Negotiation successful
0811 17:09:26.927380 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":72,"threads_started":1}
I20260811 17:09:26.928814 24046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:26.921157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47956 (local address 127.4.146.195:43805)
0811 17:09:26.921859 (+ 702us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:26.921871 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:26.921893 (+ 22us) server_negotiation.cc:407] Connection header received
0811 17:09:26.921965 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:26.921970 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:26.922148 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:26.922293 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:09:26.922707 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.924166 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.926452 (+ 2286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.927364 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.928227 (+ 863us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:26.928438 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:26.928504 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 17:09:26.928627 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":115,"threads_started":1}
I20260811 17:09:26.929064 24045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:26.920869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45760 (local address 127.4.146.194:36559)
0811 17:09:26.922065 (+ 1196us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:26.922080 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:26.922102 (+ 22us) server_negotiation.cc:407] Connection header received
0811 17:09:26.922172 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:26.922176 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:26.922397 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:26.922650 (+ 253us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:09:26.922939 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.924235 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.926436 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:26.927479 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:26.928474 (+ 995us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:26.928662 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:26.928724 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 17:09:26.928838 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1079,"thread_start_us":206,"threads_started":1}
I20260811 17:09:26.932060 23402 tablet_service.cc:1467] Processing CreateTablet for tablet 2c7f30e6d17b47ff879b153a0f2d42f3 (DEFAULT_TABLE table=test-table [id=0d6cd9c498ea4e55a16303b8027bf3b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:09:26.932055 23910 tablet_service.cc:1467] Processing CreateTablet for tablet 2c7f30e6d17b47ff879b153a0f2d42f3 (DEFAULT_TABLE table=test-table [id=0d6cd9c498ea4e55a16303b8027bf3b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:09:26.932057 23659 tablet_service.cc:1467] Processing CreateTablet for tablet 2c7f30e6d17b47ff879b153a0f2d42f3 (DEFAULT_TABLE table=test-table [id=0d6cd9c498ea4e55a16303b8027bf3b9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:09:26.933382 23402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c7f30e6d17b47ff879b153a0f2d42f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:09:26.933394 23910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c7f30e6d17b47ff879b153a0f2d42f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:09:26.933384 23659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c7f30e6d17b47ff879b153a0f2d42f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:09:26.942237 24051 tablet_bootstrap.cc:492] T 2c7f30e6d17b47ff879b153a0f2d42f3 P 6c72dd4b54cb457da6857c91a545de6e: Bootstrap starting.
I20260811 17:09:26.942577 24050 tablet_bootstrap.cc:492] T 2c7f30e6d17b47ff879b153a0f2d42f3 P ec704bd63db74be5930e96e14a87b154: Bootstrap starting.
I20260811 17:09:26.942960 24049 tablet_bootstrap.cc:492] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e: Bootstrap starting.
I20260811 17:09:26.945261 24049 tablet_bootstrap.cc:654] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e: Neither blocks nor log segments found. Creating new log.
I20260811 17:09:26.945544 24050 tablet_bootstrap.cc:654] T 2c7f30e6d17b47ff879b153a0f2d42f3 P ec704bd63db74be5930e96e14a87b154: Neither blocks nor log segments found. Creating new log.
I20260811 17:09:26.945544 24051 tablet_bootstrap.cc:654] T 2c7f30e6d17b47ff879b153a0f2d42f3 P 6c72dd4b54cb457da6857c91a545de6e: Neither blocks nor log segments found. Creating new log.
I20260811 17:09:26.946236 24049 log.cc:824] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e: Log is configured to *not* fsync() on all Append() calls
I20260811 17:09:26.946494 24050 log.cc:824] T 2c7f30e6d17b47ff879b153a0f2d42f3 P ec704bd63db74be5930e96e14a87b154: Log is configured to *not* fsync() on all Append() calls
I20260811 17:09:26.946494 24051 log.cc:824] T 2c7f30e6d17b47ff879b153a0f2d42f3 P 6c72dd4b54cb457da6857c91a545de6e: Log is configured to *not* fsync() on all Append() calls
I20260811 17:09:26.948966 24049 tablet_bootstrap.cc:492] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e: No bootstrap required, opened a new log
I20260811 17:09:26.948975 24050 tablet_bootstrap.cc:492] T 2c7f30e6d17b47ff879b153a0f2d42f3 P ec704bd63db74be5930e96e14a87b154: No bootstrap required, opened a new log
I20260811 17:09:26.948975 24051 tablet_bootstrap.cc:492] T 2c7f30e6d17b47ff879b153a0f2d42f3 P 6c72dd4b54cb457da6857c91a545de6e: No bootstrap required, opened a new log
I20260811 17:09:26.949232 24049 ts_tablet_manager.cc:1397] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 17:09:26.949231 24051 ts_tablet_manager.cc:1397] T 2c7f30e6d17b47ff879b153a0f2d42f3 P 6c72dd4b54cb457da6857c91a545de6e: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260811 17:09:26.949231 24050 ts_tablet_manager.cc:1397] T 2c7f30e6d17b47ff879b153a0f2d42f3 P ec704bd63db74be5930e96e14a87b154: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 17:09:26.953562 24051 raft_consensus.cc:348] T 2c7f30e6d17b47ff879b153a0f2d42f3 P 6c72dd4b54cb457da6857c91a545de6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be79162553d44694a674670fa478d93e" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 35607 } } peers { permanent_uuid: "ec704bd63db74be5930e96e14a87b154" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 36559 } } peers { permanent_uuid: "6c72dd4b54cb457da6857c91a545de6e" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 43805 } }
I20260811 17:09:26.953562 24050 raft_consensus.cc:348] T 2c7f30e6d17b47ff879b153a0f2d42f3 P ec704bd63db74be5930e96e14a87b154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be79162553d44694a674670fa478d93e" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 35607 } } peers { permanent_uuid: "ec704bd63db74be5930e96e14a87b154" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 36559 } } peers { permanent_uuid: "6c72dd4b54cb457da6857c91a545de6e" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 43805 } }
I20260811 17:09:26.953915 24051 raft_consensus.cc:374] T 2c7f30e6d17b47ff879b153a0f2d42f3 P 6c72dd4b54cb457da6857c91a545de6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:09:26.953915 24050 raft_consensus.cc:374] T 2c7f30e6d17b47ff879b153a0f2d42f3 P ec704bd63db74be5930e96e14a87b154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:09:26.953738 24049 raft_consensus.cc:348] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be79162553d44694a674670fa478d93e" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 35607 } } peers { permanent_uuid: "ec704bd63db74be5930e96e14a87b154" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 36559 } } peers { permanent_uuid: "6c72dd4b54cb457da6857c91a545de6e" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 43805 } }
I20260811 17:09:26.953979 24051 raft_consensus.cc:729] T 2c7f30e6d17b47ff879b153a0f2d42f3 P 6c72dd4b54cb457da6857c91a545de6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c72dd4b54cb457da6857c91a545de6e, State: Initialized, Role: FOLLOWER
I20260811 17:09:26.953991 24050 raft_consensus.cc:729] T 2c7f30e6d17b47ff879b153a0f2d42f3 P ec704bd63db74be5930e96e14a87b154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec704bd63db74be5930e96e14a87b154, State: Initialized, Role: FOLLOWER
I20260811 17:09:26.954051 24049 raft_consensus.cc:374] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:09:26.954126 24049 raft_consensus.cc:729] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be79162553d44694a674670fa478d93e, State: Initialized, Role: FOLLOWER
I20260811 17:09:26.954574 24049 consensus_queue.cc:260] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be79162553d44694a674670fa478d93e" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 35607 } } peers { permanent_uuid: "ec704bd63db74be5930e96e14a87b154" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 36559 } } peers { permanent_uuid: "6c72dd4b54cb457da6857c91a545de6e" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 43805 } }
I20260811 17:09:26.954560 24050 consensus_queue.cc:260] T 2c7f30e6d17b47ff879b153a0f2d42f3 P ec704bd63db74be5930e96e14a87b154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be79162553d44694a674670fa478d93e" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 35607 } } peers { permanent_uuid: "ec704bd63db74be5930e96e14a87b154" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 36559 } } peers { permanent_uuid: "6c72dd4b54cb457da6857c91a545de6e" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 43805 } }
I20260811 17:09:26.954560 24051 consensus_queue.cc:260] T 2c7f30e6d17b47ff879b153a0f2d42f3 P 6c72dd4b54cb457da6857c91a545de6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be79162553d44694a674670fa478d93e" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 35607 } } peers { permanent_uuid: "ec704bd63db74be5930e96e14a87b154" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 36559 } } peers { permanent_uuid: "6c72dd4b54cb457da6857c91a545de6e" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 43805 } }
I20260811 17:09:26.955412 23792 heartbeater.cc:503] Master 127.4.146.254:46807 was elected leader, sending a full tablet report...
I20260811 17:09:26.955816 24049 ts_tablet_manager.cc:1428] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260811 17:09:26.955874 24022 heartbeater.cc:503] Master 127.4.146.254:46807 was elected leader, sending a full tablet report...
I20260811 17:09:26.956413 24051 ts_tablet_manager.cc:1428] T 2c7f30e6d17b47ff879b153a0f2d42f3 P 6c72dd4b54cb457da6857c91a545de6e: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260811 17:09:26.956655 23536 heartbeater.cc:503] Master 127.4.146.254:46807 was elected leader, sending a full tablet report...
I20260811 17:09:26.958482 24050 ts_tablet_manager.cc:1428] T 2c7f30e6d17b47ff879b153a0f2d42f3 P ec704bd63db74be5930e96e14a87b154: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
W20260811 17:09:27.068361 23537 tablet.cc:2369] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 17:09:27.076356 24061 raft_consensus.cc:482] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:09:27.076685 24061 raft_consensus.cc:504] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be79162553d44694a674670fa478d93e" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 35607 } } peers { permanent_uuid: "ec704bd63db74be5930e96e14a87b154" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 36559 } } peers { permanent_uuid: "6c72dd4b54cb457da6857c91a545de6e" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 43805 } }
I20260811 17:09:27.078014 24061 leader_election.cc:288] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec704bd63db74be5930e96e14a87b154 (127.4.146.194:36559), 6c72dd4b54cb457da6857c91a545de6e (127.4.146.195:43805)
I20260811 17:09:27.082664 24045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:27.078443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:50853 (local address 127.4.146.194:36559)
0811 17:09:27.078634 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:27.078640 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:27.078989 (+ 349us) server_negotiation.cc:407] Connection header received
0811 17:09:27.079188 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:27.079191 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:27.079238 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:27.079337 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:09:27.079656 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:27.080265 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:27.081521 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:27.082002 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:27.082136 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:27.082217 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:27.082440 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 17:09:27.082519 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 17:09:27.082693 24064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:27.078363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:36559 (local address 127.4.146.193:50853)
0811 17:09:27.078871 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:27.078884 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:27.079058 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:27.079349 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:27.079352 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:27.079369 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:09:27.079530 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:27.079537 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:27.080386 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:27.080390 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:27.081376 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:27.081387 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:27.082130 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:27.082134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:27.082244 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:27.082278 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 17:09:27.082420 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 17:09:27.082507 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":422,"mutex_wait_us":217,"spinlock_wait_cycles":10496,"thread_start_us":118,"threads_started":1}
I20260811 17:09:27.082664 24046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:27.078529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:43265 (local address 127.4.146.195:43805)
0811 17:09:27.078700 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:27.078706 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:27.078960 (+ 254us) server_negotiation.cc:407] Connection header received
0811 17:09:27.079157 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:27.079161 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:27.079217 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:27.079312 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:09:27.079652 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:27.080259 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:27.081525 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:27.081950 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:27.082096 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:27.082157 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:27.082369 (+ 212us) server_negotiation.cc:299] Negotiation successful
0811 17:09:27.082469 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 17:09:27.083086 24063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:27.078355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:43805 (local address 127.4.146.193:43265)
0811 17:09:27.078837 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:27.078851 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:09:27.079028 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:09:27.079330 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:09:27.079333 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:09:27.079352 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:09:27.079525 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:27.079531 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:27.080389 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:27.080395 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:27.081376 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:09:27.081388 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:09:27.082097 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:09:27.082101 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:09:27.082207 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:27.082237 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 17:09:27.082791 (+ 554us) client_negotiation.cc:240] Negotiation successful
0811 17:09:27.082890 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"mutex_wait_us":14,"spinlock_wait_cycles":8448,"thread_start_us":190,"threads_started":1}
I20260811 17:09:27.083772 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c7f30e6d17b47ff879b153a0f2d42f3" candidate_uuid: "be79162553d44694a674670fa478d93e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec704bd63db74be5930e96e14a87b154" is_pre_election: true
I20260811 17:09:27.084012 23944 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c7f30e6d17b47ff879b153a0f2d42f3" candidate_uuid: "be79162553d44694a674670fa478d93e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c72dd4b54cb457da6857c91a545de6e" is_pre_election: true
I20260811 17:09:27.084328 23700 raft_consensus.cc:2454] T 2c7f30e6d17b47ff879b153a0f2d42f3 P ec704bd63db74be5930e96e14a87b154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be79162553d44694a674670fa478d93e in term 0.
I20260811 17:09:27.084435 23944 raft_consensus.cc:2454] T 2c7f30e6d17b47ff879b153a0f2d42f3 P 6c72dd4b54cb457da6857c91a545de6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be79162553d44694a674670fa478d93e in term 0.
I20260811 17:09:27.084920 23328 leader_election.cc:302] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 6c72dd4b54cb457da6857c91a545de6e, be79162553d44694a674670fa478d93e, ec704bd63db74be5930e96e14a87b154; no voters:
I20260811 17:09:27.085266 24061 raft_consensus.cc:2781] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:09:27.085366 24061 raft_consensus.cc:482] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:09:27.085405 24061 raft_consensus.cc:3037] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:09:27.086700 24061 raft_consensus.cc:504] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be79162553d44694a674670fa478d93e" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 35607 } } peers { permanent_uuid: "ec704bd63db74be5930e96e14a87b154" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 36559 } } peers { permanent_uuid: "6c72dd4b54cb457da6857c91a545de6e" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 43805 } }
I20260811 17:09:27.087121 24061 leader_election.cc:288] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e [CANDIDATE]: Term 1 election: Requested vote from peers ec704bd63db74be5930e96e14a87b154 (127.4.146.194:36559), 6c72dd4b54cb457da6857c91a545de6e (127.4.146.195:43805)
I20260811 17:09:27.087586 23944 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c7f30e6d17b47ff879b153a0f2d42f3" candidate_uuid: "be79162553d44694a674670fa478d93e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c72dd4b54cb457da6857c91a545de6e"
I20260811 17:09:27.087731 23944 raft_consensus.cc:3037] T 2c7f30e6d17b47ff879b153a0f2d42f3 P 6c72dd4b54cb457da6857c91a545de6e [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:09:27.087929 23700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c7f30e6d17b47ff879b153a0f2d42f3" candidate_uuid: "be79162553d44694a674670fa478d93e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec704bd63db74be5930e96e14a87b154"
I20260811 17:09:27.088078 23700 raft_consensus.cc:3037] T 2c7f30e6d17b47ff879b153a0f2d42f3 P ec704bd63db74be5930e96e14a87b154 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:09:27.089475 23944 raft_consensus.cc:2454] T 2c7f30e6d17b47ff879b153a0f2d42f3 P 6c72dd4b54cb457da6857c91a545de6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be79162553d44694a674670fa478d93e in term 1.
I20260811 17:09:27.089675 23700 raft_consensus.cc:2454] T 2c7f30e6d17b47ff879b153a0f2d42f3 P ec704bd63db74be5930e96e14a87b154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be79162553d44694a674670fa478d93e in term 1.
I20260811 17:09:27.089987 23329 leader_election.cc:302] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c72dd4b54cb457da6857c91a545de6e, be79162553d44694a674670fa478d93e; no voters:
I20260811 17:09:27.090229 24061 raft_consensus.cc:2781] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e [term 1 FOLLOWER]: Leader election won for term 1
W20260811 17:09:27.090312 23794 tablet.cc:2369] T 2c7f30e6d17b47ff879b153a0f2d42f3 P ec704bd63db74be5930e96e14a87b154: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 17:09:27.090557 24061 raft_consensus.cc:686] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e [term 1 LEADER]: Becoming Leader. State: Replica: be79162553d44694a674670fa478d93e, State: Running, Role: LEADER
I20260811 17:09:27.091004 24061 consensus_queue.cc:237] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be79162553d44694a674670fa478d93e" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 35607 } } peers { permanent_uuid: "ec704bd63db74be5930e96e14a87b154" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 36559 } } peers { permanent_uuid: "6c72dd4b54cb457da6857c91a545de6e" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 43805 } }
I20260811 17:09:27.094976 23187 catalog_manager.cc:5495] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e reported cstate change: term changed from 0 to 1, leader changed from <none> to be79162553d44694a674670fa478d93e (127.4.146.193). New cstate: current_term: 1 leader_uuid: "be79162553d44694a674670fa478d93e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be79162553d44694a674670fa478d93e" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 35607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ec704bd63db74be5930e96e14a87b154" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 36559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c72dd4b54cb457da6857c91a545de6e" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 43805 } health_report { overall_health: UNKNOWN } } }
W20260811 17:09:27.111475 24024 tablet.cc:2369] T 2c7f30e6d17b47ff879b153a0f2d42f3 P 6c72dd4b54cb457da6857c91a545de6e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 17:09:27.131976 24039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:27.127864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46130 (local address 127.4.146.193:35607)
0811 17:09:27.128007 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 17:09:27.128018 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 17:09:27.128057 (+ 39us) server_negotiation.cc:407] Connection header received
0811 17:09:27.128321 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:09:27.128324 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:09:27.128389 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:09:27.128516 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:09:27.128793 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:27.129313 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:27.130219 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:09:27.130462 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:09:27.130577 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:09:27.131009 (+ 432us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:09:27.131503 (+ 494us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:09:27.131658 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 17:09:27.131727 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 17:09:27.131802 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 17:09:27.139057 23700 raft_consensus.cc:1261] T 2c7f30e6d17b47ff879b153a0f2d42f3 P ec704bd63db74be5930e96e14a87b154 [term 1 FOLLOWER]: Refusing update from remote peer be79162553d44694a674670fa478d93e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:09:27.139065 23944 raft_consensus.cc:1261] T 2c7f30e6d17b47ff879b153a0f2d42f3 P 6c72dd4b54cb457da6857c91a545de6e [term 1 FOLLOWER]: Refusing update from remote peer be79162553d44694a674670fa478d93e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:09:27.139953 24061 consensus_queue.cc:1035] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec704bd63db74be5930e96e14a87b154" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 36559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:09:27.140282 24066 consensus_queue.cc:1035] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c72dd4b54cb457da6857c91a545de6e" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 43805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:09:27.151580 24080 mvcc.cc:205] Tried to move back new op lower bound from 7317373612592996352 to 7317373612407332864. Current Snapshot: MvccSnapshot[applied={T|T < 7317373612592996352}]
I20260811 17:09:27.162617 23187 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:09:27.162825 23187 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:09:27.166018 23187 catalog_manager.cc:5782] T 00000000000000000000000000000000 P da999842274248f6aeb7b08abf4a6575: Sending DeleteTablet for 3 replicas of tablet 2c7f30e6d17b47ff879b153a0f2d42f3
I20260811 17:09:27.167173 23659 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c7f30e6d17b47ff879b153a0f2d42f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:09:27 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:45760
I20260811 17:09:27.167212 23402 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c7f30e6d17b47ff879b153a0f2d42f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:09:27 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:46118
I20260811 17:09:27.167304 23910 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c7f30e6d17b47ff879b153a0f2d42f3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:09:27 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:47956
I20260811 17:09:27.167889 24095 tablet_replica.cc:330] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e: stopping tablet replica
I20260811 17:09:27.168154 24094 tablet_replica.cc:330] T 2c7f30e6d17b47ff879b153a0f2d42f3 P 6c72dd4b54cb457da6857c91a545de6e: stopping tablet replica
I20260811 17:09:27.168356 24095 raft_consensus.cc:2229] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e [term 1 LEADER]: Raft consensus shutting down.
I20260811 17:09:27.168509 24094 raft_consensus.cc:2229] T 2c7f30e6d17b47ff879b153a0f2d42f3 P 6c72dd4b54cb457da6857c91a545de6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:09:27.168821 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 23301
I20260811 17:09:27.168853 24095 raft_consensus.cc:2258] T 2c7f30e6d17b47ff879b153a0f2d42f3 P be79162553d44694a674670fa478d93e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:09:27.168903 24094 raft_consensus.cc:2258] T 2c7f30e6d17b47ff879b153a0f2d42f3 P 6c72dd4b54cb457da6857c91a545de6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:09:27.169279 24093 tablet_replica.cc:330] T 2c7f30e6d17b47ff879b153a0f2d42f3 P ec704bd63db74be5930e96e14a87b154: stopping tablet replica
I20260811 17:09:27.169586 24093 raft_consensus.cc:2229] T 2c7f30e6d17b47ff879b153a0f2d42f3 P ec704bd63db74be5930e96e14a87b154 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:09:27.169883 24093 raft_consensus.cc:2258] T 2c7f30e6d17b47ff879b153a0f2d42f3 P ec704bd63db74be5930e96e14a87b154 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:09:27.194414 24093 ts_tablet_manager.cc:1905] T 2c7f30e6d17b47ff879b153a0f2d42f3 P ec704bd63db74be5930e96e14a87b154: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:09:27.194414 24094 ts_tablet_manager.cc:1905] T 2c7f30e6d17b47ff879b153a0f2d42f3 P 6c72dd4b54cb457da6857c91a545de6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:09:27.197888 24093 ts_tablet_manager.cc:1918] T 2c7f30e6d17b47ff879b153a0f2d42f3 P ec704bd63db74be5930e96e14a87b154: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:09:27.197893 24094 ts_tablet_manager.cc:1918] T 2c7f30e6d17b47ff879b153a0f2d42f3 P 6c72dd4b54cb457da6857c91a545de6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:09:27.198091 24093 log.cc:1196] T 2c7f30e6d17b47ff879b153a0f2d42f3 P ec704bd63db74be5930e96e14a87b154: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-1/wal/wals/2c7f30e6d17b47ff879b153a0f2d42f3
I20260811 17:09:27.198091 24094 log.cc:1196] T 2c7f30e6d17b47ff879b153a0f2d42f3 P 6c72dd4b54cb457da6857c91a545de6e: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/2c7f30e6d17b47ff879b153a0f2d42f3
I20260811 17:09:27.198509 24093 ts_tablet_manager.cc:1939] T 2c7f30e6d17b47ff879b153a0f2d42f3 P ec704bd63db74be5930e96e14a87b154: Deleting consensus metadata
I20260811 17:09:27.198506 24094 ts_tablet_manager.cc:1939] T 2c7f30e6d17b47ff879b153a0f2d42f3 P 6c72dd4b54cb457da6857c91a545de6e: Deleting consensus metadata
W20260811 17:09:27.199586 23166 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.146.193:35607 (error 108)
I20260811 17:09:27.199782 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 23541
I20260811 17:09:27.200314 23162 catalog_manager.cc:4841] TS 6c72dd4b54cb457da6857c91a545de6e (127.4.146.195:43805): tablet 2c7f30e6d17b47ff879b153a0f2d42f3 (table test-table [id=0d6cd9c498ea4e55a16303b8027bf3b9]) successfully deleted
I20260811 17:09:27.223909 24040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:27.223418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:35607 (local address 127.0.0.1:46134)
0811 17:09:27.223635 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:27.223767 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.193:35607: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260811 17:09:27.224233 23166 catalog_manager.cc:4584] TS be79162553d44694a674670fa478d93e (127.4.146.193:35607): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2c7f30e6d17b47ff879b153a0f2d42f3: Network error: Client connection negotiation failed: client connection to 127.4.146.193:35607: connect: Connection refused (error 111)
I20260811 17:09:27.229403 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 23803
I20260811 17:09:27.248926 24040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:09:27.229685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:36559 (local address 127.0.0.1:45772)
0811 17:09:27.248631 (+ 18946us) negotiation.cc:107] Waiting for socket to connect
0811 17:09:27.248764 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.194:36559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18759}
I20260811 17:09:27.256762 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 23129
2026-08-11T17:09:27Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (3004 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:09:27 dist-test-slave-7vjv krb5kdc[24101](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:09:27 dist-test-slave-7vjv krb5kdc[24101](info): set up 2 sockets
Aug 11 17:09:27 dist-test-slave-7vjv krb5kdc[24101](info): commencing operation
krb5kdc: starting...
W20260811 17:09:28.685737 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.393s user 0.007s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:09:28 dist-test-slave-7vjv krb5kdc[24101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468168, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:09:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:09:28Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.4.146.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.4.146.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.4.146.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/rangeradmin_127.4.146.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.4.146.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/rangeradmin_127.4.146.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.4.146.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.4.146.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.4.146.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/rangerlookup_127.4.146.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.4.146.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/rangerlookup_127.4.146.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.4.146.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.4.146.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.4.146.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/HTTP_127.4.146.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.4.146.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/HTTP_127.4.146.212@KRBTEST.COM.keytab.
I20260811 17:09:28.900164 4683 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskk7LoRW/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/postgres -l logfile start
2026-08-11 17:09:31.980 UTC [24145] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 17:09:31.981 UTC [24145] LOG: listening on IPv4 address "127.4.146.212", port 48573
2026-08-11 17:09:31.987 UTC [24145] LOG: listening on Unix socket "/tmp/.s.PGSQL.48573"
2026-08-11 17:09:32.015 UTC [24148] LOG: database system was shut down at 2026-08-11 17:09:30 UTC
2026-08-11 17:09:32.020 UTC [24145] LOG: database system is ready to accept connections
I20260811 17:09:33.269603 4683 mini_postgres.cc:96] Postgres bound to 48573
2026-08-11 17:09:33.279 UTC [24163] FATAL: database "slave" does not exist
127.4.146.212:48573 - accepting connections
I20260811 17:09:33.280695 4683 mini_ranger.cc:161] Starting Ranger...
I20260811 17:09:33.299952 4683 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 17:09:33.910231 4683 mini_ranger.cc:87] Created ranger Postgres database
I20260811 17:09:33.910352 4683 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ranger-admin
2026-08-11 17:09:34,282 [I] DB FLAVOR :POSTGRES
2026-08-11 17:09:34,282 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 17:09:34,283 [I] Checking connection..
2026-08-11 17:09:34,283 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:48573/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 17:09:34,577 [I] Checking connection passed.
2026-08-11 17:09:34,577 [I] --------- Verifying version history table ---------
2026-08-11 17:09:34,578 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:48573/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 17:09:34,841 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 17:09:34,841 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:48573/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 17:09:35,152 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 17:09:35,152 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 17:09:35,153 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:48573/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 17:09:35.456 UTC [24297] WARNING: there is no transaction in progress
2026-08-11 17:09:35,464 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 17:09:35,464 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:48573/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 17:09:35,724 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 17:09:35,724 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 17:09:35,724 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:48573/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 17:09:36,007 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:48573/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 17:09:36,296 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:48573/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7vjv.c.gcp-upstream.internal','N') ;"
2026-08-11 17:09:36,577 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:48573/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 17:09:36,863 [I] Table x_portal_user does not exist in database ranger
2026-08-11 17:09:36,863 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:48573/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 17:09:37,155 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 17:09:37,155 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:48573/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 17:09:37,444 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:48573/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 17:09:37,714 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 17:09:37,714 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:48573/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 17:09:38.887 UTC [24491] WARNING: there is no transaction in progress
2026-08-11 17:09:38.905 UTC [24491] WARNING: there is no transaction in progress
2026-08-11 17:09:38.926 UTC [24491] WARNING: there is no transaction in progress
2026-08-11 17:09:38.944 UTC [24491] WARNING: there is no transaction in progress
2026-08-11 17:09:38.966 UTC [24491] WARNING: there is no transaction in progress
2026-08-11 17:09:38.990 UTC [24491] WARNING: there is no transaction in progress
2026-08-11 17:09:39.061 UTC [24491] WARNING: there is no transaction in progress
2026-08-11 17:09:39.070 UTC [24491] WARNING: there is no transaction in progress
2026-08-11 17:09:39.089 UTC [24491] WARNING: there is no transaction in progress
2026-08-11 17:09:39.101 UTC [24491] WARNING: there is no transaction in progress
2026-08-11 17:09:39.113 UTC [24491] WARNING: there is no transaction in progress
2026-08-11 17:09:39.130 UTC [24491] WARNING: there is no transaction in progress
2026-08-11 17:09:39.143 UTC [24491] WARNING: there is no transaction in progress
2026-08-11 17:09:39.153 UTC [24491] WARNING: there is no transaction in progress
2026-08-11 17:09:39.164 UTC [24491] WARNING: there is no transaction in progress
2026-08-11 17:09:39.173 UTC [24491] WARNING: there is no transaction in progress
2026-08-11 17:09:40,042 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 17:09:40,043 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:48573/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 17:09:40,324 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 17:09:40,324 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:48573/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 17:09:40,607 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 17:09:40,608 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:48573/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 17:09:40,888 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 17:09:40,888 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:48573/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 17:09:41,190 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:48573/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 17:09:41,462 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:48573/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7vjv.c.gcp-upstream.internal';"
2026-08-11 17:09:41,733 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 17:09:41,733 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:48573/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 17:09:42,024 [I] DB_PATCHES have already been applied
I20260811 17:09:42.030762 4683 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ranger-admin:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskk7LoRW/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 17:09:42.030845 4683 mini_ranger.cc:193] Using host: 127.4.146.212
I20260811 17:09:42.035979 4683 mini_ranger.cc:227] Ranger admin URL: http://127.4.146.212:50891
Aug 11, 2026 5:09:42 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 5:09:42 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 5:09:42 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 5:09:42 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 5:09:42 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 5:09:43 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 5:09:43 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 17:09:43.537712 4683 mini_ranger.cc:160] Time spent starting Ranger: real 10.257s user 0.007s sys 0.007s
Aug 11, 2026 5:10:05 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 5:10:05 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 11, 2026 5:10:05 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 5:10:05 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 5:10:05 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 5:10:05 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 5:10:05 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 5:10:05 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 5:10:05 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 5:10:05 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 5:10:05 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 5:10:05 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 5:10:05 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 5:10:05 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 5:10:05 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 5:10:05 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 5:10:05 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 5:10:06 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 17:10:07.374375 4683 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.4.146.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.4.146.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.4.146.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/rangerkms_127.4.146.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.4.146.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/rangerkms_127.4.146.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.4.146.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.4.146.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.4.146.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/HTTP_127.4.146.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.4.146.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/HTTP_127.4.146.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 17:10:07 dist-test-slave-7vjv krb5kdc[24101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468207, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 17:10:07.494541 4683 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 17:10:07.510968 4683 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 17:10:08.607434 4683 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 17:10:08.607566 4683 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ranger-kms
I20260811 17:10:08.607692 4683 mini_ranger_kms.cc:227] Using postgres at 127.4.146.212:48573
2026-08-11 17:10:09,255 [I] DB FLAVOR :POSTGRES
2026-08-11 17:10:09,256 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 17:10:09,256 [I] Checking connection
2026-08-11 17:10:09,256 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:48573/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 17:10:09,617 [I] connection success
2026-08-11 17:10:09,618 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 17:10:09,618 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 17:10:09,618 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:48573/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 17:10:09,910 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 17:10:09,911 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 17:10:09,911 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 17:10:09,911 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:48573/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 17:10:10,224 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 17:10:10.773123 4683 mini_ranger_kms.cc:310] Created kms service
I20260811 17:10:10.991246 4683 mini_ranger_kms.cc:326] Created kudu user
I20260811 17:10:11.057296 4683 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 17:10:11 dist-test-slave-7vjv krb5kdc[24101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468207, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.4.146.212@KRBTEST.COM
I20260811 17:10:11.560828 4683 mini_ranger_kms.cc:384] Added ranger policy
I20260811 17:10:11.561069 4683 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ranger-kms:/tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 17:10:11.561106 4683 mini_ranger_kms.cc:240] Using host: 127.4.146.212
I20260811 17:10:11.567569 4683 mini_ranger_kms.cc:276] Ranger KMS PID: 24805
I20260811 17:10:11.567745 4683 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.4.146.212:44835
Aug 11, 2026 5:10:12 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 5:10:12 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 5:10:13 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 5:10:13 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 5:10:13 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 5:10:13 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 17:10:14 dist-test-slave-7vjv krb5kdc[24101](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786468214, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.4.146.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:10:14.604979 4683 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 7.110s user 0.007s sys 0.616s
I20260811 17:10:14.605108 4683 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 17:10:14.605194 4683 mini_ranger_kms.cc:401] 127.4.146.212:44835/kms/v1/keys
Aug 11 17:10:14 dist-test-slave-7vjv krb5kdc[24101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468214, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.4.146.212@KRBTEST.COM for HTTP/127.4.146.212@KRBTEST.COM
Aug 11 17:10:15 dist-test-slave-7vjv krb5kdc[24101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468214, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.4.146.212@KRBTEST.COM for HTTP/127.4.146.212@KRBTEST.COM
Aug 11 17:10:19 dist-test-slave-7vjv krb5kdc[24101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468219, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:10:19.357255 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:35133
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:44387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:35133
--ranger_config_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.146.212:44835/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:10:19.515319 24894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:10:19.515743 24894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:10:19.515830 24894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:10:19.520694 24894 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:10:19.520787 24894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:10:19.520810 24894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:10:19.520829 24894 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:10:19.520848 24894 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:10:19.528375 24894 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:44387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/master-0/wal
--ranger_kms_url=127.4.146.212:44835/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:35133
--ranger_config_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:35133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24894
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:10:19.529628 24894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:10:19.530977 24894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:10:19.542395 24911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:10:19.542624 24894 server_base.cc:1034] running on GCE node
W20260811 17:10:19.542521 24906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:10:19.542475 24908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:10:19.543521 24894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:10:19.544853 24894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:10:19.546079 24894 hybrid_clock.cc:648] HybridClock initialized: now 1786468219546053 us; error 41 us; skew 500 ppm
Aug 11 17:10:19 dist-test-slave-7vjv krb5kdc[24101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468219, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:10:19.549904 24894 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:10:19.551033 24894 webserver.cc:460] Webserver started at http://127.4.146.254:38989/ using document root <none> and password file <none>
I20260811 17:10:19.551666 24894 fs_manager.cc:359] Metadata directory not provided
I20260811 17:10:19.551756 24894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:10:19.552012 24894 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 17:10:19 dist-test-slave-7vjv krb5kdc[24101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468219, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for HTTP/127.4.146.212@KRBTEST.COM
I20260811 17:10:19.625594 24894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "0adda7b156a149208468e2aa791c06e7"
format_stamp: "Formatted at 2026-08-11 17:10:19 on dist-test-slave-7vjv"
server_key: "e61f97fa08256a1bb1c2fb2759761268"
server_key_iv: "36fbddb4ab01fa742a7d2600bd61748d"
server_key_version: "kuduclusterkey@0"
I20260811 17:10:19.626435 24894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "0adda7b156a149208468e2aa791c06e7"
format_stamp: "Formatted at 2026-08-11 17:10:19 on dist-test-slave-7vjv"
server_key: "e61f97fa08256a1bb1c2fb2759761268"
server_key_iv: "36fbddb4ab01fa742a7d2600bd61748d"
server_key_version: "kuduclusterkey@0"
I20260811 17:10:19.630920 24894 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260811 17:10:19.651660 24927 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:10:19.653311 24894 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 17:10:19.653507 24894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "0adda7b156a149208468e2aa791c06e7"
format_stamp: "Formatted at 2026-08-11 17:10:19 on dist-test-slave-7vjv"
server_key: "e61f97fa08256a1bb1c2fb2759761268"
server_key_iv: "36fbddb4ab01fa742a7d2600bd61748d"
server_key_version: "kuduclusterkey@0"
I20260811 17:10:19.653677 24894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:10:19.676481 24894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:10:19.680195 24894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:10:19.680470 24894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:10:19.695878 24894 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:35133
I20260811 17:10:19.695937 25025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:35133 every 8 connection(s)
I20260811 17:10:19.697263 24894 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:10:19.699517 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 24894
I20260811 17:10:19.699666 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:10:19.700021 4683 external_mini_cluster.cc:1428] Setting key cc35bdd0220f40319be8d10d735c3842
I20260811 17:10:19.701185 25027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:10:19.710656 25027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0adda7b156a149208468e2aa791c06e7: Bootstrap starting.
Aug 11 17:10:19 dist-test-slave-7vjv krb5kdc[24101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468219, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:10:19.714061 25027 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0adda7b156a149208468e2aa791c06e7: Neither blocks nor log segments found. Creating new log.
I20260811 17:10:19.716346 25027 log.cc:824] T 00000000000000000000000000000000 P 0adda7b156a149208468e2aa791c06e7: Log is configured to *not* fsync() on all Append() calls
I20260811 17:10:19.719157 25027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0adda7b156a149208468e2aa791c06e7: No bootstrap required, opened a new log
I20260811 17:10:19.719200 25032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:10:19.701803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47644 (local address 127.4.146.254:35133)
0811 17:10:19.702535 (+ 732us) server_negotiation.cc:206] Beginning negotiation
0811 17:10:19.702586 (+ 51us) server_negotiation.cc:399] Waiting for connection header
0811 17:10:19.702759 (+ 173us) server_negotiation.cc:407] Connection header received
0811 17:10:19.704055 (+ 1296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:10:19.704081 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:10:19.704658 (+ 577us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:10:19.705169 (+ 511us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:10:19.706147 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:10:19.707829 (+ 1682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:10:19.709188 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:10:19.709970 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:10:19.710163 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:10:19.713143 (+ 2980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:10:19.713151 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:10:19.713170 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:10:19.713210 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:10:19.715765 (+ 2555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:10:19.716339 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:10:19.716347 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:10:19.716355 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:10:19.716504 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:10:19.716843 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:10:19.716850 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:10:19.716853 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:10:19.717333 (+ 480us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:10:19.717539 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0811 17:10:19.717854 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 17:10:19.718166 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":290,"threads_started":1}
I20260811 17:10:19.723819 25027 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0adda7b156a149208468e2aa791c06e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0adda7b156a149208468e2aa791c06e7" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35133 } }
I20260811 17:10:19.724169 25027 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0adda7b156a149208468e2aa791c06e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:10:19.724238 25027 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0adda7b156a149208468e2aa791c06e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0adda7b156a149208468e2aa791c06e7, State: Initialized, Role: FOLLOWER
I20260811 17:10:19.724694 25027 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0adda7b156a149208468e2aa791c06e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0adda7b156a149208468e2aa791c06e7" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35133 } }
I20260811 17:10:19.724826 25027 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0adda7b156a149208468e2aa791c06e7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:10:19.724871 25027 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0adda7b156a149208468e2aa791c06e7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:10:19.724952 25027 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0adda7b156a149208468e2aa791c06e7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:10:19.726248 25027 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0adda7b156a149208468e2aa791c06e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0adda7b156a149208468e2aa791c06e7" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35133 } }
I20260811 17:10:19.726613 25027 leader_election.cc:302] T 00000000000000000000000000000000 P 0adda7b156a149208468e2aa791c06e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0adda7b156a149208468e2aa791c06e7; no voters:
I20260811 17:10:19.726923 25027 leader_election.cc:288] T 00000000000000000000000000000000 P 0adda7b156a149208468e2aa791c06e7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:10:19.727308 25034 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0adda7b156a149208468e2aa791c06e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:10:19.727790 25034 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0adda7b156a149208468e2aa791c06e7 [term 1 LEADER]: Becoming Leader. State: Replica: 0adda7b156a149208468e2aa791c06e7, State: Running, Role: LEADER
I20260811 17:10:19.728250 25034 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0adda7b156a149208468e2aa791c06e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0adda7b156a149208468e2aa791c06e7" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35133 } }
I20260811 17:10:19.728600 25027 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0adda7b156a149208468e2aa791c06e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:10:19.730335 25037 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0adda7b156a149208468e2aa791c06e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0adda7b156a149208468e2aa791c06e7. Latest consensus state: current_term: 1 leader_uuid: "0adda7b156a149208468e2aa791c06e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0adda7b156a149208468e2aa791c06e7" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35133 } } }
I20260811 17:10:19.730505 25037 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0adda7b156a149208468e2aa791c06e7 [sys.catalog]: This master's current role is: LEADER
I20260811 17:10:19.730353 25035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0adda7b156a149208468e2aa791c06e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0adda7b156a149208468e2aa791c06e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0adda7b156a149208468e2aa791c06e7" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35133 } } }
I20260811 17:10:19.730607 25035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0adda7b156a149208468e2aa791c06e7 [sys.catalog]: This master's current role is: LEADER
I20260811 17:10:19.731256 25058 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:10:19.735291 25058 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:10:19.735922 25027 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 17:10:19.750144 25058 catalog_manager.cc:1347] Generated new cluster ID: e41caa4bf7c744d2b63ee1b3432a1152
I20260811 17:10:19.750247 25058 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:10:19.765151 25058 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:10:19.766202 25058 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:10:19.774451 25058 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0adda7b156a149208468e2aa791c06e7: Generated new TSK 0
I20260811 17:10:19.775449 25058 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
I20260811 17:10:20.592129 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.146.212:44835/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:35133
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:44387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:10:20.755883 25109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:10:20.756381 25109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:10:20.756529 25109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:10:20.762835 25109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:10:20.763000 25109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:10:20.763142 25109 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:10:20.771957 25109 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:44387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.4.146.212:44835/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:35133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25109
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:10:20.774052 25109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:10:20.775625 25109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:10:20.789203 25120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:10:20.789203 25119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:10:20.789234 25127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:10:20.789772 25109 server_base.cc:1034] running on GCE node
I20260811 17:10:20.792359 25109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:10:20.793273 25109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:10:20.794499 25109 hybrid_clock.cc:648] HybridClock initialized: now 1786468220794445 us; error 66 us; skew 500 ppm
Aug 11 17:10:20 dist-test-slave-7vjv krb5kdc[24101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468220, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:10:20.797868 25109 init.cc:377] Logged in from keytab as kudu/127.4.146.193@KRBTEST.COM (short username kudu)
I20260811 17:10:20.799257 25109 webserver.cc:460] Webserver started at http://127.4.146.193:38049/ using document root <none> and password file <none>
I20260811 17:10:20.799964 25109 fs_manager.cc:359] Metadata directory not provided
I20260811 17:10:20.800127 25109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:10:20.800386 25109 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 17:10:20 dist-test-slave-7vjv krb5kdc[24101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468220, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for HTTP/127.4.146.212@KRBTEST.COM
I20260811 17:10:20.818102 25109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "2a011ef5ac584501b59cac3334979f77"
format_stamp: "Formatted at 2026-08-11 17:10:20 on dist-test-slave-7vjv"
server_key: "a5c651166c0f086b99556854abf34e8c"
server_key_iv: "1b191b078499d90cae6ed8649987afc6"
server_key_version: "kuduclusterkey@0"
I20260811 17:10:20.819130 25109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "2a011ef5ac584501b59cac3334979f77"
format_stamp: "Formatted at 2026-08-11 17:10:20 on dist-test-slave-7vjv"
server_key: "a5c651166c0f086b99556854abf34e8c"
server_key_iv: "1b191b078499d90cae6ed8649987afc6"
server_key_version: "kuduclusterkey@0"
I20260811 17:10:20.825420 25109 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260811 17:10:20.848556 25139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:10:20.850487 25109 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.001s sys 0.000s
I20260811 17:10:20.850649 25109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "2a011ef5ac584501b59cac3334979f77"
format_stamp: "Formatted at 2026-08-11 17:10:20 on dist-test-slave-7vjv"
server_key: "a5c651166c0f086b99556854abf34e8c"
server_key_iv: "1b191b078499d90cae6ed8649987afc6"
server_key_version: "kuduclusterkey@0"
I20260811 17:10:20.850821 25109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:10:20.891180 25109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:10:20.895339 25109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:10:20.895561 25109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:10:20.896435 25109 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:10:20.897611 25109 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:10:20.897682 25109 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:10:20.897747 25109 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:10:20.897774 25109 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:10:20.911535 25109 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:38569
I20260811 17:10:20.911747 25359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:38569 every 8 connection(s)
I20260811 17:10:20.912667 25109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:10:20.915000 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 25109
I20260811 17:10:20.915138 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
I20260811 17:10:20.915450 4683 external_mini_cluster.cc:1428] Setting key 8fec7b3c46252241b37f427e81d964a6
Aug 11 17:10:20 dist-test-slave-7vjv krb5kdc[24101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468220, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.146.194@KRBTEST.COM; defaulting to no policy
I20260811 17:10:20.932484 25366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:10:20.915333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:35133 (local address 127.4.146.193:52491)
0811 17:10:20.916467 (+ 1134us) negotiation.cc:107] Waiting for socket to connect
0811 17:10:20.916513 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 17:10:20.917646 (+ 1133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:10:20.918519 (+ 873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:10:20.918531 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:10:20.918944 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:10:20.919743 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:10:20.919770 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:10:20.921019 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:10:20.921024 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:10:20.922266 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:10:20.922277 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:10:20.922832 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:10:20.922838 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:10:20.923101 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:10:20.923915 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:10:20.923943 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:10:20.925992 (+ 2049us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:10:20.928637 (+ 2645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:10:20.928644 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:10:20.928664 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:10:20.929061 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:10:20.929426 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:10:20.929430 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:10:20.929432 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:10:20.929674 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:10:20.930236 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:10:20.930247 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:10:20.930675 (+ 428us) client_negotiation.cc:769] Sending connection context
0811 17:10:20.930888 (+ 213us) client_negotiation.cc:240] Negotiation successful
0811 17:10:20.931383 (+ 495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":899,"thread_start_us":192,"threads_started":1}
I20260811 17:10:20.933375 25363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:10:20.914839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:52491 (local address 127.4.146.254:35133)
0811 17:10:20.916171 (+ 1332us) server_negotiation.cc:206] Beginning negotiation
0811 17:10:20.916176 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:10:20.916618 (+ 442us) server_negotiation.cc:407] Connection header received
0811 17:10:20.917904 (+ 1286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:10:20.917909 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:10:20.917974 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:10:20.918040 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:10:20.919899 (+ 1859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:10:20.920832 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:10:20.922410 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:10:20.922663 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:10:20.922782 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:10:20.926218 (+ 3436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:10:20.926225 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:10:20.926232 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:10:20.926268 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:10:20.928485 (+ 2217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:10:20.929210 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:10:20.929214 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:10:20.929216 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:10:20.929314 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:10:20.929812 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:10:20.929815 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:10:20.929817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:10:20.930092 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:10:20.932966 (+ 2874us) server_negotiation.cc:1035] Waiting for connection context
0811 17:10:20.933056 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 17:10:20.933205 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1208,"thread_start_us":116,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.194@KRBTEST.COM" created.
I20260811 17:10:20.934906 25360 heartbeater.cc:347] Connected to a master server at 127.4.146.254:35133
I20260811 17:10:20.935212 25360 heartbeater.cc:464] Registering TS with master...
I20260811 17:10:20.935907 25360 heartbeater.cc:511] Master 127.4.146.254:35133 requested a full tablet report, sending...
I20260811 17:10:20.938119 24958 ts_manager.cc:194] Registered new tserver with Master: 2a011ef5ac584501b59cac3334979f77 (127.4.146.193:38569)
I20260811 17:10:20.939643 24958 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.193@KRBTEST.COM'} at 127.4.146.193:52491
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
I20260811 17:10:20.960482 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.146.212:44835/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:35133
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:44387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 17:10:20 dist-test-slave-7vjv krb5kdc[24101](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786468220, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 17:10:21.142634 25373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:10:21.143378 25373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:10:21.143537 25373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:10:21.150967 25373 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:10:21.151120 25373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:10:21.151230 25373 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:10:21.159898 25373 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:44387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.4.146.212:44835/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:35133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25373
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:10:21.161230 25373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:10:21.162421 25373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:10:21.176127 25388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:10:21.176137 25389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:10:21.177409 25373 server_base.cc:1034] running on GCE node
W20260811 17:10:21.177189 25391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:10:21.178325 25373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:10:21.179316 25373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:10:21.180770 25373 hybrid_clock.cc:648] HybridClock initialized: now 1786468221180684 us; error 113 us; skew 500 ppm
Aug 11 17:10:21 dist-test-slave-7vjv krb5kdc[24101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468221, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:10:21.185322 25373 init.cc:377] Logged in from keytab as kudu/127.4.146.194@KRBTEST.COM (short username kudu)
I20260811 17:10:21.186784 25373 webserver.cc:460] Webserver started at http://127.4.146.194:44315/ using document root <none> and password file <none>
I20260811 17:10:21.187624 25373 fs_manager.cc:359] Metadata directory not provided
I20260811 17:10:21.187733 25373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:10:21.188030 25373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 17:10:21 dist-test-slave-7vjv krb5kdc[24101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468221, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for HTTP/127.4.146.212@KRBTEST.COM
I20260811 17:10:21.208825 25373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "1258148a3a2a4caaba71da1feb4c276c"
format_stamp: "Formatted at 2026-08-11 17:10:21 on dist-test-slave-7vjv"
server_key: "d81926716bf6843a9448ed13b92cfe9d"
server_key_iv: "8524f34196a220f989dfa978dacd99ba"
server_key_version: "kuduclusterkey@0"
I20260811 17:10:21.209764 25373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "1258148a3a2a4caaba71da1feb4c276c"
format_stamp: "Formatted at 2026-08-11 17:10:21 on dist-test-slave-7vjv"
server_key: "d81926716bf6843a9448ed13b92cfe9d"
server_key_iv: "8524f34196a220f989dfa978dacd99ba"
server_key_version: "kuduclusterkey@0"
I20260811 17:10:21.226332 25373 fs_manager.cc:691] Time spent creating directory manager: real 0.016s user 0.003s sys 0.005s
I20260811 17:10:21.258605 25402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:10:21.260560 25373 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.005s sys 0.000s
I20260811 17:10:21.260751 25373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "1258148a3a2a4caaba71da1feb4c276c"
format_stamp: "Formatted at 2026-08-11 17:10:21 on dist-test-slave-7vjv"
server_key: "d81926716bf6843a9448ed13b92cfe9d"
server_key_iv: "8524f34196a220f989dfa978dacd99ba"
server_key_version: "kuduclusterkey@0"
I20260811 17:10:21.260937 25373 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:10:21.288573 25373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:10:21.292423 25373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:10:21.292647 25373 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:10:21.293282 25373 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:10:21.294240 25373 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:10:21.294291 25373 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:10:21.294333 25373 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:10:21.294355 25373 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:10:21.307134 25373 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:44313
I20260811 17:10:21.307304 25592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:44313 every 8 connection(s)
I20260811 17:10:21.308377 25373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:10:21.317735 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 25373
I20260811 17:10:21.317911 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:10:21.318322 4683 external_mini_cluster.cc:1428] Setting key f2330c5b41dcae10be62c7399306d4b7
Aug 11 17:10:21 dist-test-slave-7vjv krb5kdc[24101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468221, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:10:21.327384 25363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:10:21.310568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:59681 (local address 127.4.146.254:35133)
0811 17:10:21.310744 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 17:10:21.310749 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:10:21.311877 (+ 1128us) server_negotiation.cc:407] Connection header received
0811 17:10:21.313165 (+ 1288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:10:21.313169 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:10:21.313239 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:10:21.313367 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:10:21.314707 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:10:21.315300 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:10:21.316774 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:10:21.317119 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:10:21.317246 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:10:21.321211 (+ 3965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:10:21.321219 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:10:21.321226 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:10:21.321266 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:10:21.323573 (+ 2307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:10:21.324564 (+ 991us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:10:21.324570 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:10:21.324575 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:10:21.324686 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:10:21.325329 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:10:21.325336 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:10:21.325340 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:10:21.325798 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:10:21.325925 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 17:10:21.326904 (+ 979us) server_negotiation.cc:299] Negotiation successful
0811 17:10:21.327121 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 17:10:21.328243 25598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:10:21.311079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:35133 (local address 127.4.146.194:59681)
0811 17:10:21.311678 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0811 17:10:21.311746 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 17:10:21.312884 (+ 1138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:10:21.313595 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:10:21.313603 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:10:21.313939 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:10:21.314527 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:10:21.314544 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:10:21.315461 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:10:21.315470 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:10:21.316595 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:10:21.316609 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:10:21.317320 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:10:21.317325 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:10:21.317611 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:10:21.318618 (+ 1007us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:10:21.318647 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:10:21.320905 (+ 2258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:10:21.323773 (+ 2868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:10:21.323784 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:10:21.323810 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:10:21.324396 (+ 586us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:10:21.324869 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:10:21.324874 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:10:21.324878 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:10:21.325166 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:10:21.326075 (+ 909us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:10:21.326085 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:10:21.326521 (+ 436us) client_negotiation.cc:769] Sending connection context
0811 17:10:21.326731 (+ 210us) client_negotiation.cc:240] Negotiation successful
0811 17:10:21.327075 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":203,"threads_started":1}
I20260811 17:10:21.329892 25594 heartbeater.cc:347] Connected to a master server at 127.4.146.254:35133
I20260811 17:10:21.330338 25594 heartbeater.cc:464] Registering TS with master...
I20260811 17:10:21.331240 25594 heartbeater.cc:511] Master 127.4.146.254:35133 requested a full tablet report, sending...
I20260811 17:10:21.333015 24958 ts_manager.cc:194] Registered new tserver with Master: 1258148a3a2a4caaba71da1feb4c276c (127.4.146.194:44313)
I20260811 17:10:21.334149 24958 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.194@KRBTEST.COM'} at 127.4.146.194:59681
WARNING: no policy specified for kudu/127.4.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
I20260811 17:10:21.364015 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.146.212:44835/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:35133
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:44387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 17:10:21 dist-test-slave-7vjv krb5kdc[24101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468220, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for HTTP/127.4.146.212@KRBTEST.COM
W20260811 17:10:21.562067 25601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:10:21.562644 25601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:10:21.562768 25601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:10:21.569357 25601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:10:21.569543 25601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:10:21.569718 25601 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:10:21.578310 25601 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:44387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.4.146.212:44835/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:35133
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25601
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:10:21.580255 25601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:10:21.581883 25601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:10:21.597591 25615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:10:21.597672 25612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:10:21.598102 25611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:10:21.598536 25601 server_base.cc:1034] running on GCE node
I20260811 17:10:21.599105 25601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:10:21.600039 25601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:10:21.601662 25601 hybrid_clock.cc:648] HybridClock initialized: now 1786468221601583 us; error 94 us; skew 500 ppm
Aug 11 17:10:21 dist-test-slave-7vjv krb5kdc[24101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468221, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:10:21.609529 25601 init.cc:377] Logged in from keytab as kudu/127.4.146.195@KRBTEST.COM (short username kudu)
I20260811 17:10:21.610983 25601 webserver.cc:460] Webserver started at http://127.4.146.195:42613/ using document root <none> and password file <none>
I20260811 17:10:21.611845 25601 fs_manager.cc:359] Metadata directory not provided
I20260811 17:10:21.612006 25601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:10:21.612345 25601 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 17:10:21 dist-test-slave-7vjv krb5kdc[24101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468221, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for HTTP/127.4.146.212@KRBTEST.COM
I20260811 17:10:21.650782 25601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "c6963836c1fd411fae6240b9500a2f75"
format_stamp: "Formatted at 2026-08-11 17:10:21 on dist-test-slave-7vjv"
server_key: "4e0e0766a70806e79ee05f4da7f7087e"
server_key_iv: "0a67eb4ccfc1844e1a701b41acbdb222"
server_key_version: "kuduclusterkey@0"
I20260811 17:10:21.651829 25601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "c6963836c1fd411fae6240b9500a2f75"
format_stamp: "Formatted at 2026-08-11 17:10:21 on dist-test-slave-7vjv"
server_key: "4e0e0766a70806e79ee05f4da7f7087e"
server_key_iv: "0a67eb4ccfc1844e1a701b41acbdb222"
server_key_version: "kuduclusterkey@0"
I20260811 17:10:21.662992 25601 fs_manager.cc:691] Time spent creating directory manager: real 0.011s user 0.004s sys 0.000s
I20260811 17:10:21.723251 25626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:10:21.725335 25601 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.003s sys 0.001s
I20260811 17:10:21.725502 25601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "c6963836c1fd411fae6240b9500a2f75"
format_stamp: "Formatted at 2026-08-11 17:10:21 on dist-test-slave-7vjv"
server_key: "4e0e0766a70806e79ee05f4da7f7087e"
server_key_iv: "0a67eb4ccfc1844e1a701b41acbdb222"
server_key_version: "kuduclusterkey@0"
I20260811 17:10:21.725662 25601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:10:21.767405 25601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:10:21.771548 25601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:10:21.771836 25601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:10:21.772740 25601 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:10:21.774461 25601 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:10:21.774621 25601 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:10:21.774739 25601 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:10:21.775249 25601 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 17:10:21.792662 25601 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:39261
I20260811 17:10:21.792917 25838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:39261 every 8 connection(s)
I20260811 17:10:21.793982 25601 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:10:21.804050 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 25601
I20260811 17:10:21.804244 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:10:21.804550 4683 external_mini_cluster.cc:1428] Setting key 64242d4c8d222ccdb4ca75678ddd2254
Aug 11 17:10:21 dist-test-slave-7vjv krb5kdc[24101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468221, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:10:21.813036 25363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:10:21.796450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:49769 (local address 127.4.146.254:35133)
0811 17:10:21.796606 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 17:10:21.796611 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:10:21.797872 (+ 1261us) server_negotiation.cc:407] Connection header received
0811 17:10:21.799269 (+ 1397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:10:21.799273 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:10:21.799333 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:10:21.799438 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:10:21.801239 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:10:21.802047 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:10:21.804225 (+ 2178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:10:21.804617 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:10:21.804707 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:10:21.808254 (+ 3547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:10:21.808258 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:10:21.808261 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:10:21.808292 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:10:21.810229 (+ 1937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:10:21.810989 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:10:21.810993 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:10:21.810995 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:10:21.811097 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:10:21.811586 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:10:21.811589 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:10:21.811591 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:10:21.811837 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:10:21.811940 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 17:10:21.812723 (+ 783us) server_negotiation.cc:299] Negotiation successful
0811 17:10:21.812869 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 17:10:21.814159 25844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:10:21.797007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:35133 (local address 127.4.146.195:49769)
0811 17:10:21.797672 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0811 17:10:21.797739 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 17:10:21.798975 (+ 1236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:10:21.799701 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:10:21.799712 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:10:21.800206 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:10:21.800990 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:10:21.801045 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:10:21.802219 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:10:21.802223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:10:21.804000 (+ 1777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:10:21.804014 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:10:21.805212 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:10:21.805216 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:10:21.805437 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:10:21.806204 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:10:21.806240 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:10:21.808035 (+ 1795us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:10:21.810367 (+ 2332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:10:21.810376 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:10:21.810399 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:10:21.810856 (+ 457us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:10:21.811213 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:10:21.811217 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:10:21.811219 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:10:21.811461 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:10:21.811965 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:10:21.811973 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:10:21.812398 (+ 425us) client_negotiation.cc:769] Sending connection context
0811 17:10:21.812617 (+ 219us) client_negotiation.cc:240] Negotiation successful
0811 17:10:21.813000 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":175,"threads_started":1}
I20260811 17:10:21.815562 25840 heartbeater.cc:347] Connected to a master server at 127.4.146.254:35133
I20260811 17:10:21.815874 25840 heartbeater.cc:464] Registering TS with master...
I20260811 17:10:21.816630 25840 heartbeater.cc:511] Master 127.4.146.254:35133 requested a full tablet report, sending...
I20260811 17:10:21.817930 24958 ts_manager.cc:194] Registered new tserver with Master: c6963836c1fd411fae6240b9500a2f75 (127.4.146.195:39261)
I20260811 17:10:21.818707 24958 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.195@KRBTEST.COM'} at 127.4.146.195:49769
I20260811 17:10:21.822769 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 17:10:21.838996 25363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:10:21.825839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47656 (local address 127.4.146.254:35133)
0811 17:10:21.825967 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 17:10:21.825972 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:10:21.828636 (+ 2664us) server_negotiation.cc:407] Connection header received
0811 17:10:21.828859 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:10:21.828863 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:10:21.828921 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:10:21.828978 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:10:21.830104 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:10:21.830910 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:10:21.832210 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:10:21.832531 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:10:21.832620 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:10:21.834723 (+ 2103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:10:21.834727 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:10:21.834730 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:10:21.834767 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:10:21.836711 (+ 1944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:10:21.837401 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:10:21.837405 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:10:21.837407 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:10:21.837508 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:10:21.837854 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:10:21.837857 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:10:21.837859 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:10:21.838125 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:10:21.838238 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 17:10:21.838666 (+ 428us) server_negotiation.cc:299] Negotiation successful
0811 17:10:21.838817 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 17:10:21.843641 24958 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47656:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 17:10:21.848531 24958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
Aug 11 17:10:21 dist-test-slave-7vjv krb5kdc[24101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468220, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for HTTP/127.4.146.212@KRBTEST.COM
I20260811 17:10:21.874197 25870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:10:21.861517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:44313 (local address 127.0.0.1:49634)
0811 17:10:21.865561 (+ 4044us) negotiation.cc:107] Waiting for socket to connect
0811 17:10:21.865629 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 17:10:21.866480 (+ 851us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:10:21.867529 (+ 1049us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:10:21.867535 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:10:21.867560 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:10:21.867701 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:10:21.867708 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:10:21.869985 (+ 2277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:10:21.869988 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:10:21.872141 (+ 2153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:10:21.872156 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:10:21.873605 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:10:21.873609 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:10:21.873726 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:10:21.873769 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 17:10:21.873890 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 17:10:21.874023 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3826,"thread_start_us":121,"threads_started":1}
I20260811 17:10:21.875104 25866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:10:21.862386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49634 (local address 127.4.146.194:44313)
0811 17:10:21.862826 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0811 17:10:21.862834 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 17:10:21.866568 (+ 3734us) server_negotiation.cc:407] Connection header received
0811 17:10:21.866673 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:10:21.866679 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:10:21.867153 (+ 474us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:10:21.867325 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:10:21.867841 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:10:21.869851 (+ 2010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:10:21.872309 (+ 2458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:10:21.873241 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:10:21.873360 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:10:21.873533 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 17:10:21.874825 (+ 1292us) server_negotiation.cc:299] Negotiation successful
0811 17:10:21.874944 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":189,"threads_started":1}
I20260811 17:10:21.878839 25482 tablet_service.cc:1467] Processing CreateTablet for tablet 6f3956fdacd94d72a48b46cc5a155e68 (DEFAULT_TABLE table=test-table [id=d94def9357bc4c11982eb7a6424e2494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:10:21.880242 25482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f3956fdacd94d72a48b46cc5a155e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:10:21.882223 25865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:10:21.863969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:39261 (local address 127.0.0.1:56038)
0811 17:10:21.866722 (+ 2753us) negotiation.cc:107] Waiting for socket to connect
0811 17:10:21.866733 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 17:10:21.867071 (+ 338us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:10:21.873152 (+ 6081us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:10:21.873156 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:10:21.873178 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:10:21.873280 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:10:21.873286 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:10:21.875776 (+ 2490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:10:21.875779 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:10:21.877018 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:10:21.877030 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:10:21.881746 (+ 4716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:10:21.881750 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:10:21.881852 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:10:21.881879 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 17:10:21.881953 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 17:10:21.882041 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2690,"thread_start_us":243,"threads_started":1}
I20260811 17:10:21.883219 25869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:10:21.864867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:38569 (local address 127.0.0.1:56108)
0811 17:10:21.866908 (+ 2041us) negotiation.cc:107] Waiting for socket to connect
0811 17:10:21.866921 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 17:10:21.866992 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:10:21.874214 (+ 7222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:10:21.874217 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:10:21.874236 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:10:21.874317 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:10:21.874322 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:10:21.880246 (+ 5924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:10:21.880253 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:10:21.881433 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:10:21.881449 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:10:21.882817 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:10:21.882821 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:10:21.882914 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:10:21.882942 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 17:10:21.883027 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 17:10:21.883108 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1991,"thread_start_us":159,"threads_started":1}
I20260811 17:10:21.884425 25873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:10:21.864281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56038 (local address 127.4.146.195:39261)
0811 17:10:21.872358 (+ 8077us) server_negotiation.cc:206] Beginning negotiation
0811 17:10:21.872371 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 17:10:21.872400 (+ 29us) server_negotiation.cc:407] Connection header received
0811 17:10:21.872492 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:10:21.872499 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:10:21.872765 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:10:21.872957 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:10:21.874464 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:10:21.875633 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:10:21.880450 (+ 4817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:10:21.881337 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:10:21.881469 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:10:21.881676 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0811 17:10:21.882824 (+ 1148us) server_negotiation.cc:299] Negotiation successful
0811 17:10:21.882963 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7934,"thread_start_us":167,"threads_started":1}
I20260811 17:10:21.888442 25695 tablet_service.cc:1467] Processing CreateTablet for tablet 6f3956fdacd94d72a48b46cc5a155e68 (DEFAULT_TABLE table=test-table [id=d94def9357bc4c11982eb7a6424e2494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:10:21.889895 25695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f3956fdacd94d72a48b46cc5a155e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:10:21.891918 25874 tablet_bootstrap.cc:492] T 6f3956fdacd94d72a48b46cc5a155e68 P 1258148a3a2a4caaba71da1feb4c276c: Bootstrap starting.
I20260811 17:10:21.894517 25874 tablet_bootstrap.cc:654] T 6f3956fdacd94d72a48b46cc5a155e68 P 1258148a3a2a4caaba71da1feb4c276c: Neither blocks nor log segments found. Creating new log.
I20260811 17:10:21.895488 25874 log.cc:824] T 6f3956fdacd94d72a48b46cc5a155e68 P 1258148a3a2a4caaba71da1feb4c276c: Log is configured to *not* fsync() on all Append() calls
I20260811 17:10:21.896543 25871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:10:21.864990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56108 (local address 127.4.146.193:38569)
0811 17:10:21.873598 (+ 8608us) server_negotiation.cc:206] Beginning negotiation
0811 17:10:21.873605 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:10:21.873631 (+ 26us) server_negotiation.cc:407] Connection header received
0811 17:10:21.873708 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:10:21.873713 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:10:21.873908 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:10:21.874054 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:10:21.877196 (+ 3142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:10:21.878221 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:10:21.881592 (+ 3371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:10:21.882467 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:10:21.882581 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:10:21.882747 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 17:10:21.896220 (+ 13473us) server_negotiation.cc:299] Negotiation successful
0811 17:10:21.896375 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8475,"thread_start_us":122,"threads_started":1}
I20260811 17:10:21.898077 25874 tablet_bootstrap.cc:492] T 6f3956fdacd94d72a48b46cc5a155e68 P 1258148a3a2a4caaba71da1feb4c276c: No bootstrap required, opened a new log
I20260811 17:10:21.898303 25874 ts_tablet_manager.cc:1397] T 6f3956fdacd94d72a48b46cc5a155e68 P 1258148a3a2a4caaba71da1feb4c276c: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 17:10:21.899724 25239 tablet_service.cc:1467] Processing CreateTablet for tablet 6f3956fdacd94d72a48b46cc5a155e68 (DEFAULT_TABLE table=test-table [id=d94def9357bc4c11982eb7a6424e2494]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:10:21.900941 25239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f3956fdacd94d72a48b46cc5a155e68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:10:21.903792 25874 raft_consensus.cc:348] T 6f3956fdacd94d72a48b46cc5a155e68 P 1258148a3a2a4caaba71da1feb4c276c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1258148a3a2a4caaba71da1feb4c276c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 44313 } } peers { permanent_uuid: "c6963836c1fd411fae6240b9500a2f75" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39261 } } peers { permanent_uuid: "2a011ef5ac584501b59cac3334979f77" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38569 } }
I20260811 17:10:21.904165 25874 raft_consensus.cc:374] T 6f3956fdacd94d72a48b46cc5a155e68 P 1258148a3a2a4caaba71da1feb4c276c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:10:21.904233 25874 raft_consensus.cc:729] T 6f3956fdacd94d72a48b46cc5a155e68 P 1258148a3a2a4caaba71da1feb4c276c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1258148a3a2a4caaba71da1feb4c276c, State: Initialized, Role: FOLLOWER
I20260811 17:10:21.904764 25874 consensus_queue.cc:260] T 6f3956fdacd94d72a48b46cc5a155e68 P 1258148a3a2a4caaba71da1feb4c276c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1258148a3a2a4caaba71da1feb4c276c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 44313 } } peers { permanent_uuid: "c6963836c1fd411fae6240b9500a2f75" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39261 } } peers { permanent_uuid: "2a011ef5ac584501b59cac3334979f77" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38569 } }
I20260811 17:10:21.904825 25877 tablet_bootstrap.cc:492] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75: Bootstrap starting.
I20260811 17:10:21.906011 25874 ts_tablet_manager.cc:1428] T 6f3956fdacd94d72a48b46cc5a155e68 P 1258148a3a2a4caaba71da1feb4c276c: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
I20260811 17:10:21.906426 25594 heartbeater.cc:503] Master 127.4.146.254:35133 was elected leader, sending a full tablet report...
I20260811 17:10:21.908242 25877 tablet_bootstrap.cc:654] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75: Neither blocks nor log segments found. Creating new log.
I20260811 17:10:21.912473 25877 log.cc:824] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75: Log is configured to *not* fsync() on all Append() calls
I20260811 17:10:21.916488 25881 tablet_bootstrap.cc:492] T 6f3956fdacd94d72a48b46cc5a155e68 P 2a011ef5ac584501b59cac3334979f77: Bootstrap starting.
I20260811 17:10:21.919588 25881 tablet_bootstrap.cc:654] T 6f3956fdacd94d72a48b46cc5a155e68 P 2a011ef5ac584501b59cac3334979f77: Neither blocks nor log segments found. Creating new log.
I20260811 17:10:21.920504 25881 log.cc:824] T 6f3956fdacd94d72a48b46cc5a155e68 P 2a011ef5ac584501b59cac3334979f77: Log is configured to *not* fsync() on all Append() calls
I20260811 17:10:21.929378 25881 tablet_bootstrap.cc:492] T 6f3956fdacd94d72a48b46cc5a155e68 P 2a011ef5ac584501b59cac3334979f77: No bootstrap required, opened a new log
I20260811 17:10:21.929716 25881 ts_tablet_manager.cc:1397] T 6f3956fdacd94d72a48b46cc5a155e68 P 2a011ef5ac584501b59cac3334979f77: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.000s
I20260811 17:10:21.934955 25881 raft_consensus.cc:348] T 6f3956fdacd94d72a48b46cc5a155e68 P 2a011ef5ac584501b59cac3334979f77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1258148a3a2a4caaba71da1feb4c276c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 44313 } } peers { permanent_uuid: "c6963836c1fd411fae6240b9500a2f75" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39261 } } peers { permanent_uuid: "2a011ef5ac584501b59cac3334979f77" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38569 } }
I20260811 17:10:21.935420 25881 raft_consensus.cc:374] T 6f3956fdacd94d72a48b46cc5a155e68 P 2a011ef5ac584501b59cac3334979f77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:10:21.935516 25881 raft_consensus.cc:729] T 6f3956fdacd94d72a48b46cc5a155e68 P 2a011ef5ac584501b59cac3334979f77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a011ef5ac584501b59cac3334979f77, State: Initialized, Role: FOLLOWER
I20260811 17:10:21.936230 25881 consensus_queue.cc:260] T 6f3956fdacd94d72a48b46cc5a155e68 P 2a011ef5ac584501b59cac3334979f77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1258148a3a2a4caaba71da1feb4c276c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 44313 } } peers { permanent_uuid: "c6963836c1fd411fae6240b9500a2f75" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39261 } } peers { permanent_uuid: "2a011ef5ac584501b59cac3334979f77" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38569 } }
I20260811 17:10:21.937628 25881 ts_tablet_manager.cc:1428] T 6f3956fdacd94d72a48b46cc5a155e68 P 2a011ef5ac584501b59cac3334979f77: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260811 17:10:21.937866 25877 tablet_bootstrap.cc:492] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75: No bootstrap required, opened a new log
I20260811 17:10:21.938060 25360 heartbeater.cc:503] Master 127.4.146.254:35133 was elected leader, sending a full tablet report...
I20260811 17:10:21.938213 25877 ts_tablet_manager.cc:1397] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75: Time spent bootstrapping tablet: real 0.034s user 0.003s sys 0.004s
I20260811 17:10:21.942427 25877 raft_consensus.cc:348] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1258148a3a2a4caaba71da1feb4c276c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 44313 } } peers { permanent_uuid: "c6963836c1fd411fae6240b9500a2f75" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39261 } } peers { permanent_uuid: "2a011ef5ac584501b59cac3334979f77" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38569 } }
I20260811 17:10:21.944870 25877 raft_consensus.cc:374] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:10:21.944984 25877 raft_consensus.cc:729] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6963836c1fd411fae6240b9500a2f75, State: Initialized, Role: FOLLOWER
I20260811 17:10:21.945616 25877 consensus_queue.cc:260] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1258148a3a2a4caaba71da1feb4c276c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 44313 } } peers { permanent_uuid: "c6963836c1fd411fae6240b9500a2f75" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39261 } } peers { permanent_uuid: "2a011ef5ac584501b59cac3334979f77" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38569 } }
I20260811 17:10:21.946924 25877 ts_tablet_manager.cc:1428] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75: Time spent starting tablet: real 0.009s user 0.005s sys 0.001s
I20260811 17:10:21.947391 25840 heartbeater.cc:503] Master 127.4.146.254:35133 was elected leader, sending a full tablet report...
W20260811 17:10:22.046532 25841 tablet.cc:2369] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 17:10:22.061097 25595 tablet.cc:2369] T 6f3956fdacd94d72a48b46cc5a155e68 P 1258148a3a2a4caaba71da1feb4c276c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 17:10:22.104972 25889 raft_consensus.cc:482] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:10:22.105271 25889 raft_consensus.cc:504] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1258148a3a2a4caaba71da1feb4c276c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 44313 } } peers { permanent_uuid: "c6963836c1fd411fae6240b9500a2f75" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39261 } } peers { permanent_uuid: "2a011ef5ac584501b59cac3334979f77" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38569 } }
I20260811 17:10:22.106807 25889 leader_election.cc:288] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1258148a3a2a4caaba71da1feb4c276c (127.4.146.194:44313), 2a011ef5ac584501b59cac3334979f77 (127.4.146.193:38569)
I20260811 17:10:22.112412 25844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:10:22.107278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:38569 (local address 127.4.146.195:35229)
0811 17:10:22.107442 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 17:10:22.107475 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 17:10:22.107598 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:10:22.108076 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:10:22.108079 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:10:22.108125 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:10:22.108263 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:10:22.108271 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:10:22.109536 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:10:22.109540 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:10:22.110829 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:10:22.110842 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:10:22.111891 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:10:22.111895 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:10:22.112012 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:10:22.112041 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 17:10:22.112157 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 17:10:22.112254 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 17:10:22.113220 25871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:10:22.107663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:35229 (local address 127.4.146.193:38569)
0811 17:10:22.107799 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 17:10:22.107807 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 17:10:22.107829 (+ 22us) server_negotiation.cc:407] Connection header received
0811 17:10:22.107900 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:10:22.107903 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:10:22.107960 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:10:22.108061 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:10:22.108424 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:10:22.109237 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:10:22.110998 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:10:22.111627 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:10:22.111758 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:10:22.111820 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 17:10:22.113001 (+ 1181us) server_negotiation.cc:299] Negotiation successful
0811 17:10:22.113096 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 17:10:22.114482 25268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f3956fdacd94d72a48b46cc5a155e68" candidate_uuid: "c6963836c1fd411fae6240b9500a2f75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a011ef5ac584501b59cac3334979f77" is_pre_election: true
I20260811 17:10:22.114898 25268 raft_consensus.cc:2454] T 6f3956fdacd94d72a48b46cc5a155e68 P 2a011ef5ac584501b59cac3334979f77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6963836c1fd411fae6240b9500a2f75 in term 0.
I20260811 17:10:22.115595 25627 leader_election.cc:302] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a011ef5ac584501b59cac3334979f77, c6963836c1fd411fae6240b9500a2f75; no voters:
I20260811 17:10:22.115996 25889 raft_consensus.cc:2781] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:10:22.116168 25889 raft_consensus.cc:482] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:10:22.116232 25889 raft_consensus.cc:3037] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:10:22.118000 25889 raft_consensus.cc:504] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1258148a3a2a4caaba71da1feb4c276c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 44313 } } peers { permanent_uuid: "c6963836c1fd411fae6240b9500a2f75" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39261 } } peers { permanent_uuid: "2a011ef5ac584501b59cac3334979f77" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38569 } }
I20260811 17:10:22.118520 25889 leader_election.cc:288] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75 [CANDIDATE]: Term 1 election: Requested vote from peers 1258148a3a2a4caaba71da1feb4c276c (127.4.146.194:44313), 2a011ef5ac584501b59cac3334979f77 (127.4.146.193:38569)
I20260811 17:10:22.119225 25268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f3956fdacd94d72a48b46cc5a155e68" candidate_uuid: "c6963836c1fd411fae6240b9500a2f75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a011ef5ac584501b59cac3334979f77"
I20260811 17:10:22.119397 25268 raft_consensus.cc:3037] T 6f3956fdacd94d72a48b46cc5a155e68 P 2a011ef5ac584501b59cac3334979f77 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:10:22.121147 25268 raft_consensus.cc:2454] T 6f3956fdacd94d72a48b46cc5a155e68 P 2a011ef5ac584501b59cac3334979f77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6963836c1fd411fae6240b9500a2f75 in term 1.
I20260811 17:10:22.121740 25627 leader_election.cc:302] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a011ef5ac584501b59cac3334979f77, c6963836c1fd411fae6240b9500a2f75; no voters:
I20260811 17:10:22.122020 25889 raft_consensus.cc:2781] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:10:22.122287 25889 raft_consensus.cc:686] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75 [term 1 LEADER]: Becoming Leader. State: Replica: c6963836c1fd411fae6240b9500a2f75, State: Running, Role: LEADER
I20260811 17:10:22.122740 25889 consensus_queue.cc:237] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1258148a3a2a4caaba71da1feb4c276c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 44313 } } peers { permanent_uuid: "c6963836c1fd411fae6240b9500a2f75" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39261 } } peers { permanent_uuid: "2a011ef5ac584501b59cac3334979f77" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38569 } }
I20260811 17:10:22.126979 24958 catalog_manager.cc:5495] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6963836c1fd411fae6240b9500a2f75 (127.4.146.195). New cstate: current_term: 1 leader_uuid: "c6963836c1fd411fae6240b9500a2f75" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1258148a3a2a4caaba71da1feb4c276c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 44313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6963836c1fd411fae6240b9500a2f75" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 39261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a011ef5ac584501b59cac3334979f77" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38569 } health_report { overall_health: UNKNOWN } } }
I20260811 17:10:22.131903 25866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:10:22.108494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:49865 (local address 127.4.146.194:44313)
0811 17:10:22.109456 (+ 962us) server_negotiation.cc:206] Beginning negotiation
0811 17:10:22.109474 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 17:10:22.112252 (+ 2778us) server_negotiation.cc:407] Connection header received
0811 17:10:22.112491 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:10:22.112495 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:10:22.112558 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:10:22.112614 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:10:22.113106 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:10:22.113985 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:10:22.129186 (+ 15201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:10:22.129972 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:10:22.130127 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:10:22.130191 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 17:10:22.131621 (+ 1430us) server_negotiation.cc:299] Negotiation successful
0811 17:10:22.131733 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":864}
I20260811 17:10:22.132542 25891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:10:22.107971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:44313 (local address 127.4.146.195:49865)
0811 17:10:22.112132 (+ 4161us) negotiation.cc:107] Waiting for socket to connect
0811 17:10:22.112153 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 17:10:22.112348 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:10:22.112770 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:10:22.112774 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:10:22.112793 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:10:22.112939 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:10:22.112960 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:10:22.115366 (+ 2406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:10:22.115370 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:10:22.126104 (+ 10734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:10:22.126124 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:10:22.131244 (+ 5120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:10:22.131252 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:10:22.131402 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:10:22.131446 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 17:10:22.132246 (+ 800us) client_negotiation.cc:240] Negotiation successful
0811 17:10:22.132356 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4030,"thread_start_us":183,"threads_started":1}
I20260811 17:10:22.133554 25516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f3956fdacd94d72a48b46cc5a155e68" candidate_uuid: "c6963836c1fd411fae6240b9500a2f75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1258148a3a2a4caaba71da1feb4c276c" is_pre_election: true
I20260811 17:10:22.133963 25516 raft_consensus.cc:2454] T 6f3956fdacd94d72a48b46cc5a155e68 P 1258148a3a2a4caaba71da1feb4c276c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6963836c1fd411fae6240b9500a2f75 in term 0.
I20260811 17:10:22.134409 25515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f3956fdacd94d72a48b46cc5a155e68" candidate_uuid: "c6963836c1fd411fae6240b9500a2f75" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1258148a3a2a4caaba71da1feb4c276c"
I20260811 17:10:22.134547 25515 raft_consensus.cc:3037] T 6f3956fdacd94d72a48b46cc5a155e68 P 1258148a3a2a4caaba71da1feb4c276c [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:10:22.136190 25515 raft_consensus.cc:2454] T 6f3956fdacd94d72a48b46cc5a155e68 P 1258148a3a2a4caaba71da1feb4c276c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6963836c1fd411fae6240b9500a2f75 in term 1.
W20260811 17:10:22.168721 25362 tablet.cc:2369] T 6f3956fdacd94d72a48b46cc5a155e68 P 2a011ef5ac584501b59cac3334979f77: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 17:10:22.176657 25873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:10:22.170074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56050 (local address 127.4.146.195:39261)
0811 17:10:22.170267 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 17:10:22.170273 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:10:22.170290 (+ 17us) server_negotiation.cc:407] Connection header received
0811 17:10:22.170399 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:10:22.170402 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:10:22.170501 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:10:22.170631 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:10:22.171425 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:10:22.172602 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:10:22.174017 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:10:22.174366 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:10:22.174488 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:10:22.175030 (+ 542us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:10:22.175700 (+ 670us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:10:22.175840 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 17:10:22.176398 (+ 558us) server_negotiation.cc:299] Negotiation successful
0811 17:10:22.176479 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260811 17:10:22.185887 25268 raft_consensus.cc:1261] T 6f3956fdacd94d72a48b46cc5a155e68 P 2a011ef5ac584501b59cac3334979f77 [term 1 FOLLOWER]: Refusing update from remote peer c6963836c1fd411fae6240b9500a2f75: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:10:22.186729 25515 raft_consensus.cc:1261] T 6f3956fdacd94d72a48b46cc5a155e68 P 1258148a3a2a4caaba71da1feb4c276c [term 1 FOLLOWER]: Refusing update from remote peer c6963836c1fd411fae6240b9500a2f75: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:10:22.187024 25892 consensus_queue.cc:1035] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a011ef5ac584501b59cac3334979f77" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:10:22.187578 25889 consensus_queue.cc:1035] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1258148a3a2a4caaba71da1feb4c276c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 44313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:10:22.198094 25905 mvcc.cc:205] Tried to move back new op lower bound from 7317373838060113920 to 7317373837818839040. Current Snapshot: MvccSnapshot[applied={T|T < 7317373838060113920}]
I20260811 17:10:22.200400 25913 mvcc.cc:205] Tried to move back new op lower bound from 7317373838060113920 to 7317373837818839040. Current Snapshot: MvccSnapshot[applied={T|T < 7317373838060113920}]
I20260811 17:10:22.202081 25911 mvcc.cc:205] Tried to move back new op lower bound from 7317373838060113920 to 7317373837818839040. Current Snapshot: MvccSnapshot[applied={T|T < 7317373838060113920}]
I20260811 17:10:22.215590 24958 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47656:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:10:22.215791 24958 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47656:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:10:22.218988 24958 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0adda7b156a149208468e2aa791c06e7: Sending DeleteTablet for 3 replicas of tablet 6f3956fdacd94d72a48b46cc5a155e68
I20260811 17:10:22.220348 25239 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f3956fdacd94d72a48b46cc5a155e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:10:22 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:56108
I20260811 17:10:22.220544 25482 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f3956fdacd94d72a48b46cc5a155e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:10:22 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:49634
I20260811 17:10:22.220542 25695 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f3956fdacd94d72a48b46cc5a155e68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:10:22 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:56038
I20260811 17:10:22.222050 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 25109
I20260811 17:10:22.228497 25933 tablet_replica.cc:330] T 6f3956fdacd94d72a48b46cc5a155e68 P 1258148a3a2a4caaba71da1feb4c276c: stopping tablet replica
I20260811 17:10:22.229076 25933 raft_consensus.cc:2229] T 6f3956fdacd94d72a48b46cc5a155e68 P 1258148a3a2a4caaba71da1feb4c276c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:10:22.229571 25933 raft_consensus.cc:2258] T 6f3956fdacd94d72a48b46cc5a155e68 P 1258148a3a2a4caaba71da1feb4c276c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:10:22.235153 25933 ts_tablet_manager.cc:1905] T 6f3956fdacd94d72a48b46cc5a155e68 P 1258148a3a2a4caaba71da1feb4c276c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 17:10:22.241335 24928 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.146.193:38569 (error 108)
I20260811 17:10:22.241997 25932 tablet_replica.cc:330] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75: stopping tablet replica
I20260811 17:10:22.242465 25932 raft_consensus.cc:2229] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75 [term 1 LEADER]: Raft consensus shutting down.
I20260811 17:10:22.243057 25932 raft_consensus.cc:2258] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:10:22.243235 25869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:10:22.242871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:38569 (local address 127.0.0.1:56116)
0811 17:10:22.243037 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 17:10:22.243132 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.193:38569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 17:10:22.243240 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 25373
W20260811 17:10:22.243561 24928 catalog_manager.cc:4584] TS 2a011ef5ac584501b59cac3334979f77 (127.4.146.193:38569): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6f3956fdacd94d72a48b46cc5a155e68: Network error: Client connection negotiation failed: client connection to 127.4.146.193:38569: connect: Connection refused (error 111)
I20260811 17:10:22.272953 25932 ts_tablet_manager.cc:1905] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:10:22.277822 25932 ts_tablet_manager.cc:1918] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:10:22.278031 25932 log.cc:1196] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/6f3956fdacd94d72a48b46cc5a155e68
I20260811 17:10:22.278546 25932 ts_tablet_manager.cc:1939] T 6f3956fdacd94d72a48b46cc5a155e68 P c6963836c1fd411fae6240b9500a2f75: Deleting consensus metadata
I20260811 17:10:22.307466 25869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:10:22.307064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:38569 (local address 127.0.0.1:56126)
0811 17:10:22.307291 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 17:10:22.307361 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.193:38569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140}
I20260811 17:10:22.317071 25869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:10:22.316685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:38569 (local address 127.0.0.1:56134)
0811 17:10:22.316896 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 17:10:22.316959 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.193:38569: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260811 17:10:22.341010 24931 catalog_manager.cc:4841] TS c6963836c1fd411fae6240b9500a2f75 (127.4.146.195:39261): tablet 6f3956fdacd94d72a48b46cc5a155e68 (table test-table [id=d94def9357bc4c11982eb7a6424e2494]) successfully deleted
I20260811 17:10:22.351238 25869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:10:22.350908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:44313 (local address 127.0.0.1:49638)
0811 17:10:22.351058 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 17:10:22.351127 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.194:44313: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 17:10:22.351421 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 25601
I20260811 17:10:22.370633 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 24894
I20260811 17:10:22.392364 4683 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 17:10:22.749528 4683 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 17:10:22.749681 4683 mini_ranger.cc:66] Stopping Ranger...
I20260811 17:10:23.096665 4683 mini_ranger.cc:68] Stopped Ranger
2026-08-11 17:10:23.096 UTC [24145] LOG: received smart shutdown request
2026-08-11 17:10:23.101 UTC [24145] LOG: background worker "logical replication launcher" (PID 24160) exited with exit code 1
2026-08-11 17:10:23.101 UTC [24149] LOG: shutting down
2026-08-11 17:10:23.309 UTC [24145] LOG: database system is shut down
2026-08-11T17:10:23Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (56164 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:10:23 dist-test-slave-7vjv krb5kdc[25949](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:10:23 dist-test-slave-7vjv krb5kdc[25949](info): set up 2 sockets
Aug 11 17:10:23 dist-test-slave-7vjv krb5kdc[25949](info): commencing operation
krb5kdc: starting...
W20260811 17:10:24.810470 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.353s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:10:24 dist-test-slave-7vjv krb5kdc[25949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468224, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:10:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:10:24Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.4.146.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.4.146.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.4.146.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/rangeradmin_127.4.146.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.4.146.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/rangeradmin_127.4.146.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.4.146.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.4.146.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.4.146.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/rangerlookup_127.4.146.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.4.146.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/rangerlookup_127.4.146.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.4.146.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.4.146.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.4.146.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/HTTP_127.4.146.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.4.146.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/HTTP_127.4.146.212@KRBTEST.COM.keytab.
I20260811 17:10:25.041414 4683 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskk7LoRW/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/postgres -l logfile start
2026-08-11 17:10:27.961 UTC [25999] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 17:10:27.961 UTC [25999] LOG: listening on IPv4 address "127.4.146.212", port 46077
2026-08-11 17:10:27.965 UTC [25999] LOG: listening on Unix socket "/tmp/.s.PGSQL.46077"
2026-08-11 17:10:27.990 UTC [26005] LOG: database system was shut down at 2026-08-11 17:10:26 UTC
2026-08-11 17:10:27.995 UTC [25999] LOG: database system is ready to accept connections
I20260811 17:10:29.250794 4683 mini_postgres.cc:96] Postgres bound to 46077
2026-08-11 17:10:29.260 UTC [26018] FATAL: database "slave" does not exist
127.4.146.212:46077 - accepting connections
I20260811 17:10:29.260821 4683 mini_ranger.cc:161] Starting Ranger...
I20260811 17:10:29.279098 4683 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 17:10:29.930349 4683 mini_ranger.cc:87] Created ranger Postgres database
I20260811 17:10:29.930473 4683 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ranger-admin
2026-08-11 17:10:30,233 [I] DB FLAVOR :POSTGRES
2026-08-11 17:10:30,233 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 17:10:30,234 [I] Checking connection..
2026-08-11 17:10:30,234 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:46077/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 17:10:30,529 [I] Checking connection passed.
2026-08-11 17:10:30,530 [I] --------- Verifying version history table ---------
2026-08-11 17:10:30,530 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:46077/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 17:10:30,806 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 17:10:30,807 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:46077/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 17:10:31,082 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 17:10:31,082 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 17:10:31,083 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:46077/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 17:10:31.367 UTC [26123] WARNING: there is no transaction in progress
2026-08-11 17:10:31,374 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 17:10:31,375 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:46077/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 17:10:31,664 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 17:10:31,664 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 17:10:31,665 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:46077/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 17:10:31,955 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:46077/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 17:10:32,272 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:46077/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7vjv.c.gcp-upstream.internal','N') ;"
2026-08-11 17:10:32,547 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:46077/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 17:10:32,824 [I] Table x_portal_user does not exist in database ranger
2026-08-11 17:10:32,824 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:46077/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 17:10:33,121 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 17:10:33,122 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:46077/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 17:10:33,407 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:46077/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 17:10:33,700 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 17:10:33,701 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:46077/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 17:10:34.905 UTC [26306] WARNING: there is no transaction in progress
2026-08-11 17:10:34.926 UTC [26306] WARNING: there is no transaction in progress
2026-08-11 17:10:34.947 UTC [26306] WARNING: there is no transaction in progress
2026-08-11 17:10:34.967 UTC [26306] WARNING: there is no transaction in progress
2026-08-11 17:10:34.987 UTC [26306] WARNING: there is no transaction in progress
2026-08-11 17:10:35.012 UTC [26306] WARNING: there is no transaction in progress
2026-08-11 17:10:35.087 UTC [26306] WARNING: there is no transaction in progress
2026-08-11 17:10:35.097 UTC [26306] WARNING: there is no transaction in progress
2026-08-11 17:10:35.121 UTC [26306] WARNING: there is no transaction in progress
2026-08-11 17:10:35.137 UTC [26306] WARNING: there is no transaction in progress
2026-08-11 17:10:35.151 UTC [26306] WARNING: there is no transaction in progress
2026-08-11 17:10:35.171 UTC [26306] WARNING: there is no transaction in progress
2026-08-11 17:10:35.183 UTC [26306] WARNING: there is no transaction in progress
2026-08-11 17:10:35.192 UTC [26306] WARNING: there is no transaction in progress
2026-08-11 17:10:35.202 UTC [26306] WARNING: there is no transaction in progress
2026-08-11 17:10:35.211 UTC [26306] WARNING: there is no transaction in progress
2026-08-11 17:10:36,205 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 17:10:36,205 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:46077/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 17:10:36,507 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 17:10:36,507 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:46077/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 17:10:36,812 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 17:10:36,813 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:46077/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 17:10:37,095 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 17:10:37,096 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:46077/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 17:10:37,420 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:46077/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 17:10:37,730 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:46077/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7vjv.c.gcp-upstream.internal';"
2026-08-11 17:10:38,017 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 17:10:38,018 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:46077/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 17:10:38,311 [I] DB_PATCHES have already been applied
I20260811 17:10:38.318987 4683 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ranger-admin:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskk7LoRW/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 17:10:38.319079 4683 mini_ranger.cc:193] Using host: 127.4.146.212
I20260811 17:10:38.325198 4683 mini_ranger.cc:227] Ranger admin URL: http://127.4.146.212:41913
Aug 11, 2026 5:10:38 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 5:10:38 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 5:10:38 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 5:10:38 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 5:10:38 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 5:10:39 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 5:10:39 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 17:10:39.896242 4683 mini_ranger.cc:160] Time spent starting Ranger: real 10.635s user 0.002s sys 0.013s
Aug 11, 2026 5:11:01 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 5:11:01 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 11, 2026 5:11:01 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 5:11:01 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 5:11:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 5:11:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 5:11:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 5:11:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 5:11:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 5:11:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 5:11:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 5:11:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 5:11:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 5:11:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 5:11:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 5:11:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 5:11:01 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 5:11:02 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 17:11:03.492048 4683 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.4.146.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.4.146.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.4.146.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/rangerkms_127.4.146.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.4.146.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/rangerkms_127.4.146.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.4.146.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.4.146.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.4.146.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/HTTP_127.4.146.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.4.146.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/HTTP_127.4.146.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 17:11:03 dist-test-slave-7vjv krb5kdc[25949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468263, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 17:11:03.625442 4683 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 17:11:03.637814 4683 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 17:11:04.813501 4683 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 17:11:04.813616 4683 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ranger-kms
I20260811 17:11:04.813643 4683 mini_ranger_kms.cc:227] Using postgres at 127.4.146.212:46077
2026-08-11 17:11:05,027 [I] DB FLAVOR :POSTGRES
2026-08-11 17:11:05,028 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 17:11:05,028 [I] Checking connection
2026-08-11 17:11:05,028 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:46077/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 17:11:05,323 [I] connection success
2026-08-11 17:11:05,324 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 17:11:05,324 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 17:11:05,324 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:46077/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 17:11:05,592 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 17:11:05,592 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 17:11:05,593 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 17:11:05,593 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.4.146.212:46077/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 17:11:05,924 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 17:11:06.540621 4683 mini_ranger_kms.cc:310] Created kms service
I20260811 17:11:06.819345 4683 mini_ranger_kms.cc:326] Created kudu user
I20260811 17:11:06.866870 4683 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 17:11:06 dist-test-slave-7vjv krb5kdc[25949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468263, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.4.146.212@KRBTEST.COM
I20260811 17:11:07.333292 4683 mini_ranger_kms.cc:384] Added ranger policy
I20260811 17:11:07.333583 4683 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ranger-kms:/tmp/dist-test-taskk7LoRW/build/debug/bin/postgresql.jar:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskk7LoRW/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 17:11:07.333616 4683 mini_ranger_kms.cc:240] Using host: 127.4.146.212
I20260811 17:11:07.339825 4683 mini_ranger_kms.cc:276] Ranger KMS PID: 26609
I20260811 17:11:07.339956 4683 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.4.146.212:40731
Aug 11, 2026 5:11:08 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 5:11:08 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 5:11:08 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 5:11:08 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 5:11:09 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 5:11:09 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 17:11:10 dist-test-slave-7vjv krb5kdc[25949](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786468270, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.4.146.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:10.370586 4683 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.745s user 0.012s sys 0.185s
I20260811 17:11:10.370739 4683 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 17:11:10.370814 4683 mini_ranger_kms.cc:401] 127.4.146.212:40731/kms/v1/keys
Aug 11 17:11:10 dist-test-slave-7vjv krb5kdc[25949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468270, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.4.146.212@KRBTEST.COM for HTTP/127.4.146.212@KRBTEST.COM
Aug 11 17:11:11 dist-test-slave-7vjv krb5kdc[25949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468270, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.4.146.212@KRBTEST.COM for HTTP/127.4.146.212@KRBTEST.COM
Aug 11 17:11:13 dist-test-slave-7vjv krb5kdc[25949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:11:13.712052 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:35319
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:37985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:35319
--ranger_config_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.146.212:40731/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:11:13.861198 26695 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:13.861553 26695 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:13.861640 26695 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:13.865924 26695 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:11:13.866031 26695 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:13.866080 26695 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:13.866135 26695 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:11:13.866173 26695 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:11:13.872308 26695 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:37985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/wal
--ranger_kms_url=127.4.146.212:40731/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:35319
--ranger_config_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:35319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26695
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:13.873596 26695 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:13.874706 26695 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:13.884473 26709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:13.884542 26706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:13.884558 26695 server_base.cc:1034] running on GCE node
W20260811 17:11:13.884656 26713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:13.885772 26695 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:13.887363 26695 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:13.888573 26695 hybrid_clock.cc:648] HybridClock initialized: now 1786468273888538 us; error 44 us; skew 500 ppm
Aug 11 17:11:13 dist-test-slave-7vjv krb5kdc[25949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468273, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:13.892545 26695 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:11:13.893733 26695 webserver.cc:460] Webserver started at http://127.4.146.254:38377/ using document root <none> and password file <none>
I20260811 17:11:13.894398 26695 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:13.894484 26695 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:11:13.894786 26695 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 17:11:13 dist-test-slave-7vjv krb5kdc[25949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468273, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for HTTP/127.4.146.212@KRBTEST.COM
I20260811 17:11:13.956658 26695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "3c7afccecace434eaa4dedd0f5ebadb2"
format_stamp: "Formatted at 2026-08-11 17:11:13 on dist-test-slave-7vjv"
server_key: "99e773fc113c3edcfdeec60b44626e2a"
server_key_iv: "a792a1f33711f8253bb1bdcdeaa309c5"
server_key_version: "kuduclusterkey@0"
I20260811 17:11:13.957579 26695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "3c7afccecace434eaa4dedd0f5ebadb2"
format_stamp: "Formatted at 2026-08-11 17:11:13 on dist-test-slave-7vjv"
server_key: "99e773fc113c3edcfdeec60b44626e2a"
server_key_iv: "a792a1f33711f8253bb1bdcdeaa309c5"
server_key_version: "kuduclusterkey@0"
I20260811 17:11:13.963420 26695 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 17:11:13.981160 26724 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:13.982939 26695 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:11:13.983177 26695 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "3c7afccecace434eaa4dedd0f5ebadb2"
format_stamp: "Formatted at 2026-08-11 17:11:13 on dist-test-slave-7vjv"
server_key: "99e773fc113c3edcfdeec60b44626e2a"
server_key_iv: "a792a1f33711f8253bb1bdcdeaa309c5"
server_key_version: "kuduclusterkey@0"
I20260811 17:11:13.983428 26695 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:13.999260 26695 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:14.003289 26695 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:14.003604 26695 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:14.013588 26695 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:35319
I20260811 17:11:14.013594 26812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:35319 every 8 connection(s)
I20260811 17:11:14.015030 26695 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:11:14.019126 26813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:11:14.024331 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 26695
I20260811 17:11:14.024518 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:11:14.024837 4683 external_mini_cluster.cc:1428] Setting key b3cd59d63b1614f6d7c4ec216e484400
I20260811 17:11:14.027992 26813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2: Bootstrap starting.
I20260811 17:11:14.031241 26813 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2: Neither blocks nor log segments found. Creating new log.
I20260811 17:11:14.032320 26813 log.cc:824] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2: Log is configured to *not* fsync() on all Append() calls
I20260811 17:11:14.035123 26813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2: No bootstrap required, opened a new log
Aug 11 17:11:14 dist-test-slave-7vjv krb5kdc[25949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:11:14.040036 26813 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c7afccecace434eaa4dedd0f5ebadb2" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35319 } }
I20260811 17:11:14.040457 26813 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:11:14.040547 26813 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c7afccecace434eaa4dedd0f5ebadb2, State: Initialized, Role: FOLLOWER
I20260811 17:11:14.041199 26813 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c7afccecace434eaa4dedd0f5ebadb2" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35319 } }
I20260811 17:11:14.041383 26813 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:11:14.041476 26813 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:11:14.041602 26813 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:11:14.042865 26813 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c7afccecace434eaa4dedd0f5ebadb2" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35319 } }
I20260811 17:11:14.043360 26813 leader_election.cc:302] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c7afccecace434eaa4dedd0f5ebadb2; no voters:
I20260811 17:11:14.043783 26813 leader_election.cc:288] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:11:14.043921 26822 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:11:14.044176 26822 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [term 1 LEADER]: Becoming Leader. State: Replica: 3c7afccecace434eaa4dedd0f5ebadb2, State: Running, Role: LEADER
I20260811 17:11:14.044557 26818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:14.026684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56998 (local address 127.4.146.254:35319)
0811 17:11:14.027178 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:14.027196 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:14.027237 (+ 41us) server_negotiation.cc:407] Connection header received
0811 17:11:14.027986 (+ 749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:14.028007 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:14.028526 (+ 519us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:14.028943 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:14.029913 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:14.031115 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:14.032382 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:14.033253 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:14.033466 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:14.037845 (+ 4379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:14.037860 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:14.037887 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:14.037935 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:14.040400 (+ 2465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:14.041190 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:14.041198 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:14.041206 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:14.041364 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:14.041761 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:14.041764 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:14.041766 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:14.042364 (+ 598us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:14.042600 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:14.042958 (+ 358us) server_negotiation.cc:299] Negotiation successful
0811 17:11:14.043379 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":162,"threads_started":1}
I20260811 17:11:14.045341 26813 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:11:14.044551 26822 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c7afccecace434eaa4dedd0f5ebadb2" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35319 } }
I20260811 17:11:14.048852 26822 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c7afccecace434eaa4dedd0f5ebadb2. Latest consensus state: current_term: 1 leader_uuid: "3c7afccecace434eaa4dedd0f5ebadb2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c7afccecace434eaa4dedd0f5ebadb2" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35319 } } }
I20260811 17:11:14.049118 26822 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [sys.catalog]: This master's current role is: LEADER
I20260811 17:11:14.049361 26823 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c7afccecace434eaa4dedd0f5ebadb2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c7afccecace434eaa4dedd0f5ebadb2" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35319 } } }
I20260811 17:11:14.049484 26823 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [sys.catalog]: This master's current role is: LEADER
I20260811 17:11:14.049687 26848 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:11:14.050199 26813 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 17:11:14.053411 26848 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:11:14.065729 26848 catalog_manager.cc:1347] Generated new cluster ID: 61ee314c47d84ec894842cf3321dc650
I20260811 17:11:14.065837 26848 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:11:14.090859 26848 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:11:14.092509 26848 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:11:14.117277 26848 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2: Generated new TSK 0
I20260811 17:11:14.118595 26848 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
I20260811 17:11:15.063817 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.146.212:40731/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:35319
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:37985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:11:15.221143 26898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:15.221472 26898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:15.221518 26898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:15.225826 26898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:15.225909 26898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:15.225970 26898 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:11:15.231858 26898 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:37985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.4.146.212:40731/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:35319
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:15.233242 26898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:15.234333 26898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:15.247915 26911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:15.248135 26914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:15.248230 26912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:15.248840 26898 server_base.cc:1034] running on GCE node
I20260811 17:11:15.249435 26898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:15.250394 26898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:15.251610 26898 hybrid_clock.cc:648] HybridClock initialized: now 1786468275251578 us; error 50 us; skew 500 ppm
Aug 11 17:11:15 dist-test-slave-7vjv krb5kdc[25949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468275, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:15.255723 26898 init.cc:377] Logged in from keytab as kudu/127.4.146.193@KRBTEST.COM (short username kudu)
I20260811 17:11:15.256928 26898 webserver.cc:460] Webserver started at http://127.4.146.193:46329/ using document root <none> and password file <none>
I20260811 17:11:15.257627 26898 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:15.257736 26898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:11:15.258020 26898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 17:11:15 dist-test-slave-7vjv krb5kdc[25949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468275, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for HTTP/127.4.146.212@KRBTEST.COM
I20260811 17:11:15.276181 26898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "f728d40293b547eca9eb76fff75b714b"
format_stamp: "Formatted at 2026-08-11 17:11:15 on dist-test-slave-7vjv"
server_key: "0a500e302ef0d31960e6ab13d7b92a2e"
server_key_iv: "a9ecb8ba0fbed4e82e7f4870544cc0b1"
server_key_version: "kuduclusterkey@0"
I20260811 17:11:15.277128 26898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "f728d40293b547eca9eb76fff75b714b"
format_stamp: "Formatted at 2026-08-11 17:11:15 on dist-test-slave-7vjv"
server_key: "0a500e302ef0d31960e6ab13d7b92a2e"
server_key_iv: "a9ecb8ba0fbed4e82e7f4870544cc0b1"
server_key_version: "kuduclusterkey@0"
I20260811 17:11:15.287106 26898 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.006s sys 0.000s
I20260811 17:11:15.318686 26926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:15.320562 26898 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:11:15.320806 26898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "f728d40293b547eca9eb76fff75b714b"
format_stamp: "Formatted at 2026-08-11 17:11:15 on dist-test-slave-7vjv"
server_key: "0a500e302ef0d31960e6ab13d7b92a2e"
server_key_iv: "a9ecb8ba0fbed4e82e7f4870544cc0b1"
server_key_version: "kuduclusterkey@0"
I20260811 17:11:15.321100 26898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:15.359547 26898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:15.363606 26898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:15.363880 26898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:15.364738 26898 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:11:15.365923 26898 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:11:15.366035 26898 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:15.366168 26898 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:11:15.366251 26898 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:15.383050 26898 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:38983
I20260811 17:11:15.384639 26898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:11:15.385819 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 26898
I20260811 17:11:15.385948 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
I20260811 17:11:15.386253 4683 external_mini_cluster.cc:1428] Setting key 207a241a04daf9334acc8139fd930004
I20260811 17:11:15.386256 27118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:38983 every 8 connection(s)
Aug 11 17:11:15 dist-test-slave-7vjv krb5kdc[25949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468275, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:11:15.414336 27124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:15.388984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:35319 (local address 127.4.146.193:34297)
0811 17:11:15.396646 (+ 7662us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:15.396745 (+ 99us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:15.397979 (+ 1234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:15.399210 (+ 1231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:15.399223 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:15.399725 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:15.400659 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:15.400689 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:15.402073 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:15.402077 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:15.403693 (+ 1616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:15.403707 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:15.404588 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:15.404592 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:15.404840 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:15.405702 (+ 862us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:15.405728 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:15.407701 (+ 1973us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:15.410325 (+ 2624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:15.410332 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:15.410353 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:15.410816 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:15.411209 (+ 393us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:15.411213 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:15.411215 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:15.411432 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:15.411978 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:15.411985 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:15.412442 (+ 457us) client_negotiation.cc:769] Sending connection context
0811 17:11:15.412696 (+ 254us) client_negotiation.cc:240] Negotiation successful
0811 17:11:15.413102 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7295,"thread_start_us":166,"threads_started":1}
I20260811 17:11:15.415222 27121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:15.388379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:34297 (local address 127.4.146.254:35319)
0811 17:11:15.398575 (+ 10196us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:15.398580 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:15.398597 (+ 17us) server_negotiation.cc:407] Connection header received
0811 17:11:15.398647 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:15.398650 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:15.398710 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:15.398806 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:15.400913 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:15.401885 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:15.403866 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:15.404256 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:15.404365 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:15.407957 (+ 3592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:15.407962 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:15.407965 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:15.407998 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:15.410150 (+ 2152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:15.410969 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:15.410973 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:15.410975 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:15.411085 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:15.411569 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:15.411572 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:15.411574 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:15.411825 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:15.411919 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:15.414872 (+ 2953us) server_negotiation.cc:299] Negotiation successful
0811 17:11:15.415031 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10074,"thread_start_us":79,"threads_started":1}
WARNING: no policy specified for kudu/127.4.146.194@KRBTEST.COM; defaulting to no policy
I20260811 17:11:15.417339 27119 heartbeater.cc:347] Connected to a master server at 127.4.146.254:35319
I20260811 17:11:15.417662 27119 heartbeater.cc:464] Registering TS with master...
I20260811 17:11:15.418346 27119 heartbeater.cc:511] Master 127.4.146.254:35319 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.194@KRBTEST.COM" created.
I20260811 17:11:15.420517 26754 ts_manager.cc:194] Registered new tserver with Master: f728d40293b547eca9eb76fff75b714b (127.4.146.193:38983)
I20260811 17:11:15.422479 26754 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.193@KRBTEST.COM'} at 127.4.146.193:34297
Aug 11 17:11:15 dist-test-slave-7vjv krb5kdc[25949](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786468275, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
I20260811 17:11:15.463881 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.146.212:40731/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:35319
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:37985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:11:15.650701 27127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:15.651741 27127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:15.651923 27127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:15.659241 27127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:15.659507 27127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:15.659695 27127 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:11:15.668746 27127 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:37985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.4.146.212:40731/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:35319
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27127
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:15.670709 27127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:15.672569 27127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:15.687155 27144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:15.687839 27141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:15.688562 27148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:15.689720 27127 server_base.cc:1034] running on GCE node
I20260811 17:11:15.690448 27127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:15.691437 27127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:15.694744 27127 hybrid_clock.cc:648] HybridClock initialized: now 1786468275694630 us; error 125 us; skew 500 ppm
Aug 11 17:11:15 dist-test-slave-7vjv krb5kdc[25949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468275, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:15.699371 27127 init.cc:377] Logged in from keytab as kudu/127.4.146.194@KRBTEST.COM (short username kudu)
I20260811 17:11:15.701112 27127 webserver.cc:460] Webserver started at http://127.4.146.194:36721/ using document root <none> and password file <none>
I20260811 17:11:15.702109 27127 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:15.702317 27127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:11:15.702689 27127 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 17:11:15 dist-test-slave-7vjv krb5kdc[25949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468275, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for HTTP/127.4.146.212@KRBTEST.COM
I20260811 17:11:15.723493 27127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "934daa2173fc40c78a70c4754f248ff1"
format_stamp: "Formatted at 2026-08-11 17:11:15 on dist-test-slave-7vjv"
server_key: "72cca25bed7f4ad853b620f258d515b1"
server_key_iv: "1989338d6329011331624855e718c3c5"
server_key_version: "kuduclusterkey@0"
I20260811 17:11:15.724524 27127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "934daa2173fc40c78a70c4754f248ff1"
format_stamp: "Formatted at 2026-08-11 17:11:15 on dist-test-slave-7vjv"
server_key: "72cca25bed7f4ad853b620f258d515b1"
server_key_iv: "1989338d6329011331624855e718c3c5"
server_key_version: "kuduclusterkey@0"
I20260811 17:11:15.730370 27127 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 17:11:15.757236 27161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:15.759135 27127 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260811 17:11:15.759390 27127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "934daa2173fc40c78a70c4754f248ff1"
format_stamp: "Formatted at 2026-08-11 17:11:15 on dist-test-slave-7vjv"
server_key: "72cca25bed7f4ad853b620f258d515b1"
server_key_iv: "1989338d6329011331624855e718c3c5"
server_key_version: "kuduclusterkey@0"
I20260811 17:11:15.759644 27127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:15.775206 27127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:15.779914 27127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:15.780303 27127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:15.781368 27127 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:11:15.782905 27127 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:11:15.783056 27127 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:15.783185 27127 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:11:15.783264 27127 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:15.797075 27127 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:38041
I20260811 17:11:15.797103 27360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:38041 every 8 connection(s)
I20260811 17:11:15.798275 27127 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:11:15.802675 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 27127
I20260811 17:11:15.802812 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:11:15.803160 4683 external_mini_cluster.cc:1428] Setting key 58e68871c75560f2799c0ad872ff3f9b
Aug 11 17:11:15 dist-test-slave-7vjv krb5kdc[25949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468275, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.146.195@KRBTEST.COM; defaulting to no policy
I20260811 17:11:15.817425 27121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:15.800432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:37633 (local address 127.4.146.254:35319)
0811 17:11:15.801913 (+ 1481us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:15.801919 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:15.801941 (+ 22us) server_negotiation.cc:407] Connection header received
0811 17:11:15.802696 (+ 755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:15.802702 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:15.802771 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:15.802838 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:15.804987 (+ 2149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:15.805760 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:15.807726 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:15.808173 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:15.808275 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:15.812117 (+ 3842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:15.812125 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:15.812130 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:15.812171 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:15.814275 (+ 2104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:15.815106 (+ 831us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:15.815110 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:15.815112 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:15.815219 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:15.815725 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:15.815729 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:15.815731 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:15.816019 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:15.816194 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:15.817105 (+ 911us) server_negotiation.cc:299] Negotiation successful
0811 17:11:15.817276 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1380}
I20260811 17:11:15.819563 27365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:15.800878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:35319 (local address 127.4.146.194:37633)
0811 17:11:15.801387 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:15.801442 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:15.802404 (+ 962us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:15.803334 (+ 930us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:15.803344 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:15.803741 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:15.804802 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:15.804827 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:15.805952 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:15.805959 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:15.807549 (+ 1590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:15.807567 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:15.808536 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:15.808541 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:15.808795 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:15.809611 (+ 816us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:15.809640 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:15.811795 (+ 2155us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:15.814449 (+ 2654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:15.814456 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:15.814480 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:15.814934 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:15.815354 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:15.815359 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:15.815364 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:15.815588 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:15.816309 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:15.816318 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:15.816738 (+ 420us) client_negotiation.cc:769] Sending connection context
0811 17:11:15.817721 (+ 983us) client_negotiation.cc:240] Negotiation successful
0811 17:11:15.818470 (+ 749us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":140,"threads_started":1}
I20260811 17:11:15.821436 27363 heartbeater.cc:347] Connected to a master server at 127.4.146.254:35319
I20260811 17:11:15.821763 27363 heartbeater.cc:464] Registering TS with master...
I20260811 17:11:15.822482 27363 heartbeater.cc:511] Master 127.4.146.254:35319 requested a full tablet report, sending...
I20260811 17:11:15.823968 26754 ts_manager.cc:194] Registered new tserver with Master: 934daa2173fc40c78a70c4754f248ff1 (127.4.146.194:38041)
I20260811 17:11:15.824813 26754 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.194@KRBTEST.COM'} at 127.4.146.194:37633
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
I20260811 17:11:15.869189 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.146.212:40731/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:35319
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:37985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 17:11:15 dist-test-slave-7vjv krb5kdc[25949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468275, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for HTTP/127.4.146.212@KRBTEST.COM
W20260811 17:11:16.077713 27368 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:16.078276 27368 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:16.078406 27368 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:16.085918 27368 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:16.086133 27368 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:16.086277 27368 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:11:16.095661 27368 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:37985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.4.146.212:40731/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:35319
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27368
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:16.097635 27368 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:16.099330 27368 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:16.114691 27375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:16.115154 27376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:16.115540 27368 server_base.cc:1034] running on GCE node
W20260811 17:11:16.114907 27378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:16.116636 27368 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:16.117630 27368 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:16.125087 27368 hybrid_clock.cc:648] HybridClock initialized: now 1786468276124958 us; error 133 us; skew 500 ppm
Aug 11 17:11:16 dist-test-slave-7vjv krb5kdc[25949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468276, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:16.129810 27368 init.cc:377] Logged in from keytab as kudu/127.4.146.195@KRBTEST.COM (short username kudu)
I20260811 17:11:16.131281 27368 webserver.cc:460] Webserver started at http://127.4.146.195:37865/ using document root <none> and password file <none>
I20260811 17:11:16.132190 27368 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:16.132387 27368 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:11:16.132740 27368 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 17:11:16 dist-test-slave-7vjv krb5kdc[25949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468276, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for HTTP/127.4.146.212@KRBTEST.COM
I20260811 17:11:16.150986 27368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "4be74cd6539f4033bb7820631eba8cc5"
format_stamp: "Formatted at 2026-08-11 17:11:16 on dist-test-slave-7vjv"
server_key: "f4fc53ed82e3a6923214a37e1c99c478"
server_key_iv: "72279bf08ab599f984f2b53484c87b54"
server_key_version: "kuduclusterkey@0"
I20260811 17:11:16.152026 27368 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "4be74cd6539f4033bb7820631eba8cc5"
format_stamp: "Formatted at 2026-08-11 17:11:16 on dist-test-slave-7vjv"
server_key: "f4fc53ed82e3a6923214a37e1c99c478"
server_key_iv: "72279bf08ab599f984f2b53484c87b54"
server_key_version: "kuduclusterkey@0"
I20260811 17:11:16.177875 27368 fs_manager.cc:691] Time spent creating directory manager: real 0.025s user 0.003s sys 0.002s
I20260811 17:11:16.226102 27396 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:16.228411 27368 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.002s sys 0.000s
I20260811 17:11:16.228605 27368 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "4be74cd6539f4033bb7820631eba8cc5"
format_stamp: "Formatted at 2026-08-11 17:11:16 on dist-test-slave-7vjv"
server_key: "f4fc53ed82e3a6923214a37e1c99c478"
server_key_iv: "72279bf08ab599f984f2b53484c87b54"
server_key_version: "kuduclusterkey@0"
I20260811 17:11:16.228772 27368 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:16.263067 27368 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:16.267365 27368 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:16.267656 27368 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:16.268453 27368 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:11:16.269647 27368 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:11:16.269769 27368 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:16.269871 27368 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:11:16.269946 27368 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:16.286617 27368 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:33333
I20260811 17:11:16.288166 27368 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:11:16.296438 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 27368
I20260811 17:11:16.296586 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:11:16.296880 4683 external_mini_cluster.cc:1428] Setting key ded679c7a8c98cb8183e895436b3ee52
I20260811 17:11:16.289939 27590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:33333 every 8 connection(s)
Aug 11 17:11:16 dist-test-slave-7vjv krb5kdc[25949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468276, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:11:16.316278 27121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:16.294141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:57971 (local address 127.4.146.254:35319)
0811 17:11:16.294279 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:16.294284 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:16.294904 (+ 620us) server_negotiation.cc:407] Connection header received
0811 17:11:16.299493 (+ 4589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:16.299496 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:16.299556 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:16.299608 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:16.301743 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:16.302587 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:16.304467 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:16.304815 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:16.304903 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:16.308538 (+ 3635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:16.308543 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:16.308546 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:16.308583 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:16.313203 (+ 4620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:16.314092 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:16.314096 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:16.314098 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:16.314206 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:16.314707 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:16.314711 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:16.314713 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:16.314984 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:16.315077 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:16.315884 (+ 807us) server_negotiation.cc:299] Negotiation successful
0811 17:11:16.316069 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 17:11:16.318465 27596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:16.292767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:35319 (local address 127.4.146.195:57971)
0811 17:11:16.294711 (+ 1944us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:16.294776 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:16.295958 (+ 1182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:16.300159 (+ 4201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:16.300171 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:16.300743 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:16.301550 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:16.301574 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:16.302775 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:16.302778 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:16.304305 (+ 1527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:16.304320 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:16.305182 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:16.305187 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:16.305418 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:16.306276 (+ 858us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:16.306300 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:16.308260 (+ 1960us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:16.313406 (+ 5146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:16.313415 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:16.313440 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:16.313942 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:16.314344 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:16.314347 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:16.314349 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:16.314581 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:16.315156 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:16.315163 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:16.315547 (+ 384us) client_negotiation.cc:769] Sending connection context
0811 17:11:16.316821 (+ 1274us) client_negotiation.cc:240] Negotiation successful
0811 17:11:16.317252 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1704,"thread_start_us":288,"threads_started":1}
I20260811 17:11:16.320601 27591 heartbeater.cc:347] Connected to a master server at 127.4.146.254:35319
I20260811 17:11:16.320917 27591 heartbeater.cc:464] Registering TS with master...
I20260811 17:11:16.321637 27591 heartbeater.cc:511] Master 127.4.146.254:35319 requested a full tablet report, sending...
I20260811 17:11:16.325029 26754 ts_manager.cc:194] Registered new tserver with Master: 4be74cd6539f4033bb7820631eba8cc5 (127.4.146.195:33333)
I20260811 17:11:16.325862 26754 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.195@KRBTEST.COM'} at 127.4.146.195:57971
I20260811 17:11:16.336931 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 17:11:16.337826 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 26898
I20260811 17:11:16.401705 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 27127
I20260811 17:11:16.439580 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 27368
I20260811 17:11:16.453508 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 26695
I20260811 17:11:16.469159 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:35319
--webserver_interface=127.4.146.254
--webserver_port=38377
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:37985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:35319
--ranger_config_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.146.212:40731/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.4.146.212:40731/kms with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:11:16.597503 27599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:16.597821 27599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:16.597862 27599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:16.602281 27599 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:11:16.602371 27599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:16.602392 27599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:16.602409 27599 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:11:16.602451 27599 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:11:16.608381 27599 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:37985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.4.146.212:40731/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:35319
--ranger_config_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:35319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=38377
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:16.609608 27599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:16.610711 27599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:16.622303 27607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:16.622303 27609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:16.622377 27611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:16.623248 27599 server_base.cc:1034] running on GCE node
I20260811 17:11:16.624060 27599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:16.625362 27599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:16.626600 27599 hybrid_clock.cc:648] HybridClock initialized: now 1786468276626578 us; error 36 us; skew 500 ppm
Aug 11 17:11:16 dist-test-slave-7vjv krb5kdc[25949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468276, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:16.630041 27599 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:11:16.631214 27599 webserver.cc:460] Webserver started at http://127.4.146.254:38377/ using document root <none> and password file <none>
I20260811 17:11:16.632248 27599 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:16.632380 27599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 17:11:16 dist-test-slave-7vjv krb5kdc[25949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468276, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for HTTP/127.4.146.212@KRBTEST.COM
I20260811 17:11:16.715648 27599 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 17:11:16.718482 27627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:16.720299 27599 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:11:16.720466 27599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "3c7afccecace434eaa4dedd0f5ebadb2"
format_stamp: "Formatted at 2026-08-11 17:11:13 on dist-test-slave-7vjv"
server_key: "99e773fc113c3edcfdeec60b44626e2a"
server_key_iv: "a792a1f33711f8253bb1bdcdeaa309c5"
server_key_version: "kuduclusterkey@0"
I20260811 17:11:16.721167 27599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:16.735728 27599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:16.739022 27599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:16.739264 27599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:16.747385 27599 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:35319
I20260811 17:11:16.747414 27726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:35319 every 8 connection(s)
I20260811 17:11:16.748641 27599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:11:16.750100 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 27599
I20260811 17:11:16.750730 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.146.212:40731/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:38983
--local_ip_for_outbound_sockets=127.4.146.193
--tserver_master_addrs=127.4.146.254:35319
--webserver_port=46329
--webserver_interface=127.4.146.193
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:37985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.4.146.212:40731/kms with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 17:11:16.754617 27727 sys_catalog.cc:263] Verifying existing consensus state
I20260811 17:11:16.756759 27727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2: Bootstrap starting.
I20260811 17:11:16.776165 27727 log.cc:824] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2: Log is configured to *not* fsync() on all Append() calls
I20260811 17:11:16.785118 27727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 17:11:16.785637 27727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2: Bootstrap complete.
I20260811 17:11:16.791465 27727 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c7afccecace434eaa4dedd0f5ebadb2" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35319 } }
I20260811 17:11:16.792019 27727 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c7afccecace434eaa4dedd0f5ebadb2, State: Initialized, Role: FOLLOWER
I20260811 17:11:16.792624 27727 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c7afccecace434eaa4dedd0f5ebadb2" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35319 } }
I20260811 17:11:16.792781 27727 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:11:16.792845 27727 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:11:16.792943 27727 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [term 1 FOLLOWER]: Advancing to term 2
I20260811 17:11:16.795635 27727 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c7afccecace434eaa4dedd0f5ebadb2" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35319 } }
I20260811 17:11:16.796022 27727 leader_election.cc:302] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c7afccecace434eaa4dedd0f5ebadb2; no voters:
I20260811 17:11:16.796435 27727 leader_election.cc:288] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 17:11:16.796626 27737 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 17:11:16.796933 27737 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [term 2 LEADER]: Becoming Leader. State: Replica: 3c7afccecace434eaa4dedd0f5ebadb2, State: Running, Role: LEADER
I20260811 17:11:16.797284 27737 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c7afccecace434eaa4dedd0f5ebadb2" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35319 } }
I20260811 17:11:16.797751 27727 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:11:16.798815 27740 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c7afccecace434eaa4dedd0f5ebadb2. Latest consensus state: current_term: 2 leader_uuid: "3c7afccecace434eaa4dedd0f5ebadb2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c7afccecace434eaa4dedd0f5ebadb2" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35319 } } }
I20260811 17:11:16.798990 27740 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [sys.catalog]: This master's current role is: LEADER
I20260811 17:11:16.799322 27739 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "3c7afccecace434eaa4dedd0f5ebadb2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c7afccecace434eaa4dedd0f5ebadb2" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35319 } } }
I20260811 17:11:16.799425 27739 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2 [sys.catalog]: This master's current role is: LEADER
I20260811 17:11:16.799525 27751 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:11:16.803308 27751 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:11:16.803870 27727 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 17:11:16.804262 27751 catalog_manager.cc:1259] Loaded cluster ID: 61ee314c47d84ec894842cf3321dc650
I20260811 17:11:16.804384 27751 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:11:16.807175 27751 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:11:16.808017 27751 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2: Loaded TSK: 0
I20260811 17:11:16.809486 27751 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 17:11:16.883517 27731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:16.883828 27731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:16.883909 27731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:16.888271 27731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:16.888358 27731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:16.888466 27731 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:11:16.894181 27731 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:37985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.4.146.212:40731/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:38983
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=46329
--tserver_master_addrs=127.4.146.254:35319
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:16.895416 27731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:16.896817 27731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:16.912055 27795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:16.912269 27797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:16.912091 27803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:16.912868 27731 server_base.cc:1034] running on GCE node
I20260811 17:11:16.913445 27731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:16.914364 27731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:16.917675 27731 hybrid_clock.cc:648] HybridClock initialized: now 1786468276917649 us; error 43 us; skew 500 ppm
Aug 11 17:11:16 dist-test-slave-7vjv krb5kdc[25949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468276, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:16.921866 27731 init.cc:377] Logged in from keytab as kudu/127.4.146.193@KRBTEST.COM (short username kudu)
I20260811 17:11:16.923192 27731 webserver.cc:460] Webserver started at http://127.4.146.193:46329/ using document root <none> and password file <none>
I20260811 17:11:16.923991 27731 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:16.924163 27731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 17:11:16 dist-test-slave-7vjv krb5kdc[25949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468276, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for HTTP/127.4.146.212@KRBTEST.COM
I20260811 17:11:16.952942 27731 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.003s sys 0.000s
I20260811 17:11:16.957350 27813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:16.959388 27731 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260811 17:11:16.959576 27731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "f728d40293b547eca9eb76fff75b714b"
format_stamp: "Formatted at 2026-08-11 17:11:15 on dist-test-slave-7vjv"
server_key: "0a500e302ef0d31960e6ab13d7b92a2e"
server_key_iv: "a9ecb8ba0fbed4e82e7f4870544cc0b1"
server_key_version: "kuduclusterkey@0"
I20260811 17:11:16.960553 27731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:17.000490 27731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:17.007535 27731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:17.007819 27731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:17.008802 27731 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:11:17.010123 27731 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:11:17.010200 27731 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:17.010279 27731 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:11:17.010308 27731 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:17.037830 27731 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:38983
I20260811 17:11:17.039410 27731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:11:17.043231 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 27731
I20260811 17:11:17.043884 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.146.212:40731/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:38041
--local_ip_for_outbound_sockets=127.4.146.194
--tserver_master_addrs=127.4.146.254:35319
--webserver_port=36721
--webserver_interface=127.4.146.194
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:37985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.4.146.212:40731/kms with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 17:11:17.041852 28014 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:38983 every 8 connection(s)
Aug 11 17:11:17 dist-test-slave-7vjv krb5kdc[25949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468276, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:11:17.092132 28020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:17.049287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:35319 (local address 127.4.146.193:58451)
0811 17:11:17.056471 (+ 7184us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:17.056564 (+ 93us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:17.057730 (+ 1166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:17.059925 (+ 2195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:17.059936 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:17.060746 (+ 810us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:17.062381 (+ 1635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:17.062413 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:17.065941 (+ 3528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:17.065946 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:17.068016 (+ 2070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:17.068038 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:17.073924 (+ 5886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:17.073930 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:17.074228 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:17.075280 (+ 1052us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:17.075307 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:17.084483 (+ 9176us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:17.087834 (+ 3351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:17.087842 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:17.087861 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:17.088395 (+ 534us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:17.088935 (+ 540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:17.088939 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:17.088940 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:17.089154 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:17.090087 (+ 933us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:17.090093 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:17.090421 (+ 328us) client_negotiation.cc:769] Sending connection context
0811 17:11:17.090630 (+ 209us) client_negotiation.cc:240] Negotiation successful
0811 17:11:17.091003 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6797,"thread_start_us":227,"threads_started":1}
I20260811 17:11:17.094296 28021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:17.051379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:58451 (local address 127.4.146.254:35319)
0811 17:11:17.058353 (+ 6974us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:17.058379 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:17.058430 (+ 51us) server_negotiation.cc:407] Connection header received
0811 17:11:17.058757 (+ 327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:17.058772 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:17.059278 (+ 506us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:17.059712 (+ 434us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:17.062721 (+ 3009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:17.064705 (+ 1984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:17.072273 (+ 7568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:17.073601 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:17.074786 (+ 1185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:17.084913 (+ 10127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:17.084924 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:17.084951 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:17.085006 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:17.087587 (+ 2581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:17.088596 (+ 1009us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:17.088604 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:17.088609 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:17.088798 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:17.089286 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:17.089290 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:17.089291 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:17.089861 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:17.090010 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:17.092828 (+ 2818us) server_negotiation.cc:299] Negotiation successful
0811 17:11:17.093233 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6761,"thread_start_us":152,"threads_started":1}
I20260811 17:11:17.098289 28015 heartbeater.cc:347] Connected to a master server at 127.4.146.254:35319
I20260811 17:11:17.098630 28015 heartbeater.cc:464] Registering TS with master...
I20260811 17:11:17.099427 28015 heartbeater.cc:511] Master 127.4.146.254:35319 requested a full tablet report, sending...
W20260811 17:11:17.102180 28015 heartbeater.cc:644] Failed to heartbeat to 127.4.146.254:35319 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 17:11:17.102332 28015 heartbeater.cc:464] Registering TS with master...
I20260811 17:11:17.102563 28015 heartbeater.cc:511] Master 127.4.146.254:35319 requested a full tablet report, sending...
I20260811 17:11:17.103792 28015 heartbeater.cc:464] Registering TS with master...
I20260811 17:11:17.104033 28015 heartbeater.cc:511] Master 127.4.146.254:35319 requested a full tablet report, sending...
W20260811 17:11:17.105082 28015 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 17:11:17.223131 28019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:17.223441 28019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:17.223519 28019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:17.228411 28019 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:17.228523 28019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:17.228621 28019 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:11:17.235100 28019 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:37985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.4.146.212:40731/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:38041
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=36721
--tserver_master_addrs=127.4.146.254:35319
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28019
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:17.236425 28019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:17.237607 28019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:17.250614 28031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:17.250653 28033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:17.251391 28019 server_base.cc:1034] running on GCE node
W20260811 17:11:17.251587 28028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:17.252190 28019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:17.253096 28019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:17.254323 28019 hybrid_clock.cc:648] HybridClock initialized: now 1786468277254283 us; error 63 us; skew 500 ppm
Aug 11 17:11:17 dist-test-slave-7vjv krb5kdc[25949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468277, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:17.258304 28019 init.cc:377] Logged in from keytab as kudu/127.4.146.194@KRBTEST.COM (short username kudu)
I20260811 17:11:17.259487 28019 webserver.cc:460] Webserver started at http://127.4.146.194:36721/ using document root <none> and password file <none>
I20260811 17:11:17.260242 28019 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:17.260380 28019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 17:11:17 dist-test-slave-7vjv krb5kdc[25949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468277, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for HTTP/127.4.146.212@KRBTEST.COM
I20260811 17:11:17.293740 28019 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.004s
I20260811 17:11:17.305403 28050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:17.307796 28019 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.002s sys 0.000s
I20260811 17:11:17.307984 28019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "934daa2173fc40c78a70c4754f248ff1"
format_stamp: "Formatted at 2026-08-11 17:11:15 on dist-test-slave-7vjv"
server_key: "72cca25bed7f4ad853b620f258d515b1"
server_key_iv: "1989338d6329011331624855e718c3c5"
server_key_version: "kuduclusterkey@0"
I20260811 17:11:17.308883 28019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:17.344573 28019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:17.349030 28019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:17.349291 28019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:17.350181 28019 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:11:17.351387 28019 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:11:17.351462 28019 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:17.351522 28019 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:11:17.351567 28019 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:17.364339 28019 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:38041
I20260811 17:11:17.364403 28255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:38041 every 8 connection(s)
I20260811 17:11:17.365968 28019 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:11:17.371631 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 28019
I20260811 17:11:17.374536 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.4.146.212:40731/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:33333
--local_ip_for_outbound_sockets=127.4.146.195
--tserver_master_addrs=127.4.146.254:35319
--webserver_port=37865
--webserver_interface=127.4.146.195
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:37985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.4.146.212:40731/kms with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 17:11:17 dist-test-slave-7vjv krb5kdc[25949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468277, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:11:17.393702 28021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:17.370565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:36889 (local address 127.4.146.254:35319)
0811 17:11:17.370743 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:17.370749 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:17.370771 (+ 22us) server_negotiation.cc:407] Connection header received
0811 17:11:17.378675 (+ 7904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:17.378681 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:17.378773 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:17.378853 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:17.381152 (+ 2299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:17.382056 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:17.384086 (+ 2030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:17.384567 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:17.384733 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:17.388343 (+ 3610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:17.388348 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:17.388354 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:17.388394 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:17.390438 (+ 2044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:17.391333 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:17.391340 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:17.391343 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:17.391460 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:17.392001 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:17.392005 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:17.392007 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:17.392343 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:17.392476 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:17.393337 (+ 861us) server_negotiation.cc:299] Negotiation successful
0811 17:11:17.393503 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 17:11:17.396497 28268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:17.369251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:35319 (local address 127.4.146.194:36889)
0811 17:11:17.369923 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:17.369986 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:17.371081 (+ 1095us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:17.379496 (+ 8415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:17.379508 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:17.379989 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:17.380865 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:17.380896 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:17.382287 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:17.382291 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:17.383871 (+ 1580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:17.383890 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:17.384805 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:17.384811 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:17.385078 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:17.385919 (+ 841us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:17.385944 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:17.388031 (+ 2087us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:17.390617 (+ 2586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:17.390628 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:17.390655 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:17.391167 (+ 512us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:17.391582 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:17.391587 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:17.391591 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:17.391856 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:17.392486 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:17.392497 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:17.392964 (+ 467us) client_negotiation.cc:769] Sending connection context
0811 17:11:17.393239 (+ 275us) client_negotiation.cc:240] Negotiation successful
0811 17:11:17.393652 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":203,"threads_started":1}
I20260811 17:11:17.398201 28257 heartbeater.cc:347] Connected to a master server at 127.4.146.254:35319
I20260811 17:11:17.398540 28257 heartbeater.cc:464] Registering TS with master...
I20260811 17:11:17.399251 28257 heartbeater.cc:511] Master 127.4.146.254:35319 requested a full tablet report, sending...
W20260811 17:11:17.401288 28257 heartbeater.cc:644] Failed to heartbeat to 127.4.146.254:35319 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 17:11:17.401480 28257 heartbeater.cc:464] Registering TS with master...
I20260811 17:11:17.401762 28257 heartbeater.cc:511] Master 127.4.146.254:35319 requested a full tablet report, sending...
I20260811 17:11:17.402992 28257 heartbeater.cc:464] Registering TS with master...
I20260811 17:11:17.403244 28257 heartbeater.cc:511] Master 127.4.146.254:35319 requested a full tablet report, sending...
W20260811 17:11:17.404402 28257 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 17:11:17.530758 28272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:17.531205 28272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:17.531278 28272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:17.537046 28272 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:17.537170 28272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:17.537288 28272 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:11:17.545487 28272 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:37985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.4.146.212:40731/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:33333
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=37865
--tserver_master_addrs=127.4.146.254:35319
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28272
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:17.546823 28272 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:17.548063 28272 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:17.559326 28281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:17.559726 28283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:17.559706 28279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:17.560166 28272 server_base.cc:1034] running on GCE node
I20260811 17:11:17.560863 28272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:17.561652 28272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:17.562858 28272 hybrid_clock.cc:648] HybridClock initialized: now 1786468277562816 us; error 58 us; skew 500 ppm
Aug 11 17:11:17 dist-test-slave-7vjv krb5kdc[25949](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468277, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:17.568765 28272 init.cc:377] Logged in from keytab as kudu/127.4.146.195@KRBTEST.COM (short username kudu)
I20260811 17:11:17.569967 28272 webserver.cc:460] Webserver started at http://127.4.146.195:37865/ using document root <none> and password file <none>
I20260811 17:11:17.570600 28272 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:17.570684 28272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 17:11:17 dist-test-slave-7vjv krb5kdc[25949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468277, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for HTTP/127.4.146.212@KRBTEST.COM
I20260811 17:11:17.599504 28272 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.004s sys 0.000s
I20260811 17:11:17.602900 28301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:17.604507 28272 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 17:11:17.604682 28272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "4be74cd6539f4033bb7820631eba8cc5"
format_stamp: "Formatted at 2026-08-11 17:11:16 on dist-test-slave-7vjv"
server_key: "f4fc53ed82e3a6923214a37e1c99c478"
server_key_iv: "72279bf08ab599f984f2b53484c87b54"
server_key_version: "kuduclusterkey@0"
I20260811 17:11:17.605494 28272 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:17.629983 28272 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:17.633996 28272 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:17.634267 28272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:17.635181 28272 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:11:17.636647 28272 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:11:17.636710 28272 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:17.636759 28272 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:11:17.636812 28272 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:17.650665 28272 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:33333
I20260811 17:11:17.650857 28493 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:33333 every 8 connection(s)
I20260811 17:11:17.652735 28272 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:11:17.658027 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 28272
Aug 11 17:11:17 dist-test-slave-7vjv krb5kdc[25949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468277, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:11:17.671952 28021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:17.655121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:37345 (local address 127.4.146.254:35319)
0811 17:11:17.656839 (+ 1718us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:17.656844 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:17.657367 (+ 523us) server_negotiation.cc:407] Connection header received
0811 17:11:17.658470 (+ 1103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:17.658474 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:17.658538 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:17.658635 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:17.660330 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:17.661204 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:17.663257 (+ 2053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:17.663638 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:17.663765 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:17.666876 (+ 3111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:17.666880 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:17.666883 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:17.666912 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:17.668993 (+ 2081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:17.669804 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:17.669808 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:17.669810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:17.669919 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:17.670410 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:17.670414 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:17.670416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:17.670659 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:17.670763 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:17.671638 (+ 875us) server_negotiation.cc:299] Negotiation successful
0811 17:11:17.671777 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1591}
I20260811 17:11:17.673803 28498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:17.655612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:35319 (local address 127.4.146.195:37345)
0811 17:11:17.657182 (+ 1570us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:17.657234 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:17.658228 (+ 994us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:17.659024 (+ 796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:17.659036 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:17.659401 (+ 365us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:17.659987 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:17.660072 (+ 85us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:17.661415 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:17.661421 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:17.663078 (+ 1657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:17.663093 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:17.663874 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:17.663880 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:17.664182 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:17.664950 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:17.664982 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:17.666660 (+ 1678us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:17.669174 (+ 2514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:17.669183 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:17.669207 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:17.669657 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:17.670038 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:17.670042 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:17.670044 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:17.670275 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:17.670844 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:17.670852 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:17.671285 (+ 433us) client_negotiation.cc:769] Sending connection context
0811 17:11:17.672215 (+ 930us) client_negotiation.cc:240] Negotiation successful
0811 17:11:17.672622 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1348,"thread_start_us":169,"threads_started":1}
I20260811 17:11:17.675350 28495 heartbeater.cc:347] Connected to a master server at 127.4.146.254:35319
I20260811 17:11:17.675678 28495 heartbeater.cc:464] Registering TS with master...
I20260811 17:11:17.676433 28495 heartbeater.cc:511] Master 127.4.146.254:35319 requested a full tablet report, sending...
I20260811 17:11:17.678153 28506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:17.658817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57010 (local address 127.4.146.254:35319)
0811 17:11:17.659088 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:17.659101 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:17.664325 (+ 5224us) server_negotiation.cc:407] Connection header received
0811 17:11:17.664484 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:17.664490 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:17.664926 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:17.665036 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:17.669335 (+ 4299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:17.670094 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:17.671074 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:17.671337 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:17.671453 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:17.673148 (+ 1695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:17.673152 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:17.673155 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:17.673189 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:17.675087 (+ 1898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:17.676217 (+ 1130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:17.676221 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:17.676224 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:17.676336 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:17.676801 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:17.676805 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:17.676807 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:17.677074 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:17.677299 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:17.677839 (+ 540us) server_negotiation.cc:299] Negotiation successful
0811 17:11:17.678001 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"thread_start_us":98,"threads_started":1}
W20260811 17:11:17.678622 28495 heartbeater.cc:644] Failed to heartbeat to 127.4.146.254:35319 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 17:11:17.678875 28495 heartbeater.cc:464] Registering TS with master...
I20260811 17:11:17.679324 28495 heartbeater.cc:511] Master 127.4.146.254:35319 requested a full tablet report, sending...
I20260811 17:11:17.680586 28495 heartbeater.cc:464] Registering TS with master...
I20260811 17:11:17.680804 28495 heartbeater.cc:511] Master 127.4.146.254:35319 requested a full tablet report, sending...
W20260811 17:11:17.681913 28495 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 17:11:18 dist-test-slave-7vjv krb5kdc[25949](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786468278, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:18.105438 28015 heartbeater.cc:464] Registering TS with master...
I20260811 17:11:18.105815 28015 heartbeater.cc:511] Master 127.4.146.254:35319 requested a full tablet report, sending...
I20260811 17:11:18.107309 27658 ts_manager.cc:194] Registered new tserver with Master: f728d40293b547eca9eb76fff75b714b (127.4.146.193:38983)
I20260811 17:11:18.109189 27658 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.193@KRBTEST.COM'} at 127.4.146.193:58451
I20260811 17:11:18.404716 28257 heartbeater.cc:464] Registering TS with master...
I20260811 17:11:18.405197 28257 heartbeater.cc:511] Master 127.4.146.254:35319 requested a full tablet report, sending...
I20260811 17:11:18.406342 27658 ts_manager.cc:194] Registered new tserver with Master: 934daa2173fc40c78a70c4754f248ff1 (127.4.146.194:38041)
I20260811 17:11:18.407313 27658 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.194@KRBTEST.COM'} at 127.4.146.194:36889
Aug 11 17:11:18 dist-test-slave-7vjv krb5kdc[25949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468278, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for HTTP/127.4.146.212@KRBTEST.COM
I20260811 17:11:18.682224 28495 heartbeater.cc:464] Registering TS with master...
I20260811 17:11:18.682577 28495 heartbeater.cc:511] Master 127.4.146.254:35319 requested a full tablet report, sending...
I20260811 17:11:18.683558 27663 ts_manager.cc:194] Registered new tserver with Master: 4be74cd6539f4033bb7820631eba8cc5 (127.4.146.195:33333)
I20260811 17:11:18.684042 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 17:11:18.684450 27663 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.195@KRBTEST.COM'} at 127.4.146.195:37345
I20260811 17:11:18.699420 28547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:18.688107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57026 (local address 127.4.146.254:35319)
0811 17:11:18.688959 (+ 852us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:18.688964 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:18.689246 (+ 282us) server_negotiation.cc:407] Connection header received
0811 17:11:18.689442 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:18.689446 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:18.689497 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:18.689567 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:18.690603 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:18.691435 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:18.692711 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:18.693101 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:18.693181 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:18.695183 (+ 2002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:18.695187 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:18.695190 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:18.695222 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:18.697267 (+ 2045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:18.697833 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:18.697837 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:18.697839 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:18.697931 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:18.698257 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:18.698260 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:18.698262 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:18.698506 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:18.698623 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:18.699033 (+ 410us) server_negotiation.cc:299] Negotiation successful
0811 17:11:18.699221 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":763,"thread_start_us":117,"threads_started":1}
I20260811 17:11:18.705277 27663 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57026:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 17:11:18.710734 27663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:11:18.734222 28565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:18.724730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:33333 (local address 127.0.0.1:49830)
0811 17:11:18.725921 (+ 1191us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:18.725933 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:18.726000 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:18.727251 (+ 1251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:18.727258 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:18.727282 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:11:18.727409 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:18.727415 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:18.729767 (+ 2352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:18.729771 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:18.732224 (+ 2453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:18.732230 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:18.733625 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:18.733629 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:18.733753 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:18.733807 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 17:11:18.733922 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 17:11:18.734057 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1133,"thread_start_us":102,"threads_started":1}
I20260811 17:11:18.734961 28568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:18.725875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35796 (local address 127.4.146.193:38983)
0811 17:11:18.727787 (+ 1912us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:18.727795 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:18.727820 (+ 25us) server_negotiation.cc:407] Connection header received
0811 17:11:18.727898 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:18.727903 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:18.728136 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:18.728600 (+ 464us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:11:18.728763 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:18.729974 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:18.732890 (+ 2916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:18.733755 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:18.734469 (+ 714us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:18.734652 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:18.734713 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 17:11:18.734817 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1802,"thread_start_us":76,"threads_started":1}
I20260811 17:11:18.734395 28562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:18.724618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:38983 (local address 127.0.0.1:35796)
0811 17:11:18.725522 (+ 904us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:18.725576 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:18.725712 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:18.728302 (+ 2590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:18.728305 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:18.728325 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:11:18.728422 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:18.728428 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:18.730458 (+ 2030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:18.730461 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:18.732070 (+ 1609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:18.732081 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:18.733912 (+ 1831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:18.733916 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:18.734016 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:18.734045 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 17:11:18.734095 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 17:11:18.734172 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":709,"mutex_wait_us":460,"thread_start_us":105,"threads_started":1}
I20260811 17:11:18.736481 28566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:18.725521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49830 (local address 127.4.146.195:33333)
0811 17:11:18.726214 (+ 693us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:18.726222 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:18.726245 (+ 23us) server_negotiation.cc:407] Connection header received
0811 17:11:18.726704 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:18.726711 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:18.726934 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:18.727077 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:11:18.727551 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:18.729627 (+ 2076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:18.732341 (+ 2714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:18.733281 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:18.733387 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:18.733560 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:18.736201 (+ 2641us) server_negotiation.cc:299] Negotiation successful
0811 17:11:18.736331 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":591,"thread_start_us":75,"threads_started":1}
I20260811 17:11:18.740377 28380 tablet_service.cc:1467] Processing CreateTablet for tablet 4a6654f996e54d5e82fc5e35af7a7a04 (DEFAULT_TABLE table=test-table [id=c725e4a9a79849f98a6364a598000129]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:11:18.743103 28380 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a6654f996e54d5e82fc5e35af7a7a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:11:18.742595 27895 tablet_service.cc:1467] Processing CreateTablet for tablet 4a6654f996e54d5e82fc5e35af7a7a04 (DEFAULT_TABLE table=test-table [id=c725e4a9a79849f98a6364a598000129]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:11:18.743894 27895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a6654f996e54d5e82fc5e35af7a7a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:11:18.756173 28572 tablet_bootstrap.cc:492] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5: Bootstrap starting.
I20260811 17:11:18.758870 28572 tablet_bootstrap.cc:654] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5: Neither blocks nor log segments found. Creating new log.
I20260811 17:11:18.761327 28572 log.cc:824] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5: Log is configured to *not* fsync() on all Append() calls
I20260811 17:11:18.764025 28572 tablet_bootstrap.cc:492] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5: No bootstrap required, opened a new log
I20260811 17:11:18.764295 28572 ts_tablet_manager.cc:1397] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260811 17:11:18.767614 28570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:18.726880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:38041 (local address 127.0.0.1:56510)
0811 17:11:18.730215 (+ 3335us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:18.730231 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:18.730327 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:18.732624 (+ 2297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:18.732627 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:18.732648 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:11:18.732742 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:18.732749 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:18.764347 (+ 31598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:18.764352 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:18.765591 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:18.765612 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:18.767093 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:18.767101 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:18.767215 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:18.767255 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 17:11:18.767322 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 17:11:18.767421 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3263,"thread_start_us":94,"threads_started":1}
I20260811 17:11:18.770102 28572 raft_consensus.cc:348] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be74cd6539f4033bb7820631eba8cc5" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 33333 } } peers { permanent_uuid: "f728d40293b547eca9eb76fff75b714b" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38983 } } peers { permanent_uuid: "934daa2173fc40c78a70c4754f248ff1" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38041 } }
I20260811 17:11:18.770589 28572 raft_consensus.cc:374] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:11:18.770700 28572 raft_consensus.cc:729] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4be74cd6539f4033bb7820631eba8cc5, State: Initialized, Role: FOLLOWER
I20260811 17:11:18.771210 28571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:18.727298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56510 (local address 127.4.146.194:38041)
0811 17:11:18.731813 (+ 4515us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:18.731821 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:18.731847 (+ 26us) server_negotiation.cc:407] Connection header received
0811 17:11:18.731933 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:18.731940 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:18.732239 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:18.732419 (+ 180us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:11:18.735340 (+ 2921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:18.736600 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:18.765849 (+ 29249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:18.766897 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:18.770656 (+ 3759us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:18.770855 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:18.770923 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 17:11:18.771039 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4391,"thread_start_us":75,"threads_started":1}
I20260811 17:11:18.771275 28572 consensus_queue.cc:260] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be74cd6539f4033bb7820631eba8cc5" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 33333 } } peers { permanent_uuid: "f728d40293b547eca9eb76fff75b714b" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38983 } } peers { permanent_uuid: "934daa2173fc40c78a70c4754f248ff1" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38041 } }
I20260811 17:11:18.772449 28572 ts_tablet_manager.cc:1428] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260811 17:11:18.772929 28495 heartbeater.cc:503] Master 127.4.146.254:35319 was elected leader, sending a full tablet report...
I20260811 17:11:18.773231 28575 tablet_bootstrap.cc:492] T 4a6654f996e54d5e82fc5e35af7a7a04 P f728d40293b547eca9eb76fff75b714b: Bootstrap starting.
I20260811 17:11:18.775767 28575 tablet_bootstrap.cc:654] T 4a6654f996e54d5e82fc5e35af7a7a04 P f728d40293b547eca9eb76fff75b714b: Neither blocks nor log segments found. Creating new log.
I20260811 17:11:18.776803 28575 log.cc:824] T 4a6654f996e54d5e82fc5e35af7a7a04 P f728d40293b547eca9eb76fff75b714b: Log is configured to *not* fsync() on all Append() calls
I20260811 17:11:18.780419 28112 tablet_service.cc:1467] Processing CreateTablet for tablet 4a6654f996e54d5e82fc5e35af7a7a04 (DEFAULT_TABLE table=test-table [id=c725e4a9a79849f98a6364a598000129]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:11:18.781718 28112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a6654f996e54d5e82fc5e35af7a7a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:11:18.783953 28575 tablet_bootstrap.cc:492] T 4a6654f996e54d5e82fc5e35af7a7a04 P f728d40293b547eca9eb76fff75b714b: No bootstrap required, opened a new log
I20260811 17:11:18.784286 28575 ts_tablet_manager.cc:1397] T 4a6654f996e54d5e82fc5e35af7a7a04 P f728d40293b547eca9eb76fff75b714b: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.004s
I20260811 17:11:18.794811 28579 tablet_bootstrap.cc:492] T 4a6654f996e54d5e82fc5e35af7a7a04 P 934daa2173fc40c78a70c4754f248ff1: Bootstrap starting.
I20260811 17:11:18.797281 28575 raft_consensus.cc:348] T 4a6654f996e54d5e82fc5e35af7a7a04 P f728d40293b547eca9eb76fff75b714b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be74cd6539f4033bb7820631eba8cc5" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 33333 } } peers { permanent_uuid: "f728d40293b547eca9eb76fff75b714b" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38983 } } peers { permanent_uuid: "934daa2173fc40c78a70c4754f248ff1" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38041 } }
I20260811 17:11:18.797742 28579 tablet_bootstrap.cc:654] T 4a6654f996e54d5e82fc5e35af7a7a04 P 934daa2173fc40c78a70c4754f248ff1: Neither blocks nor log segments found. Creating new log.
I20260811 17:11:18.798807 28579 log.cc:824] T 4a6654f996e54d5e82fc5e35af7a7a04 P 934daa2173fc40c78a70c4754f248ff1: Log is configured to *not* fsync() on all Append() calls
I20260811 17:11:18.798943 28575 raft_consensus.cc:374] T 4a6654f996e54d5e82fc5e35af7a7a04 P f728d40293b547eca9eb76fff75b714b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:11:18.799362 28575 raft_consensus.cc:729] T 4a6654f996e54d5e82fc5e35af7a7a04 P f728d40293b547eca9eb76fff75b714b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f728d40293b547eca9eb76fff75b714b, State: Initialized, Role: FOLLOWER
I20260811 17:11:18.801779 28579 tablet_bootstrap.cc:492] T 4a6654f996e54d5e82fc5e35af7a7a04 P 934daa2173fc40c78a70c4754f248ff1: No bootstrap required, opened a new log
I20260811 17:11:18.802021 28579 ts_tablet_manager.cc:1397] T 4a6654f996e54d5e82fc5e35af7a7a04 P 934daa2173fc40c78a70c4754f248ff1: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 17:11:18.800212 28575 consensus_queue.cc:260] T 4a6654f996e54d5e82fc5e35af7a7a04 P f728d40293b547eca9eb76fff75b714b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be74cd6539f4033bb7820631eba8cc5" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 33333 } } peers { permanent_uuid: "f728d40293b547eca9eb76fff75b714b" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38983 } } peers { permanent_uuid: "934daa2173fc40c78a70c4754f248ff1" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38041 } }
I20260811 17:11:18.805740 28575 ts_tablet_manager.cc:1428] T 4a6654f996e54d5e82fc5e35af7a7a04 P f728d40293b547eca9eb76fff75b714b: Time spent starting tablet: real 0.021s user 0.007s sys 0.000s
I20260811 17:11:18.806247 28015 heartbeater.cc:503] Master 127.4.146.254:35319 was elected leader, sending a full tablet report...
I20260811 17:11:18.806841 28579 raft_consensus.cc:348] T 4a6654f996e54d5e82fc5e35af7a7a04 P 934daa2173fc40c78a70c4754f248ff1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be74cd6539f4033bb7820631eba8cc5" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 33333 } } peers { permanent_uuid: "f728d40293b547eca9eb76fff75b714b" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38983 } } peers { permanent_uuid: "934daa2173fc40c78a70c4754f248ff1" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38041 } }
I20260811 17:11:18.807132 28579 raft_consensus.cc:374] T 4a6654f996e54d5e82fc5e35af7a7a04 P 934daa2173fc40c78a70c4754f248ff1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:11:18.808388 28579 raft_consensus.cc:729] T 4a6654f996e54d5e82fc5e35af7a7a04 P 934daa2173fc40c78a70c4754f248ff1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 934daa2173fc40c78a70c4754f248ff1, State: Initialized, Role: FOLLOWER
I20260811 17:11:18.808946 28579 consensus_queue.cc:260] T 4a6654f996e54d5e82fc5e35af7a7a04 P 934daa2173fc40c78a70c4754f248ff1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be74cd6539f4033bb7820631eba8cc5" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 33333 } } peers { permanent_uuid: "f728d40293b547eca9eb76fff75b714b" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38983 } } peers { permanent_uuid: "934daa2173fc40c78a70c4754f248ff1" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38041 } }
I20260811 17:11:18.810191 28579 ts_tablet_manager.cc:1428] T 4a6654f996e54d5e82fc5e35af7a7a04 P 934daa2173fc40c78a70c4754f248ff1: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
I20260811 17:11:18.810585 28257 heartbeater.cc:503] Master 127.4.146.254:35319 was elected leader, sending a full tablet report...
I20260811 17:11:18.813045 28576 raft_consensus.cc:482] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:11:18.813256 28576 raft_consensus.cc:504] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be74cd6539f4033bb7820631eba8cc5" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 33333 } } peers { permanent_uuid: "f728d40293b547eca9eb76fff75b714b" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38983 } } peers { permanent_uuid: "934daa2173fc40c78a70c4754f248ff1" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38041 } }
I20260811 17:11:18.814772 28576 leader_election.cc:288] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f728d40293b547eca9eb76fff75b714b (127.4.146.193:38983), 934daa2173fc40c78a70c4754f248ff1 (127.4.146.194:38041)
I20260811 17:11:18.820236 28568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:18.815240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:35037 (local address 127.4.146.193:38983)
0811 17:11:18.815396 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:18.815401 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:18.815609 (+ 208us) server_negotiation.cc:407] Connection header received
0811 17:11:18.815805 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:18.815808 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:18.815854 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:18.815901 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:11:18.816366 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:18.817121 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:18.818722 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:18.819404 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:18.819506 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:18.819562 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:18.819961 (+ 399us) server_negotiation.cc:299] Negotiation successful
0811 17:11:18.820053 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 17:11:18.820773 28583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:18.815162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:38983 (local address 127.4.146.195:35037)
0811 17:11:18.815519 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:18.815535 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:18.815687 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:18.816047 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:18.816049 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:18.816067 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:11:18.816241 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:18.816247 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:18.817267 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:18.817270 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:18.818571 (+ 1301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:18.818582 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:18.819682 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:18.819686 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:18.819807 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:18.819832 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 17:11:18.820486 (+ 654us) client_negotiation.cc:240] Negotiation successful
0811 17:11:18.820585 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":154,"threads_started":1}
I20260811 17:11:18.821651 27934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a6654f996e54d5e82fc5e35af7a7a04" candidate_uuid: "4be74cd6539f4033bb7820631eba8cc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f728d40293b547eca9eb76fff75b714b" is_pre_election: true
I20260811 17:11:18.822057 27934 raft_consensus.cc:2454] T 4a6654f996e54d5e82fc5e35af7a7a04 P f728d40293b547eca9eb76fff75b714b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4be74cd6539f4033bb7820631eba8cc5 in term 0.
I20260811 17:11:18.822680 28571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:18.816111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:60911 (local address 127.4.146.194:38041)
0811 17:11:18.816233 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:18.816237 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:18.816499 (+ 262us) server_negotiation.cc:407] Connection header received
0811 17:11:18.816728 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:18.816732 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:18.816782 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:18.816830 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:11:18.817256 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:18.817974 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:18.819605 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:18.820225 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:18.820325 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:18.820377 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:18.822460 (+ 2083us) server_negotiation.cc:299] Negotiation successful
0811 17:11:18.822561 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 17:11:18.822662 28302 leader_election.cc:302] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be74cd6539f4033bb7820631eba8cc5, f728d40293b547eca9eb76fff75b714b; no voters:
Aug 11 17:11:18 dist-test-slave-7vjv krb5kdc[25949](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468278, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for HTTP/127.4.146.212@KRBTEST.COM
I20260811 17:11:18.823028 28576 raft_consensus.cc:2781] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:11:18.823140 28576 raft_consensus.cc:482] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:11:18.823187 28576 raft_consensus.cc:3037] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:11:18.823448 28584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:18.815639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:38041 (local address 127.4.146.195:60911)
0811 17:11:18.816403 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:18.816417 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:18.816595 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:18.816969 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:18.816975 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:18.816994 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:11:18.817116 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:18.817123 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:18.818225 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:18.818228 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:18.819420 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:18.819432 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:18.820719 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:18.820722 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:18.820828 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:18.820850 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 17:11:18.823087 (+ 2237us) client_negotiation.cc:240] Negotiation successful
0811 17:11:18.823176 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":682,"thread_start_us":103,"threads_started":1}
I20260811 17:11:18.824307 28175 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a6654f996e54d5e82fc5e35af7a7a04" candidate_uuid: "4be74cd6539f4033bb7820631eba8cc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "934daa2173fc40c78a70c4754f248ff1" is_pre_election: true
I20260811 17:11:18.824651 28175 raft_consensus.cc:2454] T 4a6654f996e54d5e82fc5e35af7a7a04 P 934daa2173fc40c78a70c4754f248ff1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4be74cd6539f4033bb7820631eba8cc5 in term 0.
I20260811 17:11:18.824795 28576 raft_consensus.cc:504] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be74cd6539f4033bb7820631eba8cc5" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 33333 } } peers { permanent_uuid: "f728d40293b547eca9eb76fff75b714b" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38983 } } peers { permanent_uuid: "934daa2173fc40c78a70c4754f248ff1" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38041 } }
I20260811 17:11:18.825263 28576 leader_election.cc:288] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5 [CANDIDATE]: Term 1 election: Requested vote from peers f728d40293b547eca9eb76fff75b714b (127.4.146.193:38983), 934daa2173fc40c78a70c4754f248ff1 (127.4.146.194:38041)
I20260811 17:11:18.826272 27934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a6654f996e54d5e82fc5e35af7a7a04" candidate_uuid: "4be74cd6539f4033bb7820631eba8cc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f728d40293b547eca9eb76fff75b714b"
I20260811 17:11:18.826423 27934 raft_consensus.cc:3037] T 4a6654f996e54d5e82fc5e35af7a7a04 P f728d40293b547eca9eb76fff75b714b [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:11:18.827984 27934 raft_consensus.cc:2454] T 4a6654f996e54d5e82fc5e35af7a7a04 P f728d40293b547eca9eb76fff75b714b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4be74cd6539f4033bb7820631eba8cc5 in term 1.
I20260811 17:11:18.828447 28175 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a6654f996e54d5e82fc5e35af7a7a04" candidate_uuid: "4be74cd6539f4033bb7820631eba8cc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "934daa2173fc40c78a70c4754f248ff1"
I20260811 17:11:18.828612 28175 raft_consensus.cc:3037] T 4a6654f996e54d5e82fc5e35af7a7a04 P 934daa2173fc40c78a70c4754f248ff1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:11:18.830132 28175 raft_consensus.cc:2454] T 4a6654f996e54d5e82fc5e35af7a7a04 P 934daa2173fc40c78a70c4754f248ff1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4be74cd6539f4033bb7820631eba8cc5 in term 1.
I20260811 17:11:18.830256 28302 leader_election.cc:302] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4be74cd6539f4033bb7820631eba8cc5, f728d40293b547eca9eb76fff75b714b; no voters:
I20260811 17:11:18.830470 28576 raft_consensus.cc:2781] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:11:18.830837 28576 raft_consensus.cc:686] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5 [term 1 LEADER]: Becoming Leader. State: Replica: 4be74cd6539f4033bb7820631eba8cc5, State: Running, Role: LEADER
I20260811 17:11:18.831262 28576 consensus_queue.cc:237] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be74cd6539f4033bb7820631eba8cc5" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 33333 } } peers { permanent_uuid: "f728d40293b547eca9eb76fff75b714b" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38983 } } peers { permanent_uuid: "934daa2173fc40c78a70c4754f248ff1" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38041 } }
I20260811 17:11:18.836836 27658 catalog_manager.cc:5495] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4be74cd6539f4033bb7820631eba8cc5 (127.4.146.195). New cstate: current_term: 1 leader_uuid: "4be74cd6539f4033bb7820631eba8cc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4be74cd6539f4033bb7820631eba8cc5" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 33333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f728d40293b547eca9eb76fff75b714b" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38983 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "934daa2173fc40c78a70c4754f248ff1" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38041 } health_report { overall_health: UNKNOWN } } }
I20260811 17:11:18.863826 28566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:18.857891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49840 (local address 127.4.146.195:33333)
0811 17:11:18.858015 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:18.858020 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:18.858096 (+ 76us) server_negotiation.cc:407] Connection header received
0811 17:11:18.858317 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:18.858321 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:18.858398 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:18.858531 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:11:18.859003 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:18.859765 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:18.861058 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:18.861421 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:18.861533 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:18.862129 (+ 596us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:11:18.862842 (+ 713us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:11:18.862970 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:18.863521 (+ 551us) server_negotiation.cc:299] Negotiation successful
0811 17:11:18.863614 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260811 17:11:18.868738 28258 tablet.cc:2369] T 4a6654f996e54d5e82fc5e35af7a7a04 P 934daa2173fc40c78a70c4754f248ff1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 17:11:18.874799 28175 raft_consensus.cc:1261] T 4a6654f996e54d5e82fc5e35af7a7a04 P 934daa2173fc40c78a70c4754f248ff1 [term 1 FOLLOWER]: Refusing update from remote peer 4be74cd6539f4033bb7820631eba8cc5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:11:18.875696 28576 consensus_queue.cc:1035] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "934daa2173fc40c78a70c4754f248ff1" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 38041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:11:18.877203 27934 raft_consensus.cc:1261] T 4a6654f996e54d5e82fc5e35af7a7a04 P f728d40293b547eca9eb76fff75b714b [term 1 FOLLOWER]: Refusing update from remote peer 4be74cd6539f4033bb7820631eba8cc5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:11:18.878134 28585 consensus_queue.cc:1035] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f728d40293b547eca9eb76fff75b714b" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:11:18.893069 28597 mvcc.cc:205] Tried to move back new op lower bound from 7317374070259666944 to 7317374070096482304. Current Snapshot: MvccSnapshot[applied={T|T < 7317374070259666944}]
I20260811 17:11:18.898289 28595 mvcc.cc:205] Tried to move back new op lower bound from 7317374070259666944 to 7317374070096482304. Current Snapshot: MvccSnapshot[applied={T|T < 7317374070259666944}]
I20260811 17:11:18.913165 27663 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57026:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:11:18.913383 27663 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57026:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:11:18.916814 27663 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3c7afccecace434eaa4dedd0f5ebadb2: Sending DeleteTablet for 3 replicas of tablet 4a6654f996e54d5e82fc5e35af7a7a04
I20260811 17:11:18.918197 28112 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a6654f996e54d5e82fc5e35af7a7a04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:11:18 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:56510
I20260811 17:11:18.918217 28380 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a6654f996e54d5e82fc5e35af7a7a04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:11:18 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:49830
I20260811 17:11:18.918681 27895 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a6654f996e54d5e82fc5e35af7a7a04 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:11:18 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:35796
I20260811 17:11:18.919875 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 27731
I20260811 17:11:18.944456 28612 tablet_replica.cc:330] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5: stopping tablet replica
I20260811 17:11:18.944952 28612 raft_consensus.cc:2229] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5 [term 1 LEADER]: Raft consensus shutting down.
I20260811 17:11:18.945417 28612 raft_consensus.cc:2258] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:11:18.949753 28612 ts_tablet_manager.cc:1905] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:11:18.953454 28612 ts_tablet_manager.cc:1918] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260811 17:11:18.966439 28604 log.cc:924] Time spent T 4a6654f996e54d5e82fc5e35af7a7a04 P 934daa2173fc40c78a70c4754f248ff1: Append to log took a long time: real 0.050s user 0.000s sys 0.000s
W20260811 17:11:18.967218 27628 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.146.193:38983 (error 108)
I20260811 17:11:18.968230 28612 log.cc:1196] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/4a6654f996e54d5e82fc5e35af7a7a04
I20260811 17:11:18.968390 28603 mvcc.cc:205] Tried to move back new op lower bound from 7317374070259666944 to 7317374070096482304. Current Snapshot: MvccSnapshot[applied={T|T < 7317374070259666944}]
I20260811 17:11:18.968755 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 28019
I20260811 17:11:18.968961 28612 ts_tablet_manager.cc:1939] T 4a6654f996e54d5e82fc5e35af7a7a04 P 4be74cd6539f4033bb7820631eba8cc5: Deleting consensus metadata
I20260811 17:11:18.970330 27634 catalog_manager.cc:4841] TS 4be74cd6539f4033bb7820631eba8cc5 (127.4.146.195:33333): tablet 4a6654f996e54d5e82fc5e35af7a7a04 (table test-table [id=c725e4a9a79849f98a6364a598000129]) successfully deleted
I20260811 17:11:18.998373 28570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:18.997994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:38983 (local address 127.0.0.1:35804)
0811 17:11:18.998150 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:18.998256 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.193:38983: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 17:11:18.998819 27628 catalog_manager.cc:4584] TS f728d40293b547eca9eb76fff75b714b (127.4.146.193:38983): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4a6654f996e54d5e82fc5e35af7a7a04: Network error: Client connection negotiation failed: client connection to 127.4.146.193:38983: connect: Connection refused (error 111)
I20260811 17:11:19.007921 28570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:19.007486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:38041 (local address 127.0.0.1:56526)
0811 17:11:19.007721 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:19.007806 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.194:38041: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147}
I20260811 17:11:19.020304 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 28272
I20260811 17:11:19.042699 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 27599
I20260811 17:11:19.067626 4683 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 17:11:19.420621 4683 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 17:11:19.420761 4683 mini_ranger.cc:66] Stopping Ranger...
I20260811 17:11:19.776371 4683 mini_ranger.cc:68] Stopped Ranger
2026-08-11 17:11:19.776 UTC [25999] LOG: received smart shutdown request
2026-08-11 17:11:19.782 UTC [25999] LOG: background worker "logical replication launcher" (PID 26014) exited with exit code 1
2026-08-11 17:11:19.782 UTC [26008] LOG: shutting down
2026-08-11 17:11:19.975 UTC [25999] LOG: database system is shut down
2026-08-11T17:11:19Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (56682 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:11:20 dist-test-slave-7vjv krb5kdc[28638](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:11:20 dist-test-slave-7vjv krb5kdc[28638](info): set up 2 sockets
Aug 11 17:11:20 dist-test-slave-7vjv krb5kdc[28638](info): commencing operation
krb5kdc: starting...
W20260811 17:11:21.484766 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.345s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:11:21 dist-test-slave-7vjv krb5kdc[28638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:11:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:11:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:11:21.649122 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:42203
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:34841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:42203,127.4.146.253:39177,127.4.146.252:36721
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:11:21.773581 28662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:21.773911 28662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:21.773959 28662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:21.778366 28662 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:11:21.778455 28662 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:21.778474 28662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:21.778492 28662 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:11:21.778507 28662 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:11:21.784544 28662 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:34841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:42203,127.4.146.253:39177,127.4.146.252:36721
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:42203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28662
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:21.785835 28662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:21.787005 28662 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:21.796784 28679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:21.796804 28675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:21.796802 28673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:21.797044 28662 server_base.cc:1034] running on GCE node
I20260811 17:11:21.797698 28662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:21.798981 28662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:21.800194 28662 hybrid_clock.cc:648] HybridClock initialized: now 1786468281800176 us; error 38 us; skew 500 ppm
Aug 11 17:11:21 dist-test-slave-7vjv krb5kdc[28638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468281, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:21.803262 28662 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:11:21.804384 28662 webserver.cc:460] Webserver started at http://127.4.146.254:38797/ using document root <none> and password file <none>
I20260811 17:11:21.805020 28662 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:21.805123 28662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:11:21.805379 28662 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:11:21.807561 28662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "b9c0ae58cdbc428280ff2b3956787390"
format_stamp: "Formatted at 2026-08-11 17:11:21 on dist-test-slave-7vjv"
server_key: "3a85a4f8e5cb3674a161b530ef72b563"
server_key_iv: "11c1dab1c679b1c5d036992666b66af2"
server_key_version: "encryptionkey@0"
I20260811 17:11:21.808254 28662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "b9c0ae58cdbc428280ff2b3956787390"
format_stamp: "Formatted at 2026-08-11 17:11:21 on dist-test-slave-7vjv"
server_key: "3a85a4f8e5cb3674a161b530ef72b563"
server_key_iv: "11c1dab1c679b1c5d036992666b66af2"
server_key_version: "encryptionkey@0"
I20260811 17:11:21.812583 28662 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 17:11:21.815506 28687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:21.817301 28662 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:11:21.817523 28662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "b9c0ae58cdbc428280ff2b3956787390"
format_stamp: "Formatted at 2026-08-11 17:11:21 on dist-test-slave-7vjv"
server_key: "3a85a4f8e5cb3674a161b530ef72b563"
server_key_iv: "11c1dab1c679b1c5d036992666b66af2"
server_key_version: "encryptionkey@0"
I20260811 17:11:21.817694 28662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:21.834424 28662 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:21.839193 28662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:21.839452 28662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:21.847689 28662 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:42203
I20260811 17:11:21.847721 28784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:42203 every 8 connection(s)
I20260811 17:11:21.848904 28662 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:11:21.851924 28785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:11:21.856052 28785 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42203 } has no permanent_uuid. Determining permanent_uuid...
I20260811 17:11:21.858421 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 28662
I20260811 17:11:21.858709 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:11:21.859069 4683 external_mini_cluster.cc:1428] Setting key 10af8ed2cfe11c5e8b4b9f1ac5589f49
Aug 11 17:11:21 dist-test-slave-7vjv krb5kdc[28638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468281, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.146.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.253@KRBTEST.COM" created.
I20260811 17:11:21.873204 28788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:21.859515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38320 (local address 127.4.146.254:42203)
0811 17:11:21.859816 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:21.859826 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:21.859861 (+ 35us) server_negotiation.cc:407] Connection header received
0811 17:11:21.861072 (+ 1211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:21.861077 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:21.861268 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:21.861469 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:21.862369 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:21.863284 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:21.864432 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:21.865144 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:21.865475 (+ 331us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:21.867915 (+ 2440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:21.867926 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:21.867944 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:21.867970 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:21.869750 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:21.870289 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:21.870295 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:21.870297 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:21.870414 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:21.870749 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:21.870754 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:21.870756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:21.871191 (+ 435us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:21.871345 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:21.871733 (+ 388us) server_negotiation.cc:299] Negotiation successful
0811 17:11:21.872040 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":79,"server-negotiator.queue_time_us":192,"thread_start_us":109,"threads_started":1}
I20260811 17:11:21.873201 28787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:21.858564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:42203 (local address 127.0.0.1:38320)
0811 17:11:21.859283 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:21.859352 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:21.860738 (+ 1386us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:21.861466 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:21.861471 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:21.861954 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:21.862214 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:21.862228 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:21.863409 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:21.863413 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:21.864278 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:21.864293 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:21.865338 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:21.865341 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:21.865531 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:21.866196 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:21.866214 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:21.867737 (+ 1523us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:21.869906 (+ 2169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:21.869918 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:21.869930 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:21.870167 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:21.870524 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:21.870527 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:21.870529 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:21.870649 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:21.871322 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:21.871328 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:21.871474 (+ 146us) client_negotiation.cc:769] Sending connection context
0811 17:11:21.871653 (+ 179us) client_negotiation.cc:240] Negotiation successful
0811 17:11:21.872114 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":424,"mutex_wait_us":203,"thread_start_us":180,"threads_started":1}
I20260811 17:11:21.876051 28785 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } has no permanent_uuid. Determining permanent_uuid...
I20260811 17:11:21.876976 28787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:21.876676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:39177 (local address 127.0.0.1:41528)
0811 17:11:21.876812 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:21.876903 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.253:39177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 17:11:21.877174 28696 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.146.253:39177: connect: Connection refused (error 111)
I20260811 17:11:21.878080 28787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:21.877851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:39177 (local address 127.0.0.1:41536)
0811 17:11:21.877963 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:21.878012 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.253:39177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 17:11:21.878214 28785 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.253:39177: Network error: Client connection negotiation failed: client connection to 127.4.146.253:39177: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.253.keytab.
Entry for principal kudu/127.4.146.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.253.keytab.
I20260811 17:11:21.892915 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.253:39177
--webserver_interface=127.4.146.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.253.keytab
--principal=kudu/127.4.146.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:34841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:42203,127.4.146.253:39177,127.4.146.252:36721
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 17:11:21.927510 28785 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } attempt: 1
I20260811 17:11:21.928710 28787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:21.928276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:39177 (local address 127.0.0.1:41550)
0811 17:11:21.928546 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:21.928620 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.253:39177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260811 17:11:21.929662 28787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:21.929392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:39177 (local address 127.0.0.1:41558)
0811 17:11:21.929527 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:21.929589 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.253:39177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 17:11:21.929811 28785 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.253:39177: Network error: Client connection negotiation failed: client connection to 127.4.146.253:39177: connect: Connection refused (error 111)
I20260811 17:11:21.998003 28785 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } attempt: 2
I20260811 17:11:21.998996 28787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:21.998671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:39177 (local address 127.0.0.1:41572)
0811 17:11:21.998840 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:21.998911 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.253:39177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 17:11:21.999812 28787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:21.999528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:39177 (local address 127.0.0.1:41584)
0811 17:11:21.999652 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:21.999721 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.253:39177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 17:11:22.000017 28785 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.253:39177: Network error: Client connection negotiation failed: client connection to 127.4.146.253:39177: connect: Connection refused (error 111)
W20260811 17:11:22.017505 28795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:22.017848 28795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:22.017891 28795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:22.022353 28795 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:11:22.022445 28795 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:22.022466 28795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:22.022485 28795 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:11:22.022501 28795 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:11:22.031172 28795 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:34841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:42203,127.4.146.253:39177,127.4.146.252:36721
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.253.keytab
--principal=kudu/127.4.146.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.253:39177
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.4.146.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28795
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:22.032548 28795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:22.033701 28795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:22.043954 28802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:22.044023 28795 server_base.cc:1034] running on GCE node
W20260811 17:11:22.043954 28803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:22.043954 28805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:22.045058 28795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:22.046319 28795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:22.047523 28795 hybrid_clock.cc:648] HybridClock initialized: now 1786468282047499 us; error 39 us; skew 500 ppm
Aug 11 17:11:22 dist-test-slave-7vjv krb5kdc[28638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468282, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:22.051190 28795 init.cc:377] Logged in from keytab as kudu/127.4.146.253@KRBTEST.COM (short username kudu)
I20260811 17:11:22.052292 28795 webserver.cc:460] Webserver started at http://127.4.146.253:35163/ using document root <none> and password file <none>
I20260811 17:11:22.052879 28795 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:22.052944 28795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:11:22.053156 28795 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:11:22.055399 28795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-1/data/instance:
uuid: "38c18dc7b0b74d5b8ff6fb0345917648"
format_stamp: "Formatted at 2026-08-11 17:11:22 on dist-test-slave-7vjv"
server_key: "5cb3817abee881a65c73a682caec70c5"
server_key_iv: "7f52e2abce42b0ac97dab4b2ed69bbde"
server_key_version: "encryptionkey@0"
I20260811 17:11:22.056162 28795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-1/wal/instance:
uuid: "38c18dc7b0b74d5b8ff6fb0345917648"
format_stamp: "Formatted at 2026-08-11 17:11:22 on dist-test-slave-7vjv"
server_key: "5cb3817abee881a65c73a682caec70c5"
server_key_iv: "7f52e2abce42b0ac97dab4b2ed69bbde"
server_key_version: "encryptionkey@0"
I20260811 17:11:22.060811 28795 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 17:11:22.064420 28822 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:22.066159 28795 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 17:11:22.066365 28795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-1/wal
uuid: "38c18dc7b0b74d5b8ff6fb0345917648"
format_stamp: "Formatted at 2026-08-11 17:11:22 on dist-test-slave-7vjv"
server_key: "5cb3817abee881a65c73a682caec70c5"
server_key_iv: "7f52e2abce42b0ac97dab4b2ed69bbde"
server_key_version: "encryptionkey@0"
I20260811 17:11:22.066546 28795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:22.085263 28795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:22.089562 28795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:22.089839 28795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:22.091259 28785 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } attempt: 3
I20260811 17:11:22.092233 28787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.091803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:39177 (local address 127.0.0.1:41600)
0811 17:11:22.091984 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:22.092072 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.253:39177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260811 17:11:22.093214 28787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.092892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:39177 (local address 127.0.0.1:41606)
0811 17:11:22.093030 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:22.093104 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.253:39177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 17:11:22.093428 28785 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.253:39177: Network error: Client connection negotiation failed: client connection to 127.4.146.253:39177: connect: Connection refused (error 111)
I20260811 17:11:22.098995 28795 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.253:39177
I20260811 17:11:22.099139 28911 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.253:39177 every 8 connection(s)
I20260811 17:11:22.100350 28795 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-1/data/info.pb
I20260811 17:11:22.102074 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 28795
I20260811 17:11:22.102259 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-1/wal/instance
I20260811 17:11:22.102604 4683 external_mini_cluster.cc:1428] Setting key 7699ab5094c2ab8c76598ca8e0c65aef
I20260811 17:11:22.104646 28915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:11:22.109649 28915 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42203 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.4.146.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.252@KRBTEST.COM" created.
Aug 11 17:11:22 dist-test-slave-7vjv krb5kdc[28638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468282, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.253@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:11:22.130541 28788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.112231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38332 (local address 127.4.146.254:42203)
0811 17:11:22.112389 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:22.112394 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:22.113967 (+ 1573us) server_negotiation.cc:407] Connection header received
0811 17:11:22.115122 (+ 1155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:22.115258 (+ 136us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:22.115337 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:22.115436 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:22.117593 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.118168 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.119989 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.120335 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.120475 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:22.124621 (+ 4146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:22.124625 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:22.124627 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:22.124660 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:22.127389 (+ 2729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.128288 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.128292 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.128293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.128396 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.128939 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.128943 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.128944 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.129221 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:22.129325 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:22.130162 (+ 837us) server_negotiation.cc:299] Negotiation successful
0811 17:11:22.130314 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 17:11:22.131449 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.112852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:42203 (local address 127.0.0.1:38332)
0811 17:11:22.113731 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:22.113791 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:22.114749 (+ 958us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:22.115739 (+ 990us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:22.115757 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:22.116495 (+ 738us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:22.117342 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:22.117374 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.118338 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.118345 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:22.119803 (+ 1458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:22.119818 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.120540 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.120544 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:22.120757 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:22.122005 (+ 1248us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:22.122028 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:22.124378 (+ 2350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:22.127623 (+ 3245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:22.127632 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:22.127663 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:22.128069 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:22.128523 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:22.128527 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:22.128529 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:22.128744 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:22.129367 (+ 623us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:22.129375 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:22.129797 (+ 422us) client_negotiation.cc:769] Sending connection context
0811 17:11:22.130007 (+ 210us) client_negotiation.cc:240] Negotiation successful
0811 17:11:22.130396 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":162,"threads_started":1}
I20260811 17:11:22.133824 28915 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 17:11:22 dist-test-slave-7vjv krb5kdc[28638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468282, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.253@KRBTEST.COM for kudu/127.4.146.253@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.252.keytab.
Entry for principal kudu/127.4.146.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.252.keytab.
I20260811 17:11:22.143679 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.252:36721
--webserver_interface=127.4.146.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.252.keytab
--principal=kudu/127.4.146.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:34841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:42203,127.4.146.253:39177,127.4.146.252:36721
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 17:11:22.147414 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.134424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:39177 (local address 127.0.0.1:41610)
0811 17:11:22.134583 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:22.134601 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:22.134717 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:22.135584 (+ 867us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:22.135587 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:22.135776 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:22.135893 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:22.135899 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.137303 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.137307 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:22.137985 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:22.137999 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.138963 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.138967 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:22.139162 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:22.140065 (+ 903us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:22.140079 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:22.141570 (+ 1491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:22.145038 (+ 3468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:22.145042 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:22.145044 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:22.145303 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:22.145805 (+ 502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:22.145807 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:22.145809 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:22.145907 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:22.146594 (+ 687us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:22.146599 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:22.146735 (+ 136us) client_negotiation.cc:769] Sending connection context
0811 17:11:22.146879 (+ 144us) client_negotiation.cc:240] Negotiation successful
0811 17:11:22.147126 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260811 17:11:22.147450 28924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.134692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41610 (local address 127.4.146.253:39177)
0811 17:11:22.135099 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:22.135109 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:22.135132 (+ 23us) server_negotiation.cc:407] Connection header received
0811 17:11:22.135175 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:22.135180 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:22.135395 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:22.135560 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:22.136051 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.137093 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.138293 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.138826 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.138928 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:22.141768 (+ 2840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:22.141784 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:22.141802 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:22.141827 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:22.144842 (+ 3015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.145473 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.145484 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.145488 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.145657 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.146017 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.146023 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.146027 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.146463 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:22.146600 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:22.147027 (+ 427us) server_negotiation.cc:299] Negotiation successful
0811 17:11:22.147241 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":11,"server-negotiator.queue_time_us":308,"thread_start_us":189,"threads_started":1}
I20260811 17:11:22.150204 28915 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } has no permanent_uuid. Determining permanent_uuid...
I20260811 17:11:22.151283 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.150847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:36721 (local address 127.0.0.1:36526)
0811 17:11:22.151033 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:22.151167 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:36721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260811 17:11:22.151602 28826 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.146.252:36721: connect: Connection refused (error 111)
I20260811 17:11:22.152833 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.152520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:36721 (local address 127.0.0.1:36530)
0811 17:11:22.152669 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:22.152740 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:36721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 17:11:22.153048 28915 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.252:36721: Network error: Client connection negotiation failed: client connection to 127.4.146.252:36721: connect: Connection refused (error 111)
I20260811 17:11:22.202412 28915 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } attempt: 1
I20260811 17:11:22.203459 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.203067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:36721 (local address 127.0.0.1:36540)
0811 17:11:22.203276 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:22.203356 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:36721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260811 17:11:22.204514 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.204218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:36721 (local address 127.0.0.1:36544)
0811 17:11:22.204347 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:22.204411 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:36721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 17:11:22.204715 28915 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.252:36721: Network error: Client connection negotiation failed: client connection to 127.4.146.252:36721: connect: Connection refused (error 111)
I20260811 17:11:22.236685 28785 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } attempt: 4
Aug 11 17:11:22 dist-test-slave-7vjv krb5kdc[28638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468281, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for kudu/127.4.146.253@KRBTEST.COM
I20260811 17:11:22.248449 28787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.237575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:39177 (local address 127.0.0.1:41618)
0811 17:11:22.237807 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:22.237827 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:22.237948 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:22.238563 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:22.238594 (+ 31us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:22.238837 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:22.238984 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:22.238991 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.240679 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.240684 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:22.241316 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:22.241328 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.241910 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.241915 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:22.242046 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:22.242686 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:22.242701 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:22.244439 (+ 1738us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:22.246672 (+ 2233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:22.246676 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:22.246679 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:22.246922 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:22.247273 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:22.247276 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:22.247278 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:22.247374 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:22.247812 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:22.247816 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:22.247931 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 17:11:22.248045 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 17:11:22.248263 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112}
I20260811 17:11:22.248449 28924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.237701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41618 (local address 127.4.146.253:39177)
0811 17:11:22.237900 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:22.237907 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:22.237936 (+ 29us) server_negotiation.cc:407] Connection header received
0811 17:11:22.238110 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:22.238115 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:22.238339 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:22.238516 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:22.239187 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.240524 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.241479 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.241763 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.241893 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:22.244669 (+ 2776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:22.244672 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:22.244674 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:22.244706 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:22.246496 (+ 1790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.247059 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.247063 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.247064 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.247169 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.247479 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.247483 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.247485 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.247706 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:22.247824 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:22.248160 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 17:11:22.248293 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 17:11:22.249583 28785 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } has no permanent_uuid. Determining permanent_uuid...
I20260811 17:11:22.250500 28787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.250209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:36721 (local address 127.0.0.1:36560)
0811 17:11:22.250357 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:22.250416 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:36721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260811 17:11:22.251466 28787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.251189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:36721 (local address 127.0.0.1:36562)
0811 17:11:22.251353 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:22.251405 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:36721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260811 17:11:22.251655 28785 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.252:36721: Network error: Client connection negotiation failed: client connection to 127.4.146.252:36721: connect: Connection refused (error 111)
I20260811 17:11:22.272888 28915 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } attempt: 2
I20260811 17:11:22.273831 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.273472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:36721 (local address 127.0.0.1:36566)
0811 17:11:22.273652 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:22.273729 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:36721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260811 17:11:22.274658 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.274411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:36721 (local address 127.0.0.1:36576)
0811 17:11:22.274519 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:22.274575 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:36721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 17:11:22.274874 28915 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.252:36721: Network error: Client connection negotiation failed: client connection to 127.4.146.252:36721: connect: Connection refused (error 111)
W20260811 17:11:22.277930 28925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:22.278262 28925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:22.278306 28925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:22.282815 28925 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:11:22.282907 28925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:22.282927 28925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:22.282945 28925 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:11:22.282961 28925 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:11:22.289029 28925 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:34841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:42203,127.4.146.253:39177,127.4.146.252:36721
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.252.keytab
--principal=kudu/127.4.146.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.252:36721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.4.146.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28925
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:22.290355 28925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:22.291563 28925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:22.301795 28939 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:22.301823 28925 server_base.cc:1034] running on GCE node
W20260811 17:11:22.301795 28935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:22.301842 28936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:22.302824 28925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:22.304534 28925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:22.305756 28925 hybrid_clock.cc:648] HybridClock initialized: now 1786468282305731 us; error 44 us; skew 500 ppm
Aug 11 17:11:22 dist-test-slave-7vjv krb5kdc[28638](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468282, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:22.309356 28925 init.cc:377] Logged in from keytab as kudu/127.4.146.252@KRBTEST.COM (short username kudu)
I20260811 17:11:22.310636 28925 webserver.cc:460] Webserver started at http://127.4.146.252:46297/ using document root <none> and password file <none>
I20260811 17:11:22.310847 28785 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } attempt: 1
I20260811 17:11:22.311480 28925 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:22.311587 28925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:11:22.311749 28787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.311371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:36721 (local address 127.0.0.1:36592)
0811 17:11:22.311560 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:22.311641 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:36721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260811 17:11:22.311901 28925 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:11:22.312685 28787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.312431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:36721 (local address 127.0.0.1:36608)
0811 17:11:22.312551 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:22.312600 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:36721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260811 17:11:22.312882 28785 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.252:36721: Network error: Client connection negotiation failed: client connection to 127.4.146.252:36721: connect: Connection refused (error 111)
I20260811 17:11:22.315495 28925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-2/data/instance:
uuid: "393eea57565941949347823718ef79da"
format_stamp: "Formatted at 2026-08-11 17:11:22 on dist-test-slave-7vjv"
server_key: "3d7352f649637bae8476e2c822f587b8"
server_key_iv: "4bd01ee9655da9f24c592234ffdf181c"
server_key_version: "encryptionkey@0"
I20260811 17:11:22.316293 28925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-2/wal/instance:
uuid: "393eea57565941949347823718ef79da"
format_stamp: "Formatted at 2026-08-11 17:11:22 on dist-test-slave-7vjv"
server_key: "3d7352f649637bae8476e2c822f587b8"
server_key_iv: "4bd01ee9655da9f24c592234ffdf181c"
server_key_version: "encryptionkey@0"
I20260811 17:11:22.320824 28925 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 17:11:22.323745 28953 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:22.325215 28925 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:11:22.325366 28925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-2/wal
uuid: "393eea57565941949347823718ef79da"
format_stamp: "Formatted at 2026-08-11 17:11:22 on dist-test-slave-7vjv"
server_key: "3d7352f649637bae8476e2c822f587b8"
server_key_iv: "4bd01ee9655da9f24c592234ffdf181c"
server_key_version: "encryptionkey@0"
I20260811 17:11:22.325500 28925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:22.361238 28925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:22.365468 28925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:22.365734 28925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:22.366102 28915 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } attempt: 3
I20260811 17:11:22.367062 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.366694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:36721 (local address 127.0.0.1:36620)
0811 17:11:22.366904 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:22.366977 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:36721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260811 17:11:22.368008 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.367697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:36721 (local address 127.0.0.1:36636)
0811 17:11:22.367887 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:22.367935 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:36721: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
W20260811 17:11:22.368242 28915 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.252:36721: Network error: Client connection negotiation failed: client connection to 127.4.146.252:36721: connect: Connection refused (error 111)
I20260811 17:11:22.375041 28925 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.252:36721
I20260811 17:11:22.375070 29060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.252:36721 every 8 connection(s)
I20260811 17:11:22.376214 28925 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-2/data/info.pb
I20260811 17:11:22.379355 29061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:11:22.380137 28785 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } attempt: 2
I20260811 17:11:22.384800 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 28925
I20260811 17:11:22.384964 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786468091870818-4683-0/minicluster-data/master-2/wal/instance
I20260811 17:11:22.385352 4683 external_mini_cluster.cc:1428] Setting key 175978dc63495184ae5cc8e208dfad92
I20260811 17:11:22.384974 29061 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42203 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 17:11:22 dist-test-slave-7vjv krb5kdc[28638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468281, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for kudu/127.4.146.252@KRBTEST.COM
Aug 11 17:11:22 dist-test-slave-7vjv krb5kdc[28638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468282, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.252@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
Aug 11 17:11:22 dist-test-slave-7vjv krb5kdc[28638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.252@KRBTEST.COM
I20260811 17:11:22.396939 28787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.380777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:36721 (local address 127.0.0.1:36640)
0811 17:11:22.380981 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:22.381003 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:22.381136 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:22.383861 (+ 2725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:22.383864 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:22.384156 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:22.384291 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:22.384300 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.385879 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.385885 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:22.386678 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:22.386692 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.388029 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.388036 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:22.388173 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:22.388750 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:22.388772 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:22.390700 (+ 1928us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:22.393883 (+ 3183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:22.393887 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:22.393889 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:22.394222 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:22.394725 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:22.394731 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:22.394736 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:22.394855 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:22.396025 (+ 1170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:22.396031 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:22.396227 (+ 196us) client_negotiation.cc:769] Sending connection context
0811 17:11:22.396385 (+ 158us) client_negotiation.cc:240] Negotiation successful
0811 17:11:22.396747 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82}
I20260811 17:11:22.398145 29068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.381736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36640 (local address 127.4.146.252:36721)
0811 17:11:22.382306 (+ 570us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:22.382322 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:22.382362 (+ 40us) server_negotiation.cc:407] Connection header received
0811 17:11:22.383104 (+ 742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:22.383125 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:22.383506 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:22.383925 (+ 419us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:22.384505 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.385734 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.386816 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.387608 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.387817 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:22.390963 (+ 3146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:22.390971 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:22.390988 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:22.391026 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:22.393733 (+ 2707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.394383 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.394391 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.394399 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.394580 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.394964 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.394967 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.394969 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.395728 (+ 759us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:22.395955 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:22.396599 (+ 644us) server_negotiation.cc:299] Negotiation successful
0811 17:11:22.397013 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":169,"threads_started":1}
I20260811 17:11:22.399842 28788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.387458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38342 (local address 127.4.146.254:42203)
0811 17:11:22.387594 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:22.387599 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:22.388047 (+ 448us) server_negotiation.cc:407] Connection header received
0811 17:11:22.388302 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:22.388305 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:22.388360 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:22.388417 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:22.389466 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.389955 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.391316 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.391642 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.391783 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:22.394844 (+ 3061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:22.394851 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:22.394858 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:22.394894 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:22.397412 (+ 2518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.398150 (+ 738us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.398157 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.398160 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.398259 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.398638 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.398641 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.398643 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.398920 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:22.399053 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:22.399518 (+ 465us) server_negotiation.cc:299] Negotiation successful
0811 17:11:22.399671 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 17:11:22.399859 29078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.387432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:42203 (local address 127.0.0.1:38342)
0811 17:11:22.387921 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:22.387980 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:22.388178 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:22.388619 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:22.388626 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:22.389154 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:22.389354 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:22.389364 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.390369 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.390372 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:22.391073 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:22.391084 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.391786 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.391790 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:22.391940 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:22.392687 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:22.392700 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:22.394622 (+ 1922us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:22.397574 (+ 2952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:22.397595 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:22.397604 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:22.397989 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:22.398390 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:22.398396 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:22.398398 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:22.398497 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:22.399052 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:22.399061 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:22.399238 (+ 177us) client_negotiation.cc:769] Sending connection context
0811 17:11:22.399440 (+ 202us) client_negotiation.cc:240] Negotiation successful
0811 17:11:22.399664 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":197,"threads_started":1}
I20260811 17:11:22.400898 29074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.386256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36648 (local address 127.4.146.252:36721)
0811 17:11:22.386606 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:22.386615 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:22.386844 (+ 229us) server_negotiation.cc:407] Connection header received
0811 17:11:22.386926 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:22.386929 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:22.386990 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:22.387081 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:22.388172 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.388955 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.390454 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.390872 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.390952 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:22.395309 (+ 4357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:22.395312 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:22.395315 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:22.395338 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:22.398657 (+ 3319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.399223 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.399227 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.399229 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.399316 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.399663 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.399667 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.399669 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.399919 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:22.400203 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:22.400612 (+ 409us) server_negotiation.cc:299] Negotiation successful
0811 17:11:22.400740 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":115,"threads_started":1}
I20260811 17:11:22.401319 29061 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } has no permanent_uuid. Determining permanent_uuid...
I20260811 17:11:22.404688 28785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9c0ae58cdbc428280ff2b3956787390: Bootstrap starting.
I20260811 17:11:22.408296 28785 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b9c0ae58cdbc428280ff2b3956787390: Neither blocks nor log segments found. Creating new log.
Aug 11 17:11:22 dist-test-slave-7vjv krb5kdc[28638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468282, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.252@KRBTEST.COM for kudu/127.4.146.253@KRBTEST.COM
Aug 11 17:11:22 dist-test-slave-7vjv krb5kdc[28638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:11:22.409521 28785 log.cc:824] T 00000000000000000000000000000000 P b9c0ae58cdbc428280ff2b3956787390: Log is configured to *not* fsync() on all Append() calls
I20260811 17:11:22.412539 28785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b9c0ae58cdbc428280ff2b3956787390: No bootstrap required, opened a new log
I20260811 17:11:22.414237 29078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.402121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:39177 (local address 127.0.0.1:41622)
0811 17:11:22.402333 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:22.402352 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:22.402443 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:22.403009 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:22.403012 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:22.403339 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:22.403470 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:22.403478 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.404688 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.404692 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:22.405769 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:22.405783 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.406649 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.406653 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:22.406827 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:22.407322 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:22.407340 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:22.409869 (+ 2529us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:22.412374 (+ 2505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:22.412378 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:22.412380 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:22.412680 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:22.413049 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:22.413053 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:22.413055 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:22.413142 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:22.413657 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:22.413660 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:22.413778 (+ 118us) client_negotiation.cc:769] Sending connection context
0811 17:11:22.413894 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 17:11:22.414049 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121}
I20260811 17:11:22.414535 28924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.402512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41622 (local address 127.4.146.253:39177)
0811 17:11:22.402652 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:22.402657 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:22.402673 (+ 16us) server_negotiation.cc:407] Connection header received
0811 17:11:22.402721 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:22.402724 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:22.402775 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:22.402865 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:22.403633 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.404447 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.405933 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.406360 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.406489 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:22.410281 (+ 3792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:22.410285 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:22.410288 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:22.410324 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:22.412219 (+ 1895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.412810 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.412816 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.412817 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.412919 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.413256 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.413260 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.413262 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.413520 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:22.413631 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:22.414108 (+ 477us) server_negotiation.cc:299] Negotiation successful
0811 17:11:22.414218 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 17:11:22.414767 28788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.402882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38344 (local address 127.4.146.254:42203)
0811 17:11:22.402995 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:22.402998 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:22.403007 (+ 9us) server_negotiation.cc:407] Connection header received
0811 17:11:22.403038 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:22.403039 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:22.403072 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:22.403232 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:22.404046 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.404879 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.406091 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.406332 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.406446 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:22.410174 (+ 3728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:22.410177 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:22.410180 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:22.410209 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:22.411924 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.412486 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.412490 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.412492 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.412582 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.412986 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.412990 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.412992 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.413249 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:22.413447 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:22.414469 (+ 1022us) server_negotiation.cc:299] Negotiation successful
0811 17:11:22.414621 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 17:11:22.415263 29061 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } has no permanent_uuid. Determining permanent_uuid...
I20260811 17:11:22.417318 28785 raft_consensus.cc:348] T 00000000000000000000000000000000 P b9c0ae58cdbc428280ff2b3956787390 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c0ae58cdbc428280ff2b3956787390" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42203 } } peers { permanent_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } } peers { permanent_uuid: "393eea57565941949347823718ef79da" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } }
I20260811 17:11:22.417629 28785 raft_consensus.cc:374] T 00000000000000000000000000000000 P b9c0ae58cdbc428280ff2b3956787390 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:11:22.417691 28785 raft_consensus.cc:729] T 00000000000000000000000000000000 P b9c0ae58cdbc428280ff2b3956787390 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b9c0ae58cdbc428280ff2b3956787390, State: Initialized, Role: FOLLOWER
I20260811 17:11:22.418220 28785 consensus_queue.cc:260] T 00000000000000000000000000000000 P b9c0ae58cdbc428280ff2b3956787390 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c0ae58cdbc428280ff2b3956787390" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42203 } } peers { permanent_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } } peers { permanent_uuid: "393eea57565941949347823718ef79da" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } }
I20260811 17:11:22.418826 29080 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9c0ae58cdbc428280ff2b3956787390 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c0ae58cdbc428280ff2b3956787390" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42203 } } peers { permanent_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } } peers { permanent_uuid: "393eea57565941949347823718ef79da" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } } }
I20260811 17:11:22.418995 29080 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9c0ae58cdbc428280ff2b3956787390 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:11:22.419875 28785 sys_catalog.cc:564] T 00000000000000000000000000000000 P b9c0ae58cdbc428280ff2b3956787390 [sys.catalog]: configured and running, proceeding with master startup.
Aug 11 17:11:22 dist-test-slave-7vjv krb5kdc[28638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468282, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.252@KRBTEST.COM for kudu/127.4.146.252@KRBTEST.COM
Aug 11 17:11:22 dist-test-slave-7vjv krb5kdc[28638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.253@KRBTEST.COM
W20260811 17:11:22.425698 29102 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b9c0ae58cdbc428280ff2b3956787390: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 17:11:22.425766 29102 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 17:11:22.426592 29078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.415815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:36721 (local address 127.0.0.1:36656)
0811 17:11:22.416617 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:22.416632 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:22.416728 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:22.416976 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:22.416978 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:22.417170 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:22.417275 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:22.417281 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.418416 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.418420 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:22.419324 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:22.419338 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.419909 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.419913 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:22.419981 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:22.420575 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:22.420591 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:22.422439 (+ 1848us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:22.424723 (+ 2284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:22.424729 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:22.424733 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:22.425028 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:22.425383 (+ 355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:22.425388 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:22.425393 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:22.425490 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:22.426012 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:22.426016 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:22.426117 (+ 101us) client_negotiation.cc:769] Sending connection context
0811 17:11:22.426224 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 17:11:22.426388 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":708}
I20260811 17:11:22.427160 29074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.416047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36656 (local address 127.4.146.252:36721)
0811 17:11:22.416233 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:22.416238 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:22.416705 (+ 467us) server_negotiation.cc:407] Connection header received
0811 17:11:22.416809 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:22.416812 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:22.416859 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:22.416940 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:22.417411 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.418249 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.419476 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.419780 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.419905 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:22.422619 (+ 2714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:22.422623 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:22.422626 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:22.422650 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:22.424581 (+ 1931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.425146 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.425150 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.425153 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.425272 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.425596 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.425601 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.425603 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.425866 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:22.425975 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:22.426831 (+ 856us) server_negotiation.cc:299] Negotiation successful
0811 17:11:22.426994 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260811 17:11:22.428511 28924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.416464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41628 (local address 127.4.146.253:39177)
0811 17:11:22.416608 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:22.416612 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:22.416624 (+ 12us) server_negotiation.cc:407] Connection header received
0811 17:11:22.416685 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:22.416691 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:22.416744 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:22.416820 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:22.417687 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.418423 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.419567 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.419913 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.420085 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:22.424196 (+ 4111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:22.424201 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:22.424204 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:22.424238 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:22.426100 (+ 1862us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.426674 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.426678 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.426680 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.426799 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.427185 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.427189 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.427194 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.427499 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:22.427764 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:22.428181 (+ 417us) server_negotiation.cc:299] Negotiation successful
0811 17:11:22.428349 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 17:11:22.431155 29061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 393eea57565941949347823718ef79da: Bootstrap starting.
I20260811 17:11:22.425640 28662 master_runner.cc:186] Error getting master registration for 127.4.146.253:39177: OK, instance_id { permanent_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" instance_seqno: 1786468282096392 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 17:11:22.431427 28662 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 17:11:22.432674 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:11:22.433957 29061 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 393eea57565941949347823718ef79da: Neither blocks nor log segments found. Creating new log.
I20260811 17:11:22.434866 29061 log.cc:824] T 00000000000000000000000000000000 P 393eea57565941949347823718ef79da: Log is configured to *not* fsync() on all Append() calls
I20260811 17:11:22.437563 29061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 393eea57565941949347823718ef79da: No bootstrap required, opened a new log
I20260811 17:11:22.441656 29061 raft_consensus.cc:348] T 00000000000000000000000000000000 P 393eea57565941949347823718ef79da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c0ae58cdbc428280ff2b3956787390" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42203 } } peers { permanent_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } } peers { permanent_uuid: "393eea57565941949347823718ef79da" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } }
I20260811 17:11:22.441954 29061 raft_consensus.cc:374] T 00000000000000000000000000000000 P 393eea57565941949347823718ef79da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:11:22.442035 29061 raft_consensus.cc:729] T 00000000000000000000000000000000 P 393eea57565941949347823718ef79da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 393eea57565941949347823718ef79da, State: Initialized, Role: FOLLOWER
I20260811 17:11:22.442639 29061 consensus_queue.cc:260] T 00000000000000000000000000000000 P 393eea57565941949347823718ef79da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c0ae58cdbc428280ff2b3956787390" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42203 } } peers { permanent_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } } peers { permanent_uuid: "393eea57565941949347823718ef79da" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } }
I20260811 17:11:22.443434 29116 sys_catalog.cc:455] T 00000000000000000000000000000000 P 393eea57565941949347823718ef79da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c0ae58cdbc428280ff2b3956787390" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42203 } } peers { permanent_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } } peers { permanent_uuid: "393eea57565941949347823718ef79da" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } } }
I20260811 17:11:22.443631 29116 sys_catalog.cc:458] T 00000000000000000000000000000000 P 393eea57565941949347823718ef79da [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:11:22.444347 29061 sys_catalog.cc:564] T 00000000000000000000000000000000 P 393eea57565941949347823718ef79da [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:11:22.446599 29074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.435763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36664 (local address 127.4.146.252:36721)
0811 17:11:22.435898 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:22.435903 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:22.436145 (+ 242us) server_negotiation.cc:407] Connection header received
0811 17:11:22.436378 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:22.436384 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:22.436438 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:22.436496 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:22.437598 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.438335 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.439578 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.439943 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.440074 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:22.442097 (+ 2023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:22.442102 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:22.442105 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:22.442139 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:22.444178 (+ 2039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.444824 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.444829 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.444831 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.444936 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.445310 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.445314 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.445317 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.445615 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:22.445735 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:22.446236 (+ 501us) server_negotiation.cc:299] Negotiation successful
0811 17:11:22.446395 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
W20260811 17:11:22.452943 29142 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 393eea57565941949347823718ef79da: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 17:11:22.453038 29142 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 17:11:22.452070 28925 master_runner.cc:186] Error getting master registration for 127.4.146.253:39177: OK, instance_id { permanent_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" instance_seqno: 1786468282096392 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 17:11:22.456594 28925 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 17:11:22.457252 28788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.436320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38358 (local address 127.4.146.254:42203)
0811 17:11:22.436438 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:22.436443 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:22.446669 (+ 10226us) server_negotiation.cc:407] Connection header received
0811 17:11:22.446889 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:22.446893 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:22.446957 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:22.447021 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:22.448072 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.448966 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.450269 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.450689 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.450773 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:22.452892 (+ 2119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:22.452897 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:22.452900 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:22.452933 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:22.455097 (+ 2164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.455668 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.455673 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.455675 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.455771 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.456129 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.456133 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.456135 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.456382 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:22.456506 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:22.456925 (+ 419us) server_negotiation.cc:299] Negotiation successful
0811 17:11:22.457081 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 17:11:22.463133 28924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.444912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41636 (local address 127.4.146.253:39177)
0811 17:11:22.445053 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:22.445059 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:22.453721 (+ 8662us) server_negotiation.cc:407] Connection header received
0811 17:11:22.454018 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:22.454022 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:22.454083 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:22.454179 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:22.454986 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.455777 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.456982 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.457308 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.457398 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:22.459247 (+ 1849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:22.459252 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:22.459255 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:22.459287 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:22.461148 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.461691 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.461694 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.461697 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.461795 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.462113 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.462117 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.462119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.462368 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:22.462530 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:22.462812 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 17:11:22.462950 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 17:11:22.511432 28915 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } attempt: 4
Aug 11 17:11:22 dist-test-slave-7vjv krb5kdc[28638](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468282, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.253@KRBTEST.COM for kudu/127.4.146.252@KRBTEST.COM
I20260811 17:11:22.524665 28921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.512007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:36721 (local address 127.0.0.1:36676)
0811 17:11:22.512233 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:22.512250 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:22.512345 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:22.512689 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:22.512692 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:22.512944 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:22.513072 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:22.513081 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.514208 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.514212 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:22.515086 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:22.515101 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.515853 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.515857 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:22.515959 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:22.516846 (+ 887us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:22.516863 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:22.519911 (+ 3048us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:22.522573 (+ 2662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:22.522577 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:22.522580 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:22.522977 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:22.523374 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:22.523378 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:22.523380 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:22.523502 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:22.524008 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:22.524011 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:22.524184 (+ 173us) client_negotiation.cc:769] Sending connection context
0811 17:11:22.524296 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 17:11:22.524462 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118}
I20260811 17:11:22.524698 29074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:22.512281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36676 (local address 127.4.146.252:36721)
0811 17:11:22.512413 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:22.512417 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:22.512433 (+ 16us) server_negotiation.cc:407] Connection header received
0811 17:11:22.512484 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:22.512487 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:22.512534 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:22.512635 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:22.513238 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.514057 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.515280 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:22.515690 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:22.515829 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:22.520070 (+ 4241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:22.520075 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:22.520078 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:22.520134 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:22.522395 (+ 2261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.523152 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.523157 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.523158 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.523259 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:22.523626 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:22.523630 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:22.523632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:22.523898 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:22.524004 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:22.524377 (+ 373us) server_negotiation.cc:299] Negotiation successful
0811 17:11:22.524523 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 17:11:22.529042 28915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648: Bootstrap starting.
I20260811 17:11:22.533480 28915 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648: Neither blocks nor log segments found. Creating new log.
I20260811 17:11:22.534608 28915 log.cc:824] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648: Log is configured to *not* fsync() on all Append() calls
I20260811 17:11:22.537510 28915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648: No bootstrap required, opened a new log
I20260811 17:11:22.542107 28915 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c0ae58cdbc428280ff2b3956787390" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42203 } } peers { permanent_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } } peers { permanent_uuid: "393eea57565941949347823718ef79da" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } }
I20260811 17:11:22.542479 28915 raft_consensus.cc:374] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:11:22.542570 28915 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38c18dc7b0b74d5b8ff6fb0345917648, State: Initialized, Role: FOLLOWER
I20260811 17:11:22.543217 28915 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c0ae58cdbc428280ff2b3956787390" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42203 } } peers { permanent_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } } peers { permanent_uuid: "393eea57565941949347823718ef79da" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } }
I20260811 17:11:22.545183 29150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c0ae58cdbc428280ff2b3956787390" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42203 } } peers { permanent_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } } peers { permanent_uuid: "393eea57565941949347823718ef79da" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } } }
I20260811 17:11:22.545552 29150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:11:22.546139 28915 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [sys.catalog]: configured and running, proceeding with master startup.
W20260811 17:11:22.551796 29170 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 17:11:22.551996 29170 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 17:11:22.555060 28795 master_runner.cc:263] No leader master found from master 38c18dc7b0b74d5b8ff6fb0345917648
I20260811 17:11:22.555160 28795 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 17:11:22.575062 29150 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:11:22.575317 29150 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c0ae58cdbc428280ff2b3956787390" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42203 } } peers { permanent_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } } peers { permanent_uuid: "393eea57565941949347823718ef79da" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } }
I20260811 17:11:22.576630 29150 leader_election.cc:288] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b9c0ae58cdbc428280ff2b3956787390 (127.4.146.254:42203), 393eea57565941949347823718ef79da (127.4.146.252:36721)
I20260811 17:11:22.577900 29013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "393eea57565941949347823718ef79da" is_pre_election: true
I20260811 17:11:22.578456 29013 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 393eea57565941949347823718ef79da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38c18dc7b0b74d5b8ff6fb0345917648 in term 0.
I20260811 17:11:22.581610 28826 leader_election.cc:302] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38c18dc7b0b74d5b8ff6fb0345917648, 393eea57565941949347823718ef79da; no voters:
I20260811 17:11:22.582886 28739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c0ae58cdbc428280ff2b3956787390" is_pre_election: true
I20260811 17:11:22.583289 28739 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b9c0ae58cdbc428280ff2b3956787390 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38c18dc7b0b74d5b8ff6fb0345917648 in term 0.
I20260811 17:11:22.584571 29150 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:11:22.584709 29150 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:11:22.584764 29150 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:11:22.586366 29150 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c0ae58cdbc428280ff2b3956787390" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42203 } } peers { permanent_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } } peers { permanent_uuid: "393eea57565941949347823718ef79da" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } }
I20260811 17:11:22.586850 29150 leader_election.cc:288] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [CANDIDATE]: Term 1 election: Requested vote from peers b9c0ae58cdbc428280ff2b3956787390 (127.4.146.254:42203), 393eea57565941949347823718ef79da (127.4.146.252:36721)
I20260811 17:11:22.587992 28739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b9c0ae58cdbc428280ff2b3956787390"
I20260811 17:11:22.588181 28739 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b9c0ae58cdbc428280ff2b3956787390 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:11:22.589777 28739 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b9c0ae58cdbc428280ff2b3956787390 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38c18dc7b0b74d5b8ff6fb0345917648 in term 1.
I20260811 17:11:22.590889 28830 leader_election.cc:302] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38c18dc7b0b74d5b8ff6fb0345917648, b9c0ae58cdbc428280ff2b3956787390; no voters:
I20260811 17:11:22.591320 29013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "393eea57565941949347823718ef79da"
I20260811 17:11:22.591511 29013 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 393eea57565941949347823718ef79da [term 0 FOLLOWER]: Advancing to term 1
W20260811 17:11:22.591723 28701 tablet.cc:2369] T 00000000000000000000000000000000 P b9c0ae58cdbc428280ff2b3956787390: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 17:11:22.592455 28833 tablet.cc:2369] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 17:11:22.593174 29013 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 393eea57565941949347823718ef79da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38c18dc7b0b74d5b8ff6fb0345917648 in term 1.
I20260811 17:11:22.594327 29150 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:11:22.594667 29150 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [term 1 LEADER]: Becoming Leader. State: Replica: 38c18dc7b0b74d5b8ff6fb0345917648, State: Running, Role: LEADER
I20260811 17:11:22.595147 29150 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c0ae58cdbc428280ff2b3956787390" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42203 } } peers { permanent_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } } peers { permanent_uuid: "393eea57565941949347823718ef79da" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } }
I20260811 17:11:22.597625 29150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38c18dc7b0b74d5b8ff6fb0345917648. Latest consensus state: current_term: 1 leader_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c0ae58cdbc428280ff2b3956787390" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42203 } } peers { permanent_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } } peers { permanent_uuid: "393eea57565941949347823718ef79da" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } } }
I20260811 17:11:22.597869 29150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [sys.catalog]: This master's current role is: LEADER
I20260811 17:11:22.598388 29175 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:11:22.599565 29175 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:11:22.612231 29013 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 393eea57565941949347823718ef79da [term 1 FOLLOWER]: Refusing update from remote peer 38c18dc7b0b74d5b8ff6fb0345917648: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:11:22.613341 29172 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "393eea57565941949347823718ef79da" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 17:11:22.617883 28963 tablet.cc:2369] T 00000000000000000000000000000000 P 393eea57565941949347823718ef79da: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 17:11:22.622265 29116 sys_catalog.cc:455] T 00000000000000000000000000000000 P 393eea57565941949347823718ef79da [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38c18dc7b0b74d5b8ff6fb0345917648. Latest consensus state: current_term: 1 leader_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c0ae58cdbc428280ff2b3956787390" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42203 } } peers { permanent_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } } peers { permanent_uuid: "393eea57565941949347823718ef79da" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } } }
I20260811 17:11:22.622459 29116 sys_catalog.cc:458] T 00000000000000000000000000000000 P 393eea57565941949347823718ef79da [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:11:22.625377 28739 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b9c0ae58cdbc428280ff2b3956787390 [term 1 FOLLOWER]: Refusing update from remote peer 38c18dc7b0b74d5b8ff6fb0345917648: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:11:22.626312 29172 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b9c0ae58cdbc428280ff2b3956787390" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:11:22.631538 29080 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9c0ae58cdbc428280ff2b3956787390 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38c18dc7b0b74d5b8ff6fb0345917648. Latest consensus state: current_term: 1 leader_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c0ae58cdbc428280ff2b3956787390" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42203 } } peers { permanent_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } } peers { permanent_uuid: "393eea57565941949347823718ef79da" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } } }
I20260811 17:11:22.631727 29080 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9c0ae58cdbc428280ff2b3956787390 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:11:22.637979 29172 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c0ae58cdbc428280ff2b3956787390" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42203 } } peers { permanent_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } } peers { permanent_uuid: "393eea57565941949347823718ef79da" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } } }
I20260811 17:11:22.638173 29172 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [sys.catalog]: This master's current role is: LEADER
I20260811 17:11:22.640617 29080 sys_catalog.cc:455] T 00000000000000000000000000000000 P b9c0ae58cdbc428280ff2b3956787390 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c0ae58cdbc428280ff2b3956787390" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42203 } } peers { permanent_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } } peers { permanent_uuid: "393eea57565941949347823718ef79da" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } } }
I20260811 17:11:22.640820 29080 sys_catalog.cc:458] T 00000000000000000000000000000000 P b9c0ae58cdbc428280ff2b3956787390 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:11:22.642758 29176 mvcc.cc:205] Tried to move back new op lower bound from 7317374085568626688 to 7317374085515161600. Current Snapshot: MvccSnapshot[applied={T|T < 7317374085568626688}]
I20260811 17:11:22.646835 29172 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c0ae58cdbc428280ff2b3956787390" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42203 } } peers { permanent_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } } peers { permanent_uuid: "393eea57565941949347823718ef79da" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } } }
I20260811 17:11:22.646823 29116 sys_catalog.cc:455] T 00000000000000000000000000000000 P 393eea57565941949347823718ef79da [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b9c0ae58cdbc428280ff2b3956787390" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42203 } } peers { permanent_uuid: "38c18dc7b0b74d5b8ff6fb0345917648" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 39177 } } peers { permanent_uuid: "393eea57565941949347823718ef79da" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 36721 } } }
I20260811 17:11:22.646989 29116 sys_catalog.cc:458] T 00000000000000000000000000000000 P 393eea57565941949347823718ef79da [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:11:22.646986 29172 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648 [sys.catalog]: This master's current role is: LEADER
I20260811 17:11:22.645140 29182 mvcc.cc:205] Tried to move back new op lower bound from 7317374085568626688 to 7317374085515161600. Current Snapshot: MvccSnapshot[applied={T|T < 7317374085568626688}]
I20260811 17:11:22.650291 29175 catalog_manager.cc:1347] Generated new cluster ID: 570c54d3377b4eac8ebfee6e90de01a0
I20260811 17:11:22.650390 29175 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:11:22.653705 29178 mvcc.cc:205] Tried to move back new op lower bound from 7317374085568626688 to 7317374085515161600. Current Snapshot: MvccSnapshot[applied={T|T < 7317374085568626688}]
I20260811 17:11:22.669392 29175 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:11:22.670977 29175 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:11:22.687882 29175 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 38c18dc7b0b74d5b8ff6fb0345917648: Generated new TSK 0
I20260811 17:11:22.688859 29175 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:11:23.427268 29102 catalog_manager.cc:1259] Loaded cluster ID: 570c54d3377b4eac8ebfee6e90de01a0
I20260811 17:11:23.427369 29102 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b9c0ae58cdbc428280ff2b3956787390: loading cluster ID for follower catalog manager: success
I20260811 17:11:23.429592 29102 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b9c0ae58cdbc428280ff2b3956787390: acquiring CA information for follower catalog manager: success
I20260811 17:11:23.431012 29102 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b9c0ae58cdbc428280ff2b3956787390: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 17:11:23.454416 29142 catalog_manager.cc:1259] Loaded cluster ID: 570c54d3377b4eac8ebfee6e90de01a0
I20260811 17:11:23.454542 29142 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 393eea57565941949347823718ef79da: loading cluster ID for follower catalog manager: success
I20260811 17:11:23.456313 29142 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 393eea57565941949347823718ef79da: acquiring CA information for follower catalog manager: success
I20260811 17:11:23.457580 29142 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 393eea57565941949347823718ef79da: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 17:11:23.767899 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 28662
I20260811 17:11:23.787345 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 28795
I20260811 17:11:23.807230 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 28925
2026-08-11T17:11:23Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3700 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:11:23 dist-test-slave-7vjv krb5kdc[29196](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:11:23 dist-test-slave-7vjv krb5kdc[29196](info): set up 2 sockets
Aug 11 17:11:23 dist-test-slave-7vjv krb5kdc[29196](info): commencing operation
krb5kdc: starting...
W20260811 17:11:25.201766 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.362s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:11:25 dist-test-slave-7vjv krb5kdc[29196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:11:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:11:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:11:25.360852 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:40063
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:36135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:40063
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:11:25.486713 29219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:25.487074 29219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:25.487131 29219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:25.491487 29219 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:11:25.491576 29219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:25.491597 29219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:25.491614 29219 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:11:25.491629 29219 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:11:25.497776 29219 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:36135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:40063
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:40063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29219
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:25.499104 29219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:25.500283 29219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:25.509586 29231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:25.509565 29239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:25.509562 29235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:25.509999 29219 server_base.cc:1034] running on GCE node
I20260811 17:11:25.511014 29219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:25.512452 29219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:25.513691 29219 hybrid_clock.cc:648] HybridClock initialized: now 1786468285513652 us; error 54 us; skew 500 ppm
Aug 11 17:11:25 dist-test-slave-7vjv krb5kdc[29196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468285, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:25.521914 29219 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:11:25.523288 29219 webserver.cc:460] Webserver started at http://127.4.146.254:41173/ using document root <none> and password file <none>
I20260811 17:11:25.524015 29219 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:25.524171 29219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:11:25.524469 29219 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:11:25.526978 29219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "27f9548cdcc14f5cab7564a4262a8901"
format_stamp: "Formatted at 2026-08-11 17:11:25 on dist-test-slave-7vjv"
server_key: "e353f9862a15a39dc21bdab2c4b657a0"
server_key_iv: "cd78c3ebf5e5f63d844d775bc59f42cf"
server_key_version: "encryptionkey@0"
I20260811 17:11:25.527999 29219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "27f9548cdcc14f5cab7564a4262a8901"
format_stamp: "Formatted at 2026-08-11 17:11:25 on dist-test-slave-7vjv"
server_key: "e353f9862a15a39dc21bdab2c4b657a0"
server_key_iv: "cd78c3ebf5e5f63d844d775bc59f42cf"
server_key_version: "encryptionkey@0"
I20260811 17:11:25.532732 29219 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 17:11:25.535656 29258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:25.537350 29219 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:11:25.537555 29219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "27f9548cdcc14f5cab7564a4262a8901"
format_stamp: "Formatted at 2026-08-11 17:11:25 on dist-test-slave-7vjv"
server_key: "e353f9862a15a39dc21bdab2c4b657a0"
server_key_iv: "cd78c3ebf5e5f63d844d775bc59f42cf"
server_key_version: "encryptionkey@0"
I20260811 17:11:25.537720 29219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:25.555059 29219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:25.558943 29219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:25.559191 29219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:25.567490 29219 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:40063
I20260811 17:11:25.567528 29357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:40063 every 8 connection(s)
I20260811 17:11:25.568655 29219 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:11:25.570065 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 29219
I20260811 17:11:25.570266 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:11:25.570601 4683 external_mini_cluster.cc:1428] Setting key c979d3ac003f89b7e831f098ee9c7d8a
I20260811 17:11:25.572525 29358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:11:25.580621 29358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27f9548cdcc14f5cab7564a4262a8901: Bootstrap starting.
Aug 11 17:11:25 dist-test-slave-7vjv krb5kdc[29196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:11:25.583878 29358 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 27f9548cdcc14f5cab7564a4262a8901: Neither blocks nor log segments found. Creating new log.
I20260811 17:11:25.584939 29358 log.cc:824] T 00000000000000000000000000000000 P 27f9548cdcc14f5cab7564a4262a8901: Log is configured to *not* fsync() on all Append() calls
I20260811 17:11:25.587656 29358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27f9548cdcc14f5cab7564a4262a8901: No bootstrap required, opened a new log
I20260811 17:11:25.588496 29362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:25.572208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57500 (local address 127.4.146.254:40063)
0811 17:11:25.572715 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:25.572736 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:25.572784 (+ 48us) server_negotiation.cc:407] Connection header received
0811 17:11:25.573693 (+ 909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:25.573721 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:25.574201 (+ 480us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:25.574630 (+ 429us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:25.575616 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:25.577251 (+ 1635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:25.578271 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:25.579037 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:25.579238 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:25.582367 (+ 3129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:25.582375 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:25.582395 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:25.582436 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:25.584728 (+ 2292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:25.585311 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:25.585320 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:25.585330 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:25.585498 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:25.585882 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:25.585884 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:25.585885 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:25.586543 (+ 658us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:25.586736 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:25.587090 (+ 354us) server_negotiation.cc:299] Negotiation successful
0811 17:11:25.587431 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":147,"threads_started":1}
I20260811 17:11:25.591830 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:11:25.592446 29358 raft_consensus.cc:348] T 00000000000000000000000000000000 P 27f9548cdcc14f5cab7564a4262a8901 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27f9548cdcc14f5cab7564a4262a8901" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40063 } }
I20260811 17:11:25.592718 29358 raft_consensus.cc:374] T 00000000000000000000000000000000 P 27f9548cdcc14f5cab7564a4262a8901 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:11:25.592808 29358 raft_consensus.cc:729] T 00000000000000000000000000000000 P 27f9548cdcc14f5cab7564a4262a8901 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27f9548cdcc14f5cab7564a4262a8901, State: Initialized, Role: FOLLOWER
I20260811 17:11:25.593338 29358 consensus_queue.cc:260] T 00000000000000000000000000000000 P 27f9548cdcc14f5cab7564a4262a8901 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27f9548cdcc14f5cab7564a4262a8901" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40063 } }
I20260811 17:11:25.593487 29358 raft_consensus.cc:388] T 00000000000000000000000000000000 P 27f9548cdcc14f5cab7564a4262a8901 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:11:25.593652 29358 raft_consensus.cc:482] T 00000000000000000000000000000000 P 27f9548cdcc14f5cab7564a4262a8901 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:11:25.593781 29358 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 27f9548cdcc14f5cab7564a4262a8901 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:11:25.594854 29358 raft_consensus.cc:504] T 00000000000000000000000000000000 P 27f9548cdcc14f5cab7564a4262a8901 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27f9548cdcc14f5cab7564a4262a8901" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40063 } }
I20260811 17:11:25.595242 29358 leader_election.cc:302] T 00000000000000000000000000000000 P 27f9548cdcc14f5cab7564a4262a8901 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 27f9548cdcc14f5cab7564a4262a8901; no voters:
I20260811 17:11:25.595607 29358 leader_election.cc:288] T 00000000000000000000000000000000 P 27f9548cdcc14f5cab7564a4262a8901 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:11:25.595801 29365 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 27f9548cdcc14f5cab7564a4262a8901 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:11:25.596149 29365 raft_consensus.cc:686] T 00000000000000000000000000000000 P 27f9548cdcc14f5cab7564a4262a8901 [term 1 LEADER]: Becoming Leader. State: Replica: 27f9548cdcc14f5cab7564a4262a8901, State: Running, Role: LEADER
I20260811 17:11:25.596510 29365 consensus_queue.cc:237] T 00000000000000000000000000000000 P 27f9548cdcc14f5cab7564a4262a8901 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27f9548cdcc14f5cab7564a4262a8901" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40063 } }
I20260811 17:11:25.597033 29358 sys_catalog.cc:564] T 00000000000000000000000000000000 P 27f9548cdcc14f5cab7564a4262a8901 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:11:25.598343 29366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27f9548cdcc14f5cab7564a4262a8901 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "27f9548cdcc14f5cab7564a4262a8901" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27f9548cdcc14f5cab7564a4262a8901" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40063 } } }
I20260811 17:11:25.598348 29368 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27f9548cdcc14f5cab7564a4262a8901 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 27f9548cdcc14f5cab7564a4262a8901. Latest consensus state: current_term: 1 leader_uuid: "27f9548cdcc14f5cab7564a4262a8901" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27f9548cdcc14f5cab7564a4262a8901" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40063 } } }
I20260811 17:11:25.598541 29366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27f9548cdcc14f5cab7564a4262a8901 [sys.catalog]: This master's current role is: LEADER
I20260811 17:11:25.598567 29368 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27f9548cdcc14f5cab7564a4262a8901 [sys.catalog]: This master's current role is: LEADER
I20260811 17:11:25.599043 29384 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:11:25.602035 29384 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:11:25.608269 29384 catalog_manager.cc:1347] Generated new cluster ID: 666c9d818aef4b37a2c56e6b03b9b6ca
I20260811 17:11:25.608382 29384 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:11:25.645147 29384 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:11:25.646240 29384 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:11:25.651562 29384 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 27f9548cdcc14f5cab7564a4262a8901: Generated new TSK 0
I20260811 17:11:25.652536 29384 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:11:25.700398 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 29219
2026-08-11T17:11:25Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1893 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:11:25 dist-test-slave-7vjv krb5kdc[29403](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:11:25 dist-test-slave-7vjv krb5kdc[29403](info): set up 2 sockets
Aug 11 17:11:25 dist-test-slave-7vjv krb5kdc[29403](info): commencing operation
krb5kdc: starting...
W20260811 17:11:27.080763 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.347s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:11:27 dist-test-slave-7vjv krb5kdc[29403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:11:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:11:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:11:27.241750 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:34867
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:34867
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:11:27.372229 29426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:27.372552 29426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:27.372597 29426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:27.376863 29426 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:11:27.376962 29426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:27.376984 29426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:27.377002 29426 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:11:27.377017 29426 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:11:27.382939 29426 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:34867
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:34867
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29426
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:27.384284 29426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:27.385464 29426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:27.396356 29436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:27.396591 29435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:27.396512 29444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:27.396420 29426 server_base.cc:1034] running on GCE node
I20260811 17:11:27.397349 29426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:27.398701 29426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:27.399947 29426 hybrid_clock.cc:648] HybridClock initialized: now 1786468287399921 us; error 42 us; skew 500 ppm
Aug 11 17:11:27 dist-test-slave-7vjv krb5kdc[29403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468287, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:27.403266 29426 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:11:27.404517 29426 webserver.cc:460] Webserver started at http://127.4.146.254:43375/ using document root <none> and password file <none>
I20260811 17:11:27.405155 29426 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:27.405261 29426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:11:27.405522 29426 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:11:27.407814 29426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "b06fd163bb9e4d359523e1e6945f5321"
format_stamp: "Formatted at 2026-08-11 17:11:27 on dist-test-slave-7vjv"
server_key: "5a81fd86dba2308b856e37e1e89189a5"
server_key_iv: "8885787c5bcc7d9617616553b672d606"
server_key_version: "encryptionkey@0"
I20260811 17:11:27.408535 29426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "b06fd163bb9e4d359523e1e6945f5321"
format_stamp: "Formatted at 2026-08-11 17:11:27 on dist-test-slave-7vjv"
server_key: "5a81fd86dba2308b856e37e1e89189a5"
server_key_iv: "8885787c5bcc7d9617616553b672d606"
server_key_version: "encryptionkey@0"
I20260811 17:11:27.412760 29426 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 17:11:27.415591 29453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:27.417599 29426 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:11:27.417848 29426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "b06fd163bb9e4d359523e1e6945f5321"
format_stamp: "Formatted at 2026-08-11 17:11:27 on dist-test-slave-7vjv"
server_key: "5a81fd86dba2308b856e37e1e89189a5"
server_key_iv: "8885787c5bcc7d9617616553b672d606"
server_key_version: "encryptionkey@0"
I20260811 17:11:27.418022 29426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:27.446770 29426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:27.450390 29426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:27.450644 29426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:27.459147 29426 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:34867
I20260811 17:11:27.459506 29555 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:34867 every 8 connection(s)
I20260811 17:11:27.460371 29426 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:11:27.461361 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 29426
I20260811 17:11:27.461521 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:11:27.461835 4683 external_mini_cluster.cc:1428] Setting key 70abd7acf1881aa1af441dcbc2bba38f
I20260811 17:11:27.464157 29556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:11:27.472229 29556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321: Bootstrap starting.
Aug 11 17:11:27 dist-test-slave-7vjv krb5kdc[29403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468287, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:11:27.475390 29556 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321: Neither blocks nor log segments found. Creating new log.
I20260811 17:11:27.476522 29556 log.cc:824] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321: Log is configured to *not* fsync() on all Append() calls
I20260811 17:11:27.479314 29556 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321: No bootstrap required, opened a new log
I20260811 17:11:27.479486 29560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:27.463352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42932 (local address 127.4.146.254:34867)
0811 17:11:27.463839 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:27.463862 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:27.463911 (+ 49us) server_negotiation.cc:407] Connection header received
0811 17:11:27.464912 (+ 1001us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:27.464939 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:27.465428 (+ 489us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:27.465842 (+ 414us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:27.466685 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:27.468483 (+ 1798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:27.469490 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:27.470292 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:27.470479 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:27.473392 (+ 2913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:27.473402 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:27.473426 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:27.473473 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:27.475876 (+ 2403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:27.476464 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:27.476471 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:27.476478 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:27.476649 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:27.477018 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:27.477024 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:27.477029 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:27.477513 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:27.477765 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:27.478067 (+ 302us) server_negotiation.cc:299] Negotiation successful
0811 17:11:27.478419 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":123,"threads_started":1}
I20260811 17:11:27.483896 29556 raft_consensus.cc:348] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fd163bb9e4d359523e1e6945f5321" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34867 } }
I20260811 17:11:27.484261 29556 raft_consensus.cc:374] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:11:27.484335 29556 raft_consensus.cc:729] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06fd163bb9e4d359523e1e6945f5321, State: Initialized, Role: FOLLOWER
I20260811 17:11:27.484863 29556 consensus_queue.cc:260] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fd163bb9e4d359523e1e6945f5321" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34867 } }
I20260811 17:11:27.485044 29556 raft_consensus.cc:388] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:11:27.485121 29556 raft_consensus.cc:482] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:11:27.485241 29556 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:11:27.486392 29556 raft_consensus.cc:504] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fd163bb9e4d359523e1e6945f5321" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34867 } }
I20260811 17:11:27.486814 29556 leader_election.cc:302] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b06fd163bb9e4d359523e1e6945f5321; no voters:
I20260811 17:11:27.487241 29556 leader_election.cc:288] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:11:27.487458 29562 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:11:27.487762 29562 raft_consensus.cc:686] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [term 1 LEADER]: Becoming Leader. State: Replica: b06fd163bb9e4d359523e1e6945f5321, State: Running, Role: LEADER
I20260811 17:11:27.488197 29562 consensus_queue.cc:237] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fd163bb9e4d359523e1e6945f5321" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34867 } }
I20260811 17:11:27.488948 29556 sys_catalog.cc:564] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:11:27.490316 29566 sys_catalog.cc:455] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b06fd163bb9e4d359523e1e6945f5321. Latest consensus state: current_term: 1 leader_uuid: "b06fd163bb9e4d359523e1e6945f5321" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fd163bb9e4d359523e1e6945f5321" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34867 } } }
I20260811 17:11:27.490501 29566 sys_catalog.cc:458] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [sys.catalog]: This master's current role is: LEADER
I20260811 17:11:27.490325 29563 sys_catalog.cc:455] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b06fd163bb9e4d359523e1e6945f5321" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fd163bb9e4d359523e1e6945f5321" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34867 } } }
I20260811 17:11:27.490849 29563 sys_catalog.cc:458] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [sys.catalog]: This master's current role is: LEADER
I20260811 17:11:27.490936 29575 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:11:27.494587 29575 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:11:27.501368 29575 catalog_manager.cc:1347] Generated new cluster ID: b86e4a94001c477c9db32fee45b062a7
I20260811 17:11:27.501471 29575 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:11:27.520951 29575 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:11:27.522325 29575 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:11:27.532454 29575 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321: Generated new TSK 0
I20260811 17:11:27.533504 29575 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
I20260811 17:11:27.580736 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:34867
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:11:27.709251 29608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:27.709653 29608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:27.709748 29608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:27.715067 29608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:27.715216 29608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:27.715332 29608 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:11:27.721503 29608 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:34867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:27.722802 29608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:27.723964 29608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:27.735051 29616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:27.735051 29618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:27.735211 29614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:27.735193 29608 server_base.cc:1034] running on GCE node
I20260811 17:11:27.735948 29608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:27.736770 29608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:27.737979 29608 hybrid_clock.cc:648] HybridClock initialized: now 1786468287737956 us; error 37 us; skew 500 ppm
Aug 11 17:11:27 dist-test-slave-7vjv krb5kdc[29403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468287, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:27.741551 29608 init.cc:377] Logged in from keytab as kudu/127.4.146.193@KRBTEST.COM (short username kudu)
I20260811 17:11:27.742673 29608 webserver.cc:460] Webserver started at http://127.4.146.193:41013/ using document root <none> and password file <none>
I20260811 17:11:27.743335 29608 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:27.743443 29608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:11:27.743705 29608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:11:27.746060 29608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "31677abfedd14f438297f889a7191560"
format_stamp: "Formatted at 2026-08-11 17:11:27 on dist-test-slave-7vjv"
server_key: "7fed74da281e59d33ae53a06f99e4831"
server_key_iv: "b48902092c228a48daefc5a2a94487ef"
server_key_version: "encryptionkey@0"
I20260811 17:11:27.746726 29608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "31677abfedd14f438297f889a7191560"
format_stamp: "Formatted at 2026-08-11 17:11:27 on dist-test-slave-7vjv"
server_key: "7fed74da281e59d33ae53a06f99e4831"
server_key_iv: "b48902092c228a48daefc5a2a94487ef"
server_key_version: "encryptionkey@0"
I20260811 17:11:27.751451 29608 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260811 17:11:27.754635 29630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:27.756176 29608 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 17:11:27.756371 29608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "31677abfedd14f438297f889a7191560"
format_stamp: "Formatted at 2026-08-11 17:11:27 on dist-test-slave-7vjv"
server_key: "7fed74da281e59d33ae53a06f99e4831"
server_key_iv: "b48902092c228a48daefc5a2a94487ef"
server_key_version: "encryptionkey@0"
I20260811 17:11:27.756515 29608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:27.767768 29608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:27.771142 29608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:27.771389 29608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:27.772064 29608 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:11:27.773082 29608 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:11:27.773160 29608 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:27.773243 29608 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:11:27.773289 29608 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:27.784451 29608 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:39385
I20260811 17:11:27.784500 29836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:39385 every 8 connection(s)
I20260811 17:11:27.785529 29608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:11:27.790582 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 29608
I20260811 17:11:27.790788 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
I20260811 17:11:27.791172 4683 external_mini_cluster.cc:1428] Setting key 55c75ef0023473f910cf102cd3b4621b
Aug 11 17:11:27 dist-test-slave-7vjv krb5kdc[29403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468287, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.146.194@KRBTEST.COM; defaulting to no policy
I20260811 17:11:27.802711 29560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:27.787710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:42813 (local address 127.4.146.254:34867)
0811 17:11:27.787855 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:27.787859 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:27.789004 (+ 1145us) server_negotiation.cc:407] Connection header received
0811 17:11:27.790625 (+ 1621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:27.790629 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:27.790694 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:27.790824 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:27.792795 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:27.793397 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:27.794783 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:27.795053 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:27.795191 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:27.798454 (+ 3263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:27.798458 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:27.798460 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:27.798491 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:27.800206 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:27.800885 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:27.800894 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:27.800895 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:27.800986 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:27.801426 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:27.801429 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:27.801431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:27.801661 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:27.801782 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:27.802381 (+ 599us) server_negotiation.cc:299] Negotiation successful
0811 17:11:27.802534 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 17:11:27.803638 29843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:27.788125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.193:42813)
0811 17:11:27.788828 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:27.788885 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:27.790382 (+ 1497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:27.791217 (+ 835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:27.791231 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:27.791793 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:27.792591 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:27.792617 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:27.793548 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:27.793552 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:27.794612 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:27.794623 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:27.795238 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:27.795242 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:27.795450 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:27.796223 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:27.796243 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:27.798218 (+ 1975us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:27.800362 (+ 2144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:27.800370 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:27.800393 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:27.800746 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:27.801112 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:27.801116 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:27.801118 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:27.801304 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:27.801785 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:27.801796 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:27.802110 (+ 314us) client_negotiation.cc:769] Sending connection context
0811 17:11:27.802320 (+ 210us) client_negotiation.cc:240] Negotiation successful
0811 17:11:27.802725 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":127,"threads_started":1}
I20260811 17:11:27.805154 29838 heartbeater.cc:347] Connected to a master server at 127.4.146.254:34867
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.194@KRBTEST.COM" created.
I20260811 17:11:27.805480 29838 heartbeater.cc:464] Registering TS with master...
I20260811 17:11:27.806025 29838 heartbeater.cc:511] Master 127.4.146.254:34867 requested a full tablet report, sending...
I20260811 17:11:27.807919 29491 ts_manager.cc:194] Registered new tserver with Master: 31677abfedd14f438297f889a7191560 (127.4.146.193:39385)
I20260811 17:11:27.809274 29491 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.193@KRBTEST.COM'} at 127.4.146.193:42813
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
I20260811 17:11:27.825578 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:34867
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:11:27.951596 29847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:27.951920 29847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:27.951972 29847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:27.956595 29847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:27.956682 29847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:27.956748 29847 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:11:27.962656 29847 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:34867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29847
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:27.963900 29847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:27.965047 29847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:27.976358 29856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:27.976369 29853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:27.976369 29854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:27.976815 29847 server_base.cc:1034] running on GCE node
I20260811 17:11:27.977319 29847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:27.978138 29847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:27.979471 29847 hybrid_clock.cc:648] HybridClock initialized: now 1786468287979418 us; error 58 us; skew 500 ppm
Aug 11 17:11:27 dist-test-slave-7vjv krb5kdc[29403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468287, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:27.982933 29847 init.cc:377] Logged in from keytab as kudu/127.4.146.194@KRBTEST.COM (short username kudu)
I20260811 17:11:27.984157 29847 webserver.cc:460] Webserver started at http://127.4.146.194:34777/ using document root <none> and password file <none>
I20260811 17:11:27.984797 29847 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:27.984896 29847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:11:27.985160 29847 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:11:27.987402 29847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "de09adfa8acb494abed24ae33281ef95"
format_stamp: "Formatted at 2026-08-11 17:11:27 on dist-test-slave-7vjv"
server_key: "aa15c91eda6b215a2b890368c23906cf"
server_key_iv: "28cbea4fd61cf347e8a94bdf38b5f531"
server_key_version: "encryptionkey@0"
I20260811 17:11:27.988021 29847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "de09adfa8acb494abed24ae33281ef95"
format_stamp: "Formatted at 2026-08-11 17:11:27 on dist-test-slave-7vjv"
server_key: "aa15c91eda6b215a2b890368c23906cf"
server_key_iv: "28cbea4fd61cf347e8a94bdf38b5f531"
server_key_version: "encryptionkey@0"
I20260811 17:11:27.992617 29847 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 17:11:27.995395 29868 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:27.997020 29847 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:11:27.997193 29847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "de09adfa8acb494abed24ae33281ef95"
format_stamp: "Formatted at 2026-08-11 17:11:27 on dist-test-slave-7vjv"
server_key: "aa15c91eda6b215a2b890368c23906cf"
server_key_iv: "28cbea4fd61cf347e8a94bdf38b5f531"
server_key_version: "encryptionkey@0"
I20260811 17:11:27.997332 29847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:28.027853 29847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:28.032496 29847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:28.032838 29847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:28.033586 29847 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:11:28.034739 29847 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:11:28.034821 29847 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:28.034900 29847 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:11:28.034945 29847 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:28.045149 29847 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:39971
I20260811 17:11:28.045171 30086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:39971 every 8 connection(s)
I20260811 17:11:28.046263 29847 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:11:28.055716 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 29847
I20260811 17:11:28.055887 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:11:28.056269 4683 external_mini_cluster.cc:1428] Setting key 803fe334f0410b7001a32942e8132ce5
Aug 11 17:11:28 dist-test-slave-7vjv krb5kdc[29403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468287, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:11:28.063795 29560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:28.048594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:52675 (local address 127.4.146.254:34867)
0811 17:11:28.048793 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:28.048798 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:28.050556 (+ 1758us) server_negotiation.cc:407] Connection header received
0811 17:11:28.051999 (+ 1443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:28.052003 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:28.052072 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:28.052229 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:28.053697 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.054254 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.055532 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.055798 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.055969 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:28.059092 (+ 3123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:28.059097 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:28.059100 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:28.059135 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:28.061045 (+ 1910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:28.061736 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:28.061742 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:28.061747 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:28.061855 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:28.062410 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:28.062413 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:28.062415 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:28.062655 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:28.062752 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:28.063503 (+ 751us) server_negotiation.cc:299] Negotiation successful
0811 17:11:28.063662 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260811 17:11:28.065263 30089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:28.049264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.194:52675)
0811 17:11:28.050324 (+ 1060us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:28.050395 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:28.051675 (+ 1280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:28.052457 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:28.052465 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:28.052894 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:28.053522 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:28.053537 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.054400 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.054403 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:28.055346 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:28.055357 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.056058 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.056065 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:28.056313 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:28.057002 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:28.057020 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:28.058905 (+ 1885us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:28.061208 (+ 2303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:28.061214 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:28.061230 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:28.061622 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:28.062027 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:28.062033 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:28.062038 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:28.062274 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:28.062785 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:28.062795 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:28.063200 (+ 405us) client_negotiation.cc:769] Sending connection context
0811 17:11:28.063442 (+ 242us) client_negotiation.cc:240] Negotiation successful
0811 17:11:28.063912 (+ 470us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":742,"thread_start_us":201,"threads_started":1}
I20260811 17:11:28.066995 30087 heartbeater.cc:347] Connected to a master server at 127.4.146.254:34867
I20260811 17:11:28.067299 30087 heartbeater.cc:464] Registering TS with master...
I20260811 17:11:28.067916 30087 heartbeater.cc:511] Master 127.4.146.254:34867 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.4.146.195@KRBTEST.COM; defaulting to no policy
I20260811 17:11:28.069263 29491 ts_manager.cc:194] Registered new tserver with Master: de09adfa8acb494abed24ae33281ef95 (127.4.146.194:39971)
I20260811 17:11:28.069945 29491 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.194@KRBTEST.COM'} at 127.4.146.194:52675
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
I20260811 17:11:28.092777 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:34867
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:11:28.219900 30096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:28.220321 30096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:28.220376 30096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:28.225448 30096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:28.225558 30096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:28.225625 30096 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:11:28.232486 30096 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:34867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:28.233817 30096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:28.234936 30096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 17:11:28.246788 30096 server_base.cc:1034] running on GCE node
W20260811 17:11:28.246726 30104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:28.246739 30107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:28.246727 30110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:28.247601 30096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:28.248409 30096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:28.249612 30096 hybrid_clock.cc:648] HybridClock initialized: now 1786468288249577 us; error 57 us; skew 500 ppm
Aug 11 17:11:28 dist-test-slave-7vjv krb5kdc[29403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468288, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:28.252959 30096 init.cc:377] Logged in from keytab as kudu/127.4.146.195@KRBTEST.COM (short username kudu)
I20260811 17:11:28.254051 30096 webserver.cc:460] Webserver started at http://127.4.146.195:41907/ using document root <none> and password file <none>
I20260811 17:11:28.254680 30096 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:28.254783 30096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:11:28.255036 30096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:11:28.257329 30096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "3f652faaa74045a0a3e6cdec66c497b7"
format_stamp: "Formatted at 2026-08-11 17:11:28 on dist-test-slave-7vjv"
server_key: "d628f94c18cb4e69bc4a90e14d527df3"
server_key_iv: "f60e4d23babd531758447d66f4f5d763"
server_key_version: "encryptionkey@0"
I20260811 17:11:28.258037 30096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "3f652faaa74045a0a3e6cdec66c497b7"
format_stamp: "Formatted at 2026-08-11 17:11:28 on dist-test-slave-7vjv"
server_key: "d628f94c18cb4e69bc4a90e14d527df3"
server_key_iv: "f60e4d23babd531758447d66f4f5d763"
server_key_version: "encryptionkey@0"
I20260811 17:11:28.262392 30096 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 17:11:28.265441 30122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:28.266988 30096 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:11:28.267168 30096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "3f652faaa74045a0a3e6cdec66c497b7"
format_stamp: "Formatted at 2026-08-11 17:11:28 on dist-test-slave-7vjv"
server_key: "d628f94c18cb4e69bc4a90e14d527df3"
server_key_iv: "f60e4d23babd531758447d66f4f5d763"
server_key_version: "encryptionkey@0"
I20260811 17:11:28.267311 30096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:28.283561 30096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:28.287611 30096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:28.287866 30096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:28.288652 30096 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:11:28.289726 30096 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:11:28.289801 30096 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:28.289878 30096 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:11:28.289932 30096 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:28.299360 30096 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:41425
I20260811 17:11:28.299441 30312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:41425 every 8 connection(s)
I20260811 17:11:28.300500 30096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:11:28.301626 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 30096
I20260811 17:11:28.301769 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:11:28.302034 4683 external_mini_cluster.cc:1428] Setting key fc02d36632e164439660bacb677857d9
Aug 11 17:11:28 dist-test-slave-7vjv krb5kdc[29403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468288, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:11:28.316381 29560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:28.302822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:45203 (local address 127.4.146.254:34867)
0811 17:11:28.303015 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:28.303021 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:28.304593 (+ 1572us) server_negotiation.cc:407] Connection header received
0811 17:11:28.305338 (+ 745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:28.305341 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:28.305390 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:28.305468 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:28.306732 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.307268 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.308616 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.308873 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.309102 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:28.312038 (+ 2936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:28.312042 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:28.312044 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:28.312075 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:28.313515 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:28.314133 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:28.314136 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:28.314137 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:28.314284 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:28.314753 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:28.314757 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:28.314759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:28.315060 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:28.315172 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:28.315937 (+ 765us) server_negotiation.cc:299] Negotiation successful
0811 17:11:28.316185 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260811 17:11:28.317395 30319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:28.303299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.195:45203)
0811 17:11:28.304229 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:28.304293 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:28.305115 (+ 822us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:28.305631 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:28.305638 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:28.306036 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:28.306552 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:28.306567 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.307405 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.307408 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:28.308470 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:28.308482 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.309180 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.309184 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:28.309355 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:28.310125 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:28.310149 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:28.311788 (+ 1639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:28.313653 (+ 1865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:28.313659 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:28.313675 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:28.313983 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:28.314410 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:28.314413 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:28.314414 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:28.314587 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:28.315191 (+ 604us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:28.315200 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:28.315584 (+ 384us) client_negotiation.cc:769] Sending connection context
0811 17:11:28.315862 (+ 278us) client_negotiation.cc:240] Negotiation successful
0811 17:11:28.316290 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":668,"thread_start_us":188,"threads_started":1}
I20260811 17:11:28.318709 30317 heartbeater.cc:347] Connected to a master server at 127.4.146.254:34867
I20260811 17:11:28.318964 30317 heartbeater.cc:464] Registering TS with master...
I20260811 17:11:28.319525 30317 heartbeater.cc:511] Master 127.4.146.254:34867 requested a full tablet report, sending...
I20260811 17:11:28.320701 29491 ts_manager.cc:194] Registered new tserver with Master: 3f652faaa74045a0a3e6cdec66c497b7 (127.4.146.195:41425)
I20260811 17:11:28.321308 29491 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.195@KRBTEST.COM'} at 127.4.146.195:45203
I20260811 17:11:28.329378 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 17:11:28.341691 29560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:28.331925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42946 (local address 127.4.146.254:34867)
0811 17:11:28.332118 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:28.332125 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:28.332344 (+ 219us) server_negotiation.cc:407] Connection header received
0811 17:11:28.332526 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:28.332530 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:28.332589 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:28.332679 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:28.333474 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.334027 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.334941 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.335364 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.335473 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:28.337613 (+ 2140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:28.337617 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:28.337620 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:28.337658 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:28.339598 (+ 1940us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:28.340128 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:28.340134 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:28.340136 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:28.340235 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:28.340559 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:28.340562 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:28.340564 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:28.340933 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:28.341131 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:28.341383 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 17:11:28.341529 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 17:11:28.345053 29491 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42946:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 17:11:28.348264 29491 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:11:28.364578 30344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:28.358894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:41425 (local address 127.0.0.1:60834)
0811 17:11:28.359157 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:28.359172 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:28.359274 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:28.360333 (+ 1059us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:28.360336 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:28.360355 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:11:28.360462 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:28.360469 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.361598 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.361602 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:28.362881 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:28.362891 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.363897 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.363901 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:28.364015 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:28.364062 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 17:11:28.364221 (+ 159us) client_negotiation.cc:240] Negotiation successful
0811 17:11:28.364396 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":65,"thread_start_us":99,"threads_started":1}
I20260811 17:11:28.364748 30343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:28.358351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40816 (local address 127.4.146.193:39385)
0811 17:11:28.359962 (+ 1611us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:28.359967 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:28.359987 (+ 20us) server_negotiation.cc:407] Connection header received
0811 17:11:28.360152 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:28.360157 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:28.360339 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:28.360787 (+ 448us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:11:28.360929 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.362005 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.363425 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.364047 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.364208 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:28.364362 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:28.364481 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 17:11:28.364575 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1483,"thread_start_us":131,"threads_started":1}
I20260811 17:11:28.364773 30337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:28.358102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:39385 (local address 127.0.0.1:40816)
0811 17:11:28.358951 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:28.359011 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:28.359164 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:28.360487 (+ 1323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:28.360490 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:28.360507 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:11:28.360591 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:28.360597 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.362138 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.362141 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:28.363284 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:28.363295 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.364214 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.364218 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:28.364343 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:28.364366 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 17:11:28.364447 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 17:11:28.364527 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":733,"mutex_wait_us":155,"spinlock_wait_cycles":6144,"thread_start_us":134,"threads_started":1}
I20260811 17:11:28.365334 30341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:28.358274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47682 (local address 127.4.146.194:39971)
0811 17:11:28.359525 (+ 1251us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:28.359538 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:28.359564 (+ 26us) server_negotiation.cc:407] Connection header received
0811 17:11:28.359692 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:28.359699 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:28.359933 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:28.360116 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:11:28.360480 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.361735 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.363352 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.364233 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.364336 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:28.364481 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:28.365079 (+ 598us) server_negotiation.cc:299] Negotiation successful
0811 17:11:28.365194 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1138,"thread_start_us":132,"threads_started":1}
I20260811 17:11:28.365381 30347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:28.359422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60834 (local address 127.4.146.195:41425)
0811 17:11:28.359817 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:28.359829 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:28.359873 (+ 44us) server_negotiation.cc:407] Connection header received
0811 17:11:28.359950 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:28.359955 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:28.360167 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:28.360356 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:11:28.360564 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.361462 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.363007 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.363763 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.363877 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:28.364042 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:28.365114 (+ 1072us) server_negotiation.cc:299] Negotiation successful
0811 17:11:28.365225 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":183,"threads_started":1}
I20260811 17:11:28.364974 30336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:28.358102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:39971 (local address 127.0.0.1:47682)
0811 17:11:28.358951 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:28.359011 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:28.359164 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:28.360133 (+ 969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:28.360140 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:28.360167 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:11:28.360318 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:28.360325 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.361910 (+ 1585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.361914 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:28.363205 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:28.363216 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.364540 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.364544 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:28.364652 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:28.364679 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 17:11:28.364750 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 17:11:28.364828 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":668,"mutex_wait_us":4,"spinlock_wait_cycles":3200,"thread_start_us":103,"threads_started":1}
I20260811 17:11:28.368161 29717 tablet_service.cc:1467] Processing CreateTablet for tablet f2c49a62e01b498c89241502f1e6ae44 (DEFAULT_TABLE table=test-table [id=3fb432306c7e4f85bbf312abc5528d78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:11:28.368227 30198 tablet_service.cc:1467] Processing CreateTablet for tablet f2c49a62e01b498c89241502f1e6ae44 (DEFAULT_TABLE table=test-table [id=3fb432306c7e4f85bbf312abc5528d78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:11:28.369275 29717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2c49a62e01b498c89241502f1e6ae44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:11:28.369311 30198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2c49a62e01b498c89241502f1e6ae44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:11:28.369194 29958 tablet_service.cc:1467] Processing CreateTablet for tablet f2c49a62e01b498c89241502f1e6ae44 (DEFAULT_TABLE table=test-table [id=3fb432306c7e4f85bbf312abc5528d78]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:11:28.370149 29958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2c49a62e01b498c89241502f1e6ae44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:11:28.376415 30348 tablet_bootstrap.cc:492] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560: Bootstrap starting.
I20260811 17:11:28.378083 30349 tablet_bootstrap.cc:492] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95: Bootstrap starting.
I20260811 17:11:28.379624 30348 tablet_bootstrap.cc:654] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560: Neither blocks nor log segments found. Creating new log.
I20260811 17:11:28.380350 30349 tablet_bootstrap.cc:654] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95: Neither blocks nor log segments found. Creating new log.
I20260811 17:11:28.380551 30351 tablet_bootstrap.cc:492] T f2c49a62e01b498c89241502f1e6ae44 P 3f652faaa74045a0a3e6cdec66c497b7: Bootstrap starting.
I20260811 17:11:28.380579 30348 log.cc:824] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560: Log is configured to *not* fsync() on all Append() calls
I20260811 17:11:28.381227 30349 log.cc:824] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95: Log is configured to *not* fsync() on all Append() calls
I20260811 17:11:28.383011 30351 tablet_bootstrap.cc:654] T f2c49a62e01b498c89241502f1e6ae44 P 3f652faaa74045a0a3e6cdec66c497b7: Neither blocks nor log segments found. Creating new log.
I20260811 17:11:28.383337 30348 tablet_bootstrap.cc:492] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560: No bootstrap required, opened a new log
I20260811 17:11:28.383646 30349 tablet_bootstrap.cc:492] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95: No bootstrap required, opened a new log
I20260811 17:11:28.383643 30348 ts_tablet_manager.cc:1397] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260811 17:11:28.383922 30349 ts_tablet_manager.cc:1397] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260811 17:11:28.384501 30351 log.cc:824] T f2c49a62e01b498c89241502f1e6ae44 P 3f652faaa74045a0a3e6cdec66c497b7: Log is configured to *not* fsync() on all Append() calls
I20260811 17:11:28.386793 30351 tablet_bootstrap.cc:492] T f2c49a62e01b498c89241502f1e6ae44 P 3f652faaa74045a0a3e6cdec66c497b7: No bootstrap required, opened a new log
I20260811 17:11:28.386991 30351 ts_tablet_manager.cc:1397] T f2c49a62e01b498c89241502f1e6ae44 P 3f652faaa74045a0a3e6cdec66c497b7: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 17:11:28.388021 30349 raft_consensus.cc:348] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de09adfa8acb494abed24ae33281ef95" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 39971 } } peers { permanent_uuid: "31677abfedd14f438297f889a7191560" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 39385 } } peers { permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 } }
I20260811 17:11:28.388378 30349 raft_consensus.cc:374] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:11:28.388473 30349 raft_consensus.cc:729] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de09adfa8acb494abed24ae33281ef95, State: Initialized, Role: FOLLOWER
I20260811 17:11:28.388630 30348 raft_consensus.cc:348] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de09adfa8acb494abed24ae33281ef95" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 39971 } } peers { permanent_uuid: "31677abfedd14f438297f889a7191560" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 39385 } } peers { permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 } }
I20260811 17:11:28.388942 30348 raft_consensus.cc:374] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:11:28.389045 30348 raft_consensus.cc:729] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31677abfedd14f438297f889a7191560, State: Initialized, Role: FOLLOWER
I20260811 17:11:28.389019 30349 consensus_queue.cc:260] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de09adfa8acb494abed24ae33281ef95" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 39971 } } peers { permanent_uuid: "31677abfedd14f438297f889a7191560" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 39385 } } peers { permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 } }
I20260811 17:11:28.389539 30348 consensus_queue.cc:260] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de09adfa8acb494abed24ae33281ef95" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 39971 } } peers { permanent_uuid: "31677abfedd14f438297f889a7191560" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 39385 } } peers { permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 } }
I20260811 17:11:28.389848 30087 heartbeater.cc:503] Master 127.4.146.254:34867 was elected leader, sending a full tablet report...
I20260811 17:11:28.390196 30349 ts_tablet_manager.cc:1428] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 17:11:28.390799 30348 ts_tablet_manager.cc:1428] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260811 17:11:28.391242 29838 heartbeater.cc:503] Master 127.4.146.254:34867 was elected leader, sending a full tablet report...
I20260811 17:11:28.391404 30351 raft_consensus.cc:348] T f2c49a62e01b498c89241502f1e6ae44 P 3f652faaa74045a0a3e6cdec66c497b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de09adfa8acb494abed24ae33281ef95" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 39971 } } peers { permanent_uuid: "31677abfedd14f438297f889a7191560" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 39385 } } peers { permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 } }
I20260811 17:11:28.391719 30351 raft_consensus.cc:374] T f2c49a62e01b498c89241502f1e6ae44 P 3f652faaa74045a0a3e6cdec66c497b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:11:28.391774 30351 raft_consensus.cc:729] T f2c49a62e01b498c89241502f1e6ae44 P 3f652faaa74045a0a3e6cdec66c497b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f652faaa74045a0a3e6cdec66c497b7, State: Initialized, Role: FOLLOWER
I20260811 17:11:28.392256 30351 consensus_queue.cc:260] T f2c49a62e01b498c89241502f1e6ae44 P 3f652faaa74045a0a3e6cdec66c497b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de09adfa8acb494abed24ae33281ef95" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 39971 } } peers { permanent_uuid: "31677abfedd14f438297f889a7191560" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 39385 } } peers { permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 } }
I20260811 17:11:28.393085 30317 heartbeater.cc:503] Master 127.4.146.254:34867 was elected leader, sending a full tablet report...
I20260811 17:11:28.393522 30351 ts_tablet_manager.cc:1428] T f2c49a62e01b498c89241502f1e6ae44 P 3f652faaa74045a0a3e6cdec66c497b7: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260811 17:11:28.395267 30359 raft_consensus.cc:482] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:11:28.395475 30359 raft_consensus.cc:504] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de09adfa8acb494abed24ae33281ef95" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 39971 } } peers { permanent_uuid: "31677abfedd14f438297f889a7191560" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 39385 } } peers { permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 } }
I20260811 17:11:28.396971 30359 leader_election.cc:288] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31677abfedd14f438297f889a7191560 (127.4.146.193:39385), 3f652faaa74045a0a3e6cdec66c497b7 (127.4.146.195:41425)
I20260811 17:11:28.400647 30343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:28.397161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:44157 (local address 127.4.146.193:39385)
0811 17:11:28.397292 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:28.397295 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:28.397306 (+ 11us) server_negotiation.cc:407] Connection header received
0811 17:11:28.397378 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:28.397383 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:28.397429 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:28.397500 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:11:28.397780 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.398303 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.399422 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.399997 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.400222 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:28.400285 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:28.400466 (+ 181us) server_negotiation.cc:299] Negotiation successful
0811 17:11:28.400531 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 17:11:28.400678 30089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:28.396936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:39385 (local address 127.4.146.194:44157)
0811 17:11:28.397054 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:28.397071 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:28.397164 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:28.397517 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:28.397520 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:28.397539 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:11:28.397655 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:28.397660 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.398419 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.398424 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:28.399288 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:28.399297 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.400202 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.400209 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:28.400329 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:28.400361 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 17:11:28.400443 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 17:11:28.400523 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":19}
I20260811 17:11:28.401397 29752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2c49a62e01b498c89241502f1e6ae44" candidate_uuid: "de09adfa8acb494abed24ae33281ef95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31677abfedd14f438297f889a7191560" is_pre_election: true
I20260811 17:11:28.401643 30362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:28.396943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:41425 (local address 127.4.146.194:44961)
0811 17:11:28.397722 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:28.397734 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:28.397863 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:28.398111 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:28.398114 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:28.398131 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:11:28.398256 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:28.398262 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.398967 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.398972 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:28.400134 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:28.400148 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.401219 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.401222 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:28.401315 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:28.401337 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 17:11:28.401424 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 17:11:28.401498 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":718,"mutex_wait_us":75,"thread_start_us":139,"threads_started":1}
I20260811 17:11:28.401765 30347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:28.397065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:44961 (local address 127.4.146.195:41425)
0811 17:11:28.397183 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:28.397188 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:28.397827 (+ 639us) server_negotiation.cc:407] Connection header received
0811 17:11:28.397947 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:28.397950 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:28.397998 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:28.398083 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:11:28.398368 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.398849 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.400285 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.400903 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.400996 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:28.401077 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:28.401484 (+ 407us) server_negotiation.cc:299] Negotiation successful
0811 17:11:28.401631 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 17:11:28.401814 29752 raft_consensus.cc:2454] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de09adfa8acb494abed24ae33281ef95 in term 0.
I20260811 17:11:28.402402 29873 leader_election.cc:302] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31677abfedd14f438297f889a7191560, de09adfa8acb494abed24ae33281ef95; no voters:
I20260811 17:11:28.402771 30359 raft_consensus.cc:2781] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:11:28.402793 30230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2c49a62e01b498c89241502f1e6ae44" candidate_uuid: "de09adfa8acb494abed24ae33281ef95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f652faaa74045a0a3e6cdec66c497b7" is_pre_election: true
I20260811 17:11:28.402915 30359 raft_consensus.cc:482] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:11:28.402976 30359 raft_consensus.cc:3037] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:11:28.403163 30230 raft_consensus.cc:2454] T f2c49a62e01b498c89241502f1e6ae44 P 3f652faaa74045a0a3e6cdec66c497b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de09adfa8acb494abed24ae33281ef95 in term 0.
I20260811 17:11:28.404397 30359 raft_consensus.cc:504] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de09adfa8acb494abed24ae33281ef95" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 39971 } } peers { permanent_uuid: "31677abfedd14f438297f889a7191560" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 39385 } } peers { permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 } }
I20260811 17:11:28.404824 30359 leader_election.cc:288] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [CANDIDATE]: Term 1 election: Requested vote from peers 31677abfedd14f438297f889a7191560 (127.4.146.193:39385), 3f652faaa74045a0a3e6cdec66c497b7 (127.4.146.195:41425)
I20260811 17:11:28.405285 29752 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2c49a62e01b498c89241502f1e6ae44" candidate_uuid: "de09adfa8acb494abed24ae33281ef95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31677abfedd14f438297f889a7191560"
I20260811 17:11:28.405380 30230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2c49a62e01b498c89241502f1e6ae44" candidate_uuid: "de09adfa8acb494abed24ae33281ef95" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f652faaa74045a0a3e6cdec66c497b7"
I20260811 17:11:28.405454 29752 raft_consensus.cc:3037] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:11:28.405534 30230 raft_consensus.cc:3037] T f2c49a62e01b498c89241502f1e6ae44 P 3f652faaa74045a0a3e6cdec66c497b7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:11:28.406675 30230 raft_consensus.cc:2454] T f2c49a62e01b498c89241502f1e6ae44 P 3f652faaa74045a0a3e6cdec66c497b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de09adfa8acb494abed24ae33281ef95 in term 1.
I20260811 17:11:28.406692 29752 raft_consensus.cc:2454] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de09adfa8acb494abed24ae33281ef95 in term 1.
I20260811 17:11:28.407002 29869 leader_election.cc:302] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f652faaa74045a0a3e6cdec66c497b7, de09adfa8acb494abed24ae33281ef95; no voters:
I20260811 17:11:28.407217 30359 raft_consensus.cc:2781] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:11:28.407436 30359 raft_consensus.cc:686] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [term 1 LEADER]: Becoming Leader. State: Replica: de09adfa8acb494abed24ae33281ef95, State: Running, Role: LEADER
I20260811 17:11:28.407860 30359 consensus_queue.cc:237] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de09adfa8acb494abed24ae33281ef95" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 39971 } } peers { permanent_uuid: "31677abfedd14f438297f889a7191560" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 39385 } } peers { permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 } }
I20260811 17:11:28.411615 29485 catalog_manager.cc:5495] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 reported cstate change: term changed from 0 to 1, leader changed from <none> to de09adfa8acb494abed24ae33281ef95 (127.4.146.194). New cstate: current_term: 1 leader_uuid: "de09adfa8acb494abed24ae33281ef95" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de09adfa8acb494abed24ae33281ef95" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 39971 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31677abfedd14f438297f889a7191560" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 39385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 } health_report { overall_health: UNKNOWN } } }
I20260811 17:11:28.434928 30341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:28.430988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47694 (local address 127.4.146.194:39971)
0811 17:11:28.431220 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:28.431225 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:28.431239 (+ 14us) server_negotiation.cc:407] Connection header received
0811 17:11:28.431334 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:28.431336 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:28.431395 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:28.431521 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:11:28.431824 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.432414 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.433321 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:28.433547 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:28.433664 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:28.434026 (+ 362us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:11:28.434495 (+ 469us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:11:28.434635 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:28.434701 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 17:11:28.434766 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 17:11:28.442073 30230 raft_consensus.cc:1261] T f2c49a62e01b498c89241502f1e6ae44 P 3f652faaa74045a0a3e6cdec66c497b7 [term 1 FOLLOWER]: Refusing update from remote peer de09adfa8acb494abed24ae33281ef95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:11:28.442047 29752 raft_consensus.cc:1261] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560 [term 1 FOLLOWER]: Refusing update from remote peer de09adfa8acb494abed24ae33281ef95: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:11:28.450244 30359 consensus_queue.cc:1035] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31677abfedd14f438297f889a7191560" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 39385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:11:28.450563 30364 consensus_queue.cc:1035] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:11:28.462446 30370 mvcc.cc:205] Tried to move back new op lower bound from 7317374109448400896 to 7317374109321965568. Current Snapshot: MvccSnapshot[applied={T|T < 7317374109448400896}]
I20260811 17:11:28.479856 29485 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42946:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:11:28.480067 29485 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42946:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:11:28.482800 29485 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321: Sending DeleteTablet for 3 replicas of tablet f2c49a62e01b498c89241502f1e6ae44
I20260811 17:11:28.483886 30198 tablet_service.cc:1514] Processing DeleteTablet for tablet f2c49a62e01b498c89241502f1e6ae44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:11:28 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:60834
I20260811 17:11:28.483892 29958 tablet_service.cc:1514] Processing DeleteTablet for tablet f2c49a62e01b498c89241502f1e6ae44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:11:28 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:47682
I20260811 17:11:28.484520 30387 tablet_replica.cc:330] T f2c49a62e01b498c89241502f1e6ae44 P 3f652faaa74045a0a3e6cdec66c497b7: stopping tablet replica
I20260811 17:11:28.484598 29717 tablet_service.cc:1514] Processing DeleteTablet for tablet f2c49a62e01b498c89241502f1e6ae44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:11:28 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:40816
I20260811 17:11:28.485013 30387 raft_consensus.cc:2229] T f2c49a62e01b498c89241502f1e6ae44 P 3f652faaa74045a0a3e6cdec66c497b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:11:28.485445 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 29608
I20260811 17:11:28.485455 30387 raft_consensus.cc:2258] T f2c49a62e01b498c89241502f1e6ae44 P 3f652faaa74045a0a3e6cdec66c497b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:11:28.518416 30387 ts_tablet_manager.cc:1905] T f2c49a62e01b498c89241502f1e6ae44 P 3f652faaa74045a0a3e6cdec66c497b7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:11:28.522166 30389 tablet_replica.cc:330] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95: stopping tablet replica
I20260811 17:11:28.522540 30387 ts_tablet_manager.cc:1918] T f2c49a62e01b498c89241502f1e6ae44 P 3f652faaa74045a0a3e6cdec66c497b7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:11:28.522846 30387 log.cc:1196] T f2c49a62e01b498c89241502f1e6ae44 P 3f652faaa74045a0a3e6cdec66c497b7: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/f2c49a62e01b498c89241502f1e6ae44
I20260811 17:11:28.522827 30389 raft_consensus.cc:2229] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [term 1 LEADER]: Raft consensus shutting down.
I20260811 17:11:28.523362 30387 ts_tablet_manager.cc:1939] T f2c49a62e01b498c89241502f1e6ae44 P 3f652faaa74045a0a3e6cdec66c497b7: Deleting consensus metadata
I20260811 17:11:28.523516 30389 raft_consensus.cc:2258] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:11:28.525071 29454 catalog_manager.cc:4841] TS 3f652faaa74045a0a3e6cdec66c497b7 (127.4.146.195:41425): tablet f2c49a62e01b498c89241502f1e6ae44 (table test-table [id=3fb432306c7e4f85bbf312abc5528d78]) successfully deleted
W20260811 17:11:28.526959 29455 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.146.193:39385 (error 108)
I20260811 17:11:28.527293 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 29847
I20260811 17:11:28.532646 30337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:28.532208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:39385 (local address 127.0.0.1:40824)
0811 17:11:28.532400 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:28.532509 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.193:39385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 17:11:28.532933 29455 catalog_manager.cc:4584] TS 31677abfedd14f438297f889a7191560 (127.4.146.193:39385): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f2c49a62e01b498c89241502f1e6ae44: Network error: Client connection negotiation failed: client connection to 127.4.146.193:39385: connect: Connection refused (error 111)
I20260811 17:11:28.538815 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 30096
I20260811 17:11:28.539112 30337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:28.538708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:39971 (local address 127.0.0.1:47704)
0811 17:11:28.538881 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:28.538992 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.194:39971: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260811 17:11:28.557273 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 29426
I20260811 17:11:28.580533 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:34867
--webserver_interface=127.4.146.254
--webserver_port=43375
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:34867
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:11:28.713675 30392 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:28.714030 30392 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:28.714078 30392 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:28.719189 30392 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:11:28.719280 30392 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:28.719307 30392 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:28.719326 30392 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:11:28.719343 30392 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:11:28.725589 30392 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:34867
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:34867
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=43375
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30392
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:28.726866 30392 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:28.728037 30392 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:28.744752 30407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:28.744827 30392 server_base.cc:1034] running on GCE node
W20260811 17:11:28.744765 30409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:28.744753 30411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:28.745769 30392 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:28.747243 30392 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:28.748471 30392 hybrid_clock.cc:648] HybridClock initialized: now 1786468288748440 us; error 59 us; skew 500 ppm
Aug 11 17:11:28 dist-test-slave-7vjv krb5kdc[29403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468288, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:28.752342 30392 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:11:28.753476 30392 webserver.cc:460] Webserver started at http://127.4.146.254:43375/ using document root <none> and password file <none>
I20260811 17:11:28.754165 30392 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:28.754293 30392 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:11:28.758927 30392 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 17:11:28.761739 30421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:28.763278 30392 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 17:11:28.763471 30392 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "b06fd163bb9e4d359523e1e6945f5321"
format_stamp: "Formatted at 2026-08-11 17:11:27 on dist-test-slave-7vjv"
server_key: "5a81fd86dba2308b856e37e1e89189a5"
server_key_iv: "8885787c5bcc7d9617616553b672d606"
server_key_version: "encryptionkey@0"
I20260811 17:11:28.764261 30392 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:28.802657 30392 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:28.808054 30392 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:28.808367 30392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:28.817740 30392 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:34867
I20260811 17:11:28.818075 30512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:34867 every 8 connection(s)
I20260811 17:11:28.819067 30392 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:11:28.820931 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 30392
I20260811 17:11:28.821431 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:39385
--local_ip_for_outbound_sockets=127.4.146.193
--tserver_master_addrs=127.4.146.254:34867
--webserver_port=41013
--webserver_interface=127.4.146.193
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 17:11:28.825379 30514 sys_catalog.cc:263] Verifying existing consensus state
I20260811 17:11:28.827562 30514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321: Bootstrap starting.
I20260811 17:11:28.848405 30514 log.cc:824] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321: Log is configured to *not* fsync() on all Append() calls
I20260811 17:11:28.859653 30514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 17:11:28.860216 30514 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321: Bootstrap complete.
I20260811 17:11:28.865183 30514 raft_consensus.cc:348] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fd163bb9e4d359523e1e6945f5321" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34867 } }
I20260811 17:11:28.865664 30514 raft_consensus.cc:729] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06fd163bb9e4d359523e1e6945f5321, State: Initialized, Role: FOLLOWER
I20260811 17:11:28.866233 30514 consensus_queue.cc:260] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fd163bb9e4d359523e1e6945f5321" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34867 } }
I20260811 17:11:28.866400 30514 raft_consensus.cc:388] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:11:28.866490 30514 raft_consensus.cc:482] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:11:28.866617 30514 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [term 1 FOLLOWER]: Advancing to term 2
I20260811 17:11:28.868974 30514 raft_consensus.cc:504] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fd163bb9e4d359523e1e6945f5321" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34867 } }
I20260811 17:11:28.869386 30514 leader_election.cc:302] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b06fd163bb9e4d359523e1e6945f5321; no voters:
I20260811 17:11:28.869771 30514 leader_election.cc:288] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 17:11:28.869866 30529 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 17:11:28.870090 30529 raft_consensus.cc:686] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [term 2 LEADER]: Becoming Leader. State: Replica: b06fd163bb9e4d359523e1e6945f5321, State: Running, Role: LEADER
I20260811 17:11:28.870410 30529 consensus_queue.cc:237] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fd163bb9e4d359523e1e6945f5321" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34867 } }
I20260811 17:11:28.871150 30514 sys_catalog.cc:564] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:11:28.871481 30529 sys_catalog.cc:455] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b06fd163bb9e4d359523e1e6945f5321. Latest consensus state: current_term: 2 leader_uuid: "b06fd163bb9e4d359523e1e6945f5321" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fd163bb9e4d359523e1e6945f5321" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34867 } } }
I20260811 17:11:28.871613 30529 sys_catalog.cc:458] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [sys.catalog]: This master's current role is: LEADER
I20260811 17:11:28.872001 30537 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:11:28.872026 30530 sys_catalog.cc:455] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b06fd163bb9e4d359523e1e6945f5321" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fd163bb9e4d359523e1e6945f5321" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34867 } } }
I20260811 17:11:28.872304 30530 sys_catalog.cc:458] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [sys.catalog]: This master's current role is: LEADER
I20260811 17:11:28.877370 30537 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:11:28.878125 30537 catalog_manager.cc:1259] Loaded cluster ID: b86e4a94001c477c9db32fee45b062a7
I20260811 17:11:28.878192 30537 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:11:28.879321 30537 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 17:11:28.882182 30537 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 17:11:28.887458 30537 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:11:28.888468 30537 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321: Loaded TSK: 0
I20260811 17:11:28.889524 30537 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 17:11:28.974730 30516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:28.975072 30516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:28.975162 30516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:28.979511 30516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:28.979647 30516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:28.979789 30516 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:11:28.985749 30516 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:39385
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=41013
--tserver_master_addrs=127.4.146.254:34867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30516
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:28.987002 30516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:28.988214 30516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:28.999730 30575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:28.999959 30516 server_base.cc:1034] running on GCE node
W20260811 17:11:28.999732 30569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:28.999732 30570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:29.000818 30516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:29.001696 30516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:29.002929 30516 hybrid_clock.cc:648] HybridClock initialized: now 1786468289002858 us; error 92 us; skew 500 ppm
Aug 11 17:11:29 dist-test-slave-7vjv krb5kdc[29403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468289, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:29.006482 30516 init.cc:377] Logged in from keytab as kudu/127.4.146.193@KRBTEST.COM (short username kudu)
I20260811 17:11:29.007747 30516 webserver.cc:460] Webserver started at http://127.4.146.193:41013/ using document root <none> and password file <none>
I20260811 17:11:29.008473 30516 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:29.008576 30516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:11:29.013497 30516 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260811 17:11:29.016435 30586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:29.018113 30516 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 17:11:29.018301 30516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "31677abfedd14f438297f889a7191560"
format_stamp: "Formatted at 2026-08-11 17:11:27 on dist-test-slave-7vjv"
server_key: "7fed74da281e59d33ae53a06f99e4831"
server_key_iv: "b48902092c228a48daefc5a2a94487ef"
server_key_version: "encryptionkey@0"
I20260811 17:11:29.018944 30516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:29.030999 30516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:29.037110 30516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:29.037758 30516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:29.038673 30516 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:11:29.040167 30593 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 17:11:29.045040 30516 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 17:11:29.045147 30516 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260811 17:11:29.045217 30516 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 17:11:29.047113 30516 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 17:11:29.047197 30516 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260811 17:11:29.047473 30593 tablet_bootstrap.cc:492] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560: Bootstrap starting.
I20260811 17:11:29.059326 30516 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:39385
I20260811 17:11:29.059401 30772 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:39385 every 8 connection(s)
I20260811 17:11:29.060914 30516 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:11:29.061823 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 30516
I20260811 17:11:29.062299 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:39971
--local_ip_for_outbound_sockets=127.4.146.194
--tserver_master_addrs=127.4.146.254:34867
--webserver_port=34777
--webserver_interface=127.4.146.194
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 17:11:29.071455 30593 log.cc:824] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560: Log is configured to *not* fsync() on all Append() calls
Aug 11 17:11:29 dist-test-slave-7vjv krb5kdc[29403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468289, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:11:29.080912 30593 tablet_bootstrap.cc:492] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 17:11:29.081462 30593 tablet_bootstrap.cc:492] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560: Bootstrap complete.
I20260811 17:11:29.083137 30593 ts_tablet_manager.cc:1397] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560: Time spent bootstrapping tablet: real 0.036s user 0.024s sys 0.007s
I20260811 17:11:29.086304 30593 raft_consensus.cc:348] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de09adfa8acb494abed24ae33281ef95" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 39971 } } peers { permanent_uuid: "31677abfedd14f438297f889a7191560" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 39385 } } peers { permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 } }
I20260811 17:11:29.086885 30593 raft_consensus.cc:729] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31677abfedd14f438297f889a7191560, State: Initialized, Role: FOLLOWER
I20260811 17:11:29.087278 30779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:29.066602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.193:59245)
0811 17:11:29.067346 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:29.067413 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:29.068641 (+ 1228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:29.070211 (+ 1570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:29.070220 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:29.070811 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:29.071615 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:29.071643 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.073974 (+ 2331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.073978 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:29.075366 (+ 1388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:29.075380 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.076695 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.076699 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:29.076892 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:29.077727 (+ 835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:29.077748 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:29.080035 (+ 2287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:29.083161 (+ 3126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:29.083170 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:29.083187 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:29.083599 (+ 412us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:29.084166 (+ 567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:29.084170 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:29.084172 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:29.084374 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:29.085205 (+ 831us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:29.085216 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:29.085580 (+ 364us) client_negotiation.cc:769] Sending connection context
0811 17:11:29.085816 (+ 236us) client_negotiation.cc:240] Negotiation successful
0811 17:11:29.086217 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":192,"threads_started":1}
I20260811 17:11:29.087481 30593 consensus_queue.cc:260] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de09adfa8acb494abed24ae33281ef95" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 39971 } } peers { permanent_uuid: "31677abfedd14f438297f889a7191560" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 39385 } } peers { permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 } }
I20260811 17:11:29.087762 30778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:29.066628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:59245 (local address 127.4.146.254:34867)
0811 17:11:29.067147 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:29.067169 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:29.067621 (+ 452us) server_negotiation.cc:407] Connection header received
0811 17:11:29.069188 (+ 1567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:29.069208 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:29.069684 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:29.070153 (+ 469us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:29.071864 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.073754 (+ 1890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.075550 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.076503 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.076734 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:29.080383 (+ 3649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:29.080391 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:29.080409 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:29.080451 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:29.082961 (+ 2510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:29.083758 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:29.083765 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:29.083771 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:29.084017 (+ 246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:29.084498 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:29.084502 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:29.084504 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:29.085037 (+ 533us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:29.085182 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:29.085990 (+ 808us) server_negotiation.cc:299] Negotiation successful
0811 17:11:29.086340 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":193,"threads_started":1}
I20260811 17:11:29.088690 30593 ts_tablet_manager.cc:1428] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560: Time spent starting tablet: real 0.005s user 0.007s sys 0.001s
I20260811 17:11:29.090360 30774 heartbeater.cc:347] Connected to a master server at 127.4.146.254:34867
I20260811 17:11:29.090612 30774 heartbeater.cc:464] Registering TS with master...
I20260811 17:11:29.091167 30774 heartbeater.cc:511] Master 127.4.146.254:34867 requested a full tablet report, sending...
I20260811 17:11:29.093905 30445 ts_manager.cc:194] Registered new tserver with Master: 31677abfedd14f438297f889a7191560 (127.4.146.193:39385)
I20260811 17:11:29.097568 30445 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.193@KRBTEST.COM'} at 127.4.146.193:59245
I20260811 17:11:29.100332 30774 heartbeater.cc:503] Master 127.4.146.254:34867 was elected leader, sending a full tablet report...
Aug 11 17:11:29 dist-test-slave-7vjv krb5kdc[29403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468288, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for kudu/127.4.146.193@KRBTEST.COM
I20260811 17:11:29.109699 30786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:29.096911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:39385 (local address 127.0.0.1:40832)
0811 17:11:29.097776 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:29.097821 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:29.097972 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:29.098545 (+ 573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:29.098551 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:29.099032 (+ 481us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:29.099174 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:29.099183 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.100636 (+ 1453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.100640 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:29.101818 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:29.101828 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.102714 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.102717 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:29.102803 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:29.103417 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:29.103430 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:29.105219 (+ 1789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:29.107514 (+ 2295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:29.107524 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:29.107528 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:29.107778 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:29.108286 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:29.108289 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:29.108290 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:29.108408 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:29.109088 (+ 680us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:29.109095 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:29.109224 (+ 129us) client_negotiation.cc:769] Sending connection context
0811 17:11:29.109355 (+ 131us) client_negotiation.cc:240] Negotiation successful
0811 17:11:29.109541 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":686,"thread_start_us":115,"threads_started":1}
I20260811 17:11:29.109845 30789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:29.097031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40832 (local address 127.4.146.193:39385)
0811 17:11:29.097490 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:29.097508 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:29.097935 (+ 427us) server_negotiation.cc:407] Connection header received
0811 17:11:29.098147 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:29.098153 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:29.098362 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:29.098510 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:29.099321 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.100479 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.102071 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.102581 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.102698 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:29.105406 (+ 2708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:29.105421 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:29.105436 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:29.105467 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:29.107369 (+ 1902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:29.107904 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:29.107911 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:29.107912 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:29.108015 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:29.108557 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:29.108560 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:29.108562 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:29.108927 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:29.109091 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:29.109467 (+ 376us) server_negotiation.cc:299] Negotiation successful
0811 17:11:29.109672 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":139,"threads_started":1}
I20260811 17:11:29.111071 30665 tablet_service.cc:1514] Processing DeleteTablet for tablet f2c49a62e01b498c89241502f1e6ae44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:11:28 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:40832
I20260811 17:11:29.112054 30790 tablet_replica.cc:330] stopping tablet replica
I20260811 17:11:29.112514 30790 raft_consensus.cc:2229] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:11:29.112802 30790 raft_consensus.cc:2258] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:11:29.113862 30790 ts_tablet_manager.cc:1905] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:11:29.118165 30790 ts_tablet_manager.cc:1918] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:11:29.118283 30790 log.cc:1196] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/wal/wals/f2c49a62e01b498c89241502f1e6ae44
I20260811 17:11:29.118573 30790 ts_tablet_manager.cc:1939] T f2c49a62e01b498c89241502f1e6ae44 P 31677abfedd14f438297f889a7191560: Deleting consensus metadata
I20260811 17:11:29.120553 30423 catalog_manager.cc:4841] TS 31677abfedd14f438297f889a7191560 (127.4.146.193:39385): tablet f2c49a62e01b498c89241502f1e6ae44 (table test-table [id=3fb432306c7e4f85bbf312abc5528d78]) successfully deleted
W20260811 17:11:29.203912 30777 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:29.204319 30777 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:29.204404 30777 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:29.208755 30777 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:29.208863 30777 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:29.208966 30777 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:11:29.214902 30777 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:39971
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=34777
--tserver_master_addrs=127.4.146.254:34867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30777
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:29.216226 30777 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:29.217412 30777 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:29.228700 30804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:29.228825 30809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:29.228768 30807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:29.229177 30777 server_base.cc:1034] running on GCE node
I20260811 17:11:29.229844 30777 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:29.231495 30777 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:29.233106 30777 hybrid_clock.cc:648] HybridClock initialized: now 1786468289232946 us; error 155 us; skew 500 ppm
Aug 11 17:11:29 dist-test-slave-7vjv krb5kdc[29403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468289, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:29.236773 30777 init.cc:377] Logged in from keytab as kudu/127.4.146.194@KRBTEST.COM (short username kudu)
I20260811 17:11:29.237856 30777 webserver.cc:460] Webserver started at http://127.4.146.194:34777/ using document root <none> and password file <none>
I20260811 17:11:29.238444 30777 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:29.238530 30777 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:11:29.243103 30777 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 17:11:29.245934 30817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:29.247722 30777 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 17:11:29.247902 30777 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "de09adfa8acb494abed24ae33281ef95"
format_stamp: "Formatted at 2026-08-11 17:11:27 on dist-test-slave-7vjv"
server_key: "aa15c91eda6b215a2b890368c23906cf"
server_key_iv: "28cbea4fd61cf347e8a94bdf38b5f531"
server_key_version: "encryptionkey@0"
I20260811 17:11:29.248610 30777 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:29.268764 30777 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:29.272535 30777 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:29.272787 30777 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:29.273502 30777 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:11:29.274721 30826 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 17:11:29.279299 30777 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 17:11:29.279417 30777 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260811 17:11:29.279531 30777 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 17:11:29.281672 30777 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 17:11:29.281762 30777 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.001s sys 0.000s
I20260811 17:11:29.282099 30826 tablet_bootstrap.cc:492] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95: Bootstrap starting.
I20260811 17:11:29.293745 30777 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:39971
I20260811 17:11:29.293848 31025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:39971 every 8 connection(s)
I20260811 17:11:29.294827 30777 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:11:29.301687 30826 log.cc:824] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95: Log is configured to *not* fsync() on all Append() calls
I20260811 17:11:29.305147 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 30777
I20260811 17:11:29.305737 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:41425
--local_ip_for_outbound_sockets=127.4.146.195
--tserver_master_addrs=127.4.146.254:34867
--webserver_port=41907
--webserver_interface=127.4.146.195
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 17:11:29 dist-test-slave-7vjv krb5kdc[29403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468289, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:11:29.311281 30826 tablet_bootstrap.cc:492] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 17:11:29.311439 30778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:29.296875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:60487 (local address 127.4.146.254:34867)
0811 17:11:29.297046 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:29.297053 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:29.297837 (+ 784us) server_negotiation.cc:407] Connection header received
0811 17:11:29.299158 (+ 1321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:29.299161 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:29.299209 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:29.299287 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:29.300937 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.301484 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.302937 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.303215 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.303307 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:29.306816 (+ 3509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:29.306820 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:29.306823 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:29.306856 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:29.308732 (+ 1876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:29.309488 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:29.309492 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:29.309493 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:29.309603 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:29.310010 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:29.310015 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:29.310017 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:29.310241 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:29.310360 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:29.311065 (+ 705us) server_negotiation.cc:299] Negotiation successful
0811 17:11:29.311221 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 17:11:29.311836 30826 tablet_bootstrap.cc:492] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95: Bootstrap complete.
I20260811 17:11:29.312309 31028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:29.296998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.194:60487)
0811 17:11:29.297621 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:29.297694 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:29.298872 (+ 1178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:29.299500 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:29.299511 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:29.300063 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:29.300759 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:29.300792 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.301653 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.301659 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:29.302792 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:29.302803 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.303373 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.303378 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:29.303597 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:29.304365 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:29.304387 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:29.306595 (+ 2208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:29.308885 (+ 2290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:29.308894 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:29.308913 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:29.309349 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:29.309713 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:29.309716 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:29.309717 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:29.309899 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:29.310358 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:29.310365 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:29.310630 (+ 265us) client_negotiation.cc:769] Sending connection context
0811 17:11:29.310837 (+ 207us) client_negotiation.cc:240] Negotiation successful
0811 17:11:29.311228 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":124,"threads_started":1}
I20260811 17:11:29.313668 31026 heartbeater.cc:347] Connected to a master server at 127.4.146.254:34867
I20260811 17:11:29.313714 30826 ts_tablet_manager.cc:1397] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95: Time spent bootstrapping tablet: real 0.032s user 0.014s sys 0.015s
I20260811 17:11:29.313988 31026 heartbeater.cc:464] Registering TS with master...
I20260811 17:11:29.314555 31026 heartbeater.cc:511] Master 127.4.146.254:34867 requested a full tablet report, sending...
I20260811 17:11:29.316493 30445 ts_manager.cc:194] Registered new tserver with Master: de09adfa8acb494abed24ae33281ef95 (127.4.146.194:39971)
I20260811 17:11:29.317797 30445 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.194@KRBTEST.COM'} at 127.4.146.194:60487
I20260811 17:11:29.318404 30826 raft_consensus.cc:348] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de09adfa8acb494abed24ae33281ef95" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 39971 } } peers { permanent_uuid: "31677abfedd14f438297f889a7191560" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 39385 } } peers { permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 } }
I20260811 17:11:29.319167 30826 raft_consensus.cc:729] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de09adfa8acb494abed24ae33281ef95, State: Initialized, Role: FOLLOWER
I20260811 17:11:29.319887 30826 consensus_queue.cc:260] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "de09adfa8acb494abed24ae33281ef95" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 39971 } } peers { permanent_uuid: "31677abfedd14f438297f889a7191560" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 39385 } } peers { permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 } }
I20260811 17:11:29.321820 30826 ts_tablet_manager.cc:1428] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260811 17:11:29.322296 31026 heartbeater.cc:503] Master 127.4.146.254:34867 was elected leader, sending a full tablet report...
Aug 11 17:11:29 dist-test-slave-7vjv krb5kdc[29403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468288, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for kudu/127.4.146.194@KRBTEST.COM
I20260811 17:11:29.331157 30786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:29.317465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:39971 (local address 127.0.0.1:47716)
0811 17:11:29.317790 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:29.317807 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:29.317902 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:29.319248 (+ 1346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:29.319252 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:29.319479 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:29.319599 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:29.319607 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.321629 (+ 2022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.321634 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:29.322497 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:29.322512 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.323359 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.323363 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:29.323466 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:29.324149 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:29.324165 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:29.326278 (+ 2113us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:29.328767 (+ 2489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:29.328771 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:29.328774 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:29.329094 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:29.329578 (+ 484us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:29.329582 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:29.329584 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:29.329748 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:29.330342 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:29.330345 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:29.330503 (+ 158us) client_negotiation.cc:769] Sending connection context
0811 17:11:29.330675 (+ 172us) client_negotiation.cc:240] Negotiation successful
0811 17:11:29.330894 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244}
I20260811 17:11:29.331234 31032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:29.318415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47716 (local address 127.4.146.194:39971)
0811 17:11:29.318724 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:29.318735 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:29.318759 (+ 24us) server_negotiation.cc:407] Connection header received
0811 17:11:29.318828 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:29.318833 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:29.319058 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:29.319789 (+ 731us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:29.319981 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.321427 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.322656 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.323219 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.323344 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:29.326447 (+ 3103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:29.326462 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:29.326485 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:29.326518 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:29.328614 (+ 2096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:29.329266 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:29.329272 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:29.329273 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:29.329447 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:29.329857 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:29.329861 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:29.329863 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:29.330201 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:29.330386 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:29.330786 (+ 400us) server_negotiation.cc:299] Negotiation successful
0811 17:11:29.331006 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":120,"threads_started":1}
I20260811 17:11:29.332629 30898 tablet_service.cc:1514] Processing DeleteTablet for tablet f2c49a62e01b498c89241502f1e6ae44 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:11:28 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:47716
I20260811 17:11:29.333693 31035 tablet_replica.cc:330] stopping tablet replica
I20260811 17:11:29.334036 31035 raft_consensus.cc:2229] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:11:29.334286 31035 raft_consensus.cc:2258] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:11:29.335475 31035 ts_tablet_manager.cc:1905] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:11:29.339718 31035 ts_tablet_manager.cc:1918] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:11:29.339828 31035 log.cc:1196] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/wal/wals/f2c49a62e01b498c89241502f1e6ae44
I20260811 17:11:29.340186 31035 ts_tablet_manager.cc:1939] T f2c49a62e01b498c89241502f1e6ae44 P de09adfa8acb494abed24ae33281ef95: Deleting consensus metadata
I20260811 17:11:29.341859 30422 catalog_manager.cc:4841] TS de09adfa8acb494abed24ae33281ef95 (127.4.146.194:39971): tablet f2c49a62e01b498c89241502f1e6ae44 (table test-table [id=3fb432306c7e4f85bbf312abc5528d78]) successfully deleted
W20260811 17:11:29.439759 31030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:29.440142 31030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:29.440240 31030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:29.444521 31030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:29.444653 31030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:29.444764 31030 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:11:29.450572 31030 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:41425
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=41907
--tserver_master_addrs=127.4.146.254:34867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31030
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:29.452325 31030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:29.453694 31030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:29.465430 31051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:29.465449 31049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:29.465492 31042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:29.465765 31030 server_base.cc:1034] running on GCE node
I20260811 17:11:29.466518 31030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:29.467366 31030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:29.468619 31030 hybrid_clock.cc:648] HybridClock initialized: now 1786468289468565 us; error 51 us; skew 500 ppm
Aug 11 17:11:29 dist-test-slave-7vjv krb5kdc[29403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468289, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:29.472354 31030 init.cc:377] Logged in from keytab as kudu/127.4.146.195@KRBTEST.COM (short username kudu)
I20260811 17:11:29.473479 31030 webserver.cc:460] Webserver started at http://127.4.146.195:41907/ using document root <none> and password file <none>
I20260811 17:11:29.474092 31030 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:29.474186 31030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:11:29.478538 31030 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 17:11:29.481101 31063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:29.482713 31030 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 17:11:29.482872 31030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "3f652faaa74045a0a3e6cdec66c497b7"
format_stamp: "Formatted at 2026-08-11 17:11:28 on dist-test-slave-7vjv"
server_key: "d628f94c18cb4e69bc4a90e14d527df3"
server_key_iv: "f60e4d23babd531758447d66f4f5d763"
server_key_version: "encryptionkey@0"
I20260811 17:11:29.483500 31030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:29.497227 31030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:29.501017 31030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:29.501256 31030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:29.501912 31030 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:11:29.503167 31030 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:11:29.503242 31030 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:29.503298 31030 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:11:29.503319 31030 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:29.516012 31030 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:41425
I20260811 17:11:29.516036 31268 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:41425 every 8 connection(s)
I20260811 17:11:29.517311 31030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:11:29.526687 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 31030
Aug 11 17:11:29 dist-test-slave-7vjv krb5kdc[29403](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468289, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:11:29.534623 30778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:29.519633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:57763 (local address 127.4.146.254:34867)
0811 17:11:29.519820 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:29.519824 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:29.520941 (+ 1117us) server_negotiation.cc:407] Connection header received
0811 17:11:29.521973 (+ 1032us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:29.521977 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:29.522046 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:29.522136 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:29.523599 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.524412 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.525774 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.526056 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.526185 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:29.529547 (+ 3362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:29.529551 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:29.529554 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:29.529586 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:29.531765 (+ 2179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:29.532616 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:29.532620 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:29.532622 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:29.532729 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:29.533252 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:29.533256 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:29.533257 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:29.533470 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:29.533557 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:29.534289 (+ 732us) server_negotiation.cc:299] Negotiation successful
0811 17:11:29.534441 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 17:11:29.535575 31272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:29.519952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.195:57763)
0811 17:11:29.520764 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:29.520811 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:29.521730 (+ 919us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:29.522339 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:29.522347 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:29.522844 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:29.523416 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:29.523432 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.524568 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.524572 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:29.525618 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:29.525629 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.526255 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.526259 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:29.526501 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:29.527268 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:29.527309 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:29.529369 (+ 2060us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:29.531912 (+ 2543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:29.531920 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:29.531942 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:29.532454 (+ 512us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:29.532845 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:29.532852 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:29.532855 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:29.533099 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:29.533595 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:29.533607 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:29.533969 (+ 362us) client_negotiation.cc:769] Sending connection context
0811 17:11:29.534204 (+ 235us) client_negotiation.cc:240] Negotiation successful
0811 17:11:29.534601 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":167,"threads_started":1}
I20260811 17:11:29.537084 31269 heartbeater.cc:347] Connected to a master server at 127.4.146.254:34867
I20260811 17:11:29.537408 31269 heartbeater.cc:464] Registering TS with master...
I20260811 17:11:29.538110 31276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:29.527519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52764 (local address 127.4.146.254:34867)
0811 17:11:29.527826 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:29.527829 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:29.527955 (+ 126us) server_negotiation.cc:407] Connection header received
0811 17:11:29.528198 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:29.528200 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:29.528245 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:29.528355 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:29.529287 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.530250 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.531228 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.531686 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.531830 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:29.533684 (+ 1854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:29.533687 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:29.533689 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:29.533709 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:29.535538 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:29.536179 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:29.536183 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:29.536184 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:29.536282 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:29.536715 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:29.536722 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:29.536723 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:29.537201 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:29.537431 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:29.537777 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 17:11:29.537932 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":91,"threads_started":1}
I20260811 17:11:29.538131 31269 heartbeater.cc:511] Master 127.4.146.254:34867 requested a full tablet report, sending...
I20260811 17:11:29.539498 30445 ts_manager.cc:194] Registered new tserver with Master: 3f652faaa74045a0a3e6cdec66c497b7 (127.4.146.195:41425)
I20260811 17:11:29.540216 30445 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.195@KRBTEST.COM'} at 127.4.146.195:57763
I20260811 17:11:29.540527 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 17:11:29.545112 31276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:29.541205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52776 (local address 127.4.146.254:34867)
0811 17:11:29.541352 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:29.541357 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:29.541654 (+ 297us) server_negotiation.cc:407] Connection header received
0811 17:11:29.541810 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:29.541812 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:29.541908 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:29.541992 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:11:29.542285 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.542795 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.543677 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.543915 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.543998 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:29.544382 (+ 384us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:11:29.544760 (+ 378us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:11:29.544856 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:29.544910 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 17:11:29.544968 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 17:11:29.545825 30445 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:52776:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 17:11:29.549301 30445 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:11:29.559824 30898 tablet_service.cc:1467] Processing CreateTablet for tablet 6ff551f236fc4bc08f9522775587d3b3 (DEFAULT_TABLE table=test-table [id=040c0666c37e4c189b4329ab559d527b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:11:29.560513 30898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ff551f236fc4bc08f9522775587d3b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:11:29.563333 30826 tablet_bootstrap.cc:492] T 6ff551f236fc4bc08f9522775587d3b3 P de09adfa8acb494abed24ae33281ef95: Bootstrap starting.
I20260811 17:11:29.564625 30826 tablet_bootstrap.cc:654] T 6ff551f236fc4bc08f9522775587d3b3 P de09adfa8acb494abed24ae33281ef95: Neither blocks nor log segments found. Creating new log.
I20260811 17:11:29.565752 30665 tablet_service.cc:1467] Processing CreateTablet for tablet 6ff551f236fc4bc08f9522775587d3b3 (DEFAULT_TABLE table=test-table [id=040c0666c37e4c189b4329ab559d527b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:11:29.566259 30826 tablet_bootstrap.cc:492] T 6ff551f236fc4bc08f9522775587d3b3 P de09adfa8acb494abed24ae33281ef95: No bootstrap required, opened a new log
I20260811 17:11:29.566361 30826 ts_tablet_manager.cc:1397] T 6ff551f236fc4bc08f9522775587d3b3 P de09adfa8acb494abed24ae33281ef95: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 17:11:29.566491 30665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ff551f236fc4bc08f9522775587d3b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:11:29.566876 30826 raft_consensus.cc:348] T 6ff551f236fc4bc08f9522775587d3b3 P de09adfa8acb494abed24ae33281ef95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 } } peers { permanent_uuid: "31677abfedd14f438297f889a7191560" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 39385 } } peers { permanent_uuid: "de09adfa8acb494abed24ae33281ef95" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 39971 } }
I20260811 17:11:29.567011 30826 raft_consensus.cc:374] T 6ff551f236fc4bc08f9522775587d3b3 P de09adfa8acb494abed24ae33281ef95 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:11:29.567061 30826 raft_consensus.cc:729] T 6ff551f236fc4bc08f9522775587d3b3 P de09adfa8acb494abed24ae33281ef95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de09adfa8acb494abed24ae33281ef95, State: Initialized, Role: FOLLOWER
I20260811 17:11:29.567349 30826 consensus_queue.cc:260] T 6ff551f236fc4bc08f9522775587d3b3 P de09adfa8acb494abed24ae33281ef95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 } } peers { permanent_uuid: "31677abfedd14f438297f889a7191560" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 39385 } } peers { permanent_uuid: "de09adfa8acb494abed24ae33281ef95" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 39971 } }
I20260811 17:11:29.567440 30786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:29.558668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:41425 (local address 127.0.0.1:51330)
0811 17:11:29.559177 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:29.559190 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:29.559259 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:29.562580 (+ 3321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:29.562583 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:29.562607 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:11:29.562709 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:29.562715 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.563979 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.563984 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:29.565585 (+ 1601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:29.565599 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.566861 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.566866 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:29.566978 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:29.567037 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 17:11:29.567138 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 17:11:29.567251 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":422}
I20260811 17:11:29.567469 31286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:29.559280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51330 (local address 127.4.146.195:41425)
0811 17:11:29.561983 (+ 2703us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:29.561997 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:29.562026 (+ 29us) server_negotiation.cc:407] Connection header received
0811 17:11:29.562137 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:29.562142 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:29.562389 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:29.562554 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:11:29.562846 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.563807 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.565749 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.566696 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.566815 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:29.566988 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:29.567193 (+ 205us) server_negotiation.cc:299] Negotiation successful
0811 17:11:29.567312 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2582,"thread_start_us":2474,"threads_started":1}
I20260811 17:11:29.568255 30826 ts_tablet_manager.cc:1428] T 6ff551f236fc4bc08f9522775587d3b3 P de09adfa8acb494abed24ae33281ef95: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260811 17:11:29.571556 30593 tablet_bootstrap.cc:492] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560: Bootstrap starting.
I20260811 17:11:29.572659 30593 tablet_bootstrap.cc:654] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560: Neither blocks nor log segments found. Creating new log.
I20260811 17:11:29.572537 31147 tablet_service.cc:1467] Processing CreateTablet for tablet 6ff551f236fc4bc08f9522775587d3b3 (DEFAULT_TABLE table=test-table [id=040c0666c37e4c189b4329ab559d527b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:11:29.573997 31147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ff551f236fc4bc08f9522775587d3b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:11:29.575639 30593 tablet_bootstrap.cc:492] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560: No bootstrap required, opened a new log
I20260811 17:11:29.575747 30593 ts_tablet_manager.cc:1397] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 17:11:29.576392 30593 raft_consensus.cc:348] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 } } peers { permanent_uuid: "31677abfedd14f438297f889a7191560" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 39385 } } peers { permanent_uuid: "de09adfa8acb494abed24ae33281ef95" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 39971 } }
I20260811 17:11:29.576514 30593 raft_consensus.cc:374] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:11:29.576543 30593 raft_consensus.cc:729] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31677abfedd14f438297f889a7191560, State: Initialized, Role: FOLLOWER
I20260811 17:11:29.576689 30593 consensus_queue.cc:260] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 } } peers { permanent_uuid: "31677abfedd14f438297f889a7191560" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 39385 } } peers { permanent_uuid: "de09adfa8acb494abed24ae33281ef95" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 39971 } }
I20260811 17:11:29.577008 30593 ts_tablet_manager.cc:1428] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 17:11:29.585847 31291 tablet_bootstrap.cc:492] T 6ff551f236fc4bc08f9522775587d3b3 P 3f652faaa74045a0a3e6cdec66c497b7: Bootstrap starting.
I20260811 17:11:29.589330 31291 tablet_bootstrap.cc:654] T 6ff551f236fc4bc08f9522775587d3b3 P 3f652faaa74045a0a3e6cdec66c497b7: Neither blocks nor log segments found. Creating new log.
I20260811 17:11:29.590552 31291 log.cc:824] T 6ff551f236fc4bc08f9522775587d3b3 P 3f652faaa74045a0a3e6cdec66c497b7: Log is configured to *not* fsync() on all Append() calls
I20260811 17:11:29.593658 31291 tablet_bootstrap.cc:492] T 6ff551f236fc4bc08f9522775587d3b3 P 3f652faaa74045a0a3e6cdec66c497b7: No bootstrap required, opened a new log
I20260811 17:11:29.593936 31291 ts_tablet_manager.cc:1397] T 6ff551f236fc4bc08f9522775587d3b3 P 3f652faaa74045a0a3e6cdec66c497b7: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260811 17:11:29.599313 31291 raft_consensus.cc:348] T 6ff551f236fc4bc08f9522775587d3b3 P 3f652faaa74045a0a3e6cdec66c497b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 } } peers { permanent_uuid: "31677abfedd14f438297f889a7191560" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 39385 } } peers { permanent_uuid: "de09adfa8acb494abed24ae33281ef95" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 39971 } }
I20260811 17:11:29.599745 31291 raft_consensus.cc:374] T 6ff551f236fc4bc08f9522775587d3b3 P 3f652faaa74045a0a3e6cdec66c497b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:11:29.599830 31291 raft_consensus.cc:729] T 6ff551f236fc4bc08f9522775587d3b3 P 3f652faaa74045a0a3e6cdec66c497b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f652faaa74045a0a3e6cdec66c497b7, State: Initialized, Role: FOLLOWER
I20260811 17:11:29.600468 31291 consensus_queue.cc:260] T 6ff551f236fc4bc08f9522775587d3b3 P 3f652faaa74045a0a3e6cdec66c497b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 } } peers { permanent_uuid: "31677abfedd14f438297f889a7191560" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 39385 } } peers { permanent_uuid: "de09adfa8acb494abed24ae33281ef95" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 39971 } }
I20260811 17:11:29.601373 31269 heartbeater.cc:503] Master 127.4.146.254:34867 was elected leader, sending a full tablet report...
I20260811 17:11:29.601909 31291 ts_tablet_manager.cc:1428] T 6ff551f236fc4bc08f9522775587d3b3 P 3f652faaa74045a0a3e6cdec66c497b7: Time spent starting tablet: real 0.008s user 0.005s sys 0.004s
I20260811 17:11:29.664551 30785 raft_consensus.cc:482] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:11:29.664888 30785 raft_consensus.cc:504] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 } } peers { permanent_uuid: "31677abfedd14f438297f889a7191560" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 39385 } } peers { permanent_uuid: "de09adfa8acb494abed24ae33281ef95" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 39971 } }
I20260811 17:11:29.666221 30785 leader_election.cc:288] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f652faaa74045a0a3e6cdec66c497b7 (127.4.146.195:41425), de09adfa8acb494abed24ae33281ef95 (127.4.146.194:39971)
I20260811 17:11:29.672065 31286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:29.666682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:47027 (local address 127.4.146.195:41425)
0811 17:11:29.666829 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:29.666832 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:29.666969 (+ 137us) server_negotiation.cc:407] Connection header received
0811 17:11:29.667274 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:29.667278 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:29.667335 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:29.667417 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:11:29.667738 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.668595 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.670447 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.671238 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.671408 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:29.671507 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:29.671815 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 17:11:29.671909 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 17:11:29.672081 31032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:29.667189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:33897 (local address 127.4.146.194:39971)
0811 17:11:29.667370 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:29.667377 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:29.667393 (+ 16us) server_negotiation.cc:407] Connection header received
0811 17:11:29.667573 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:29.667577 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:29.667639 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:29.667750 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:11:29.668031 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.668775 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.670447 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.671292 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.671412 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:29.671627 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:29.671815 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 17:11:29.671920 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 17:11:29.672178 31297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:29.666959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:39971 (local address 127.4.146.193:33897)
0811 17:11:29.667275 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:29.667292 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:29.667430 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:29.667784 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:29.667787 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:29.667805 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:11:29.667906 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:29.667911 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.668870 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.668873 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:29.670274 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:29.670288 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.671461 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.671465 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:29.671582 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:29.671691 (+ 109us) client_negotiation.cc:769] Sending connection context
0811 17:11:29.671782 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 17:11:29.671929 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"mutex_wait_us":173,"thread_start_us":62,"threads_started":1}
I20260811 17:11:29.672181 31294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:29.666543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:41425 (local address 127.4.146.193:47027)
0811 17:11:29.666825 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:29.666843 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:29.666984 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:29.667444 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:29.667448 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:29.667467 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:11:29.667609 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:29.667616 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.668725 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.668729 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:29.670276 (+ 1547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:29.670288 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.671435 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.671440 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:29.671594 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:29.671681 (+ 87us) client_negotiation.cc:769] Sending connection context
0811 17:11:29.671782 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 17:11:29.671966 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":123,"thread_start_us":108,"threads_started":1}
I20260811 17:11:29.673272 31182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ff551f236fc4bc08f9522775587d3b3" candidate_uuid: "31677abfedd14f438297f889a7191560" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f652faaa74045a0a3e6cdec66c497b7" is_pre_election: true
I20260811 17:11:29.673262 30935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ff551f236fc4bc08f9522775587d3b3" candidate_uuid: "31677abfedd14f438297f889a7191560" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de09adfa8acb494abed24ae33281ef95" is_pre_election: true
I20260811 17:11:29.673616 31182 raft_consensus.cc:2454] T 6ff551f236fc4bc08f9522775587d3b3 P 3f652faaa74045a0a3e6cdec66c497b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31677abfedd14f438297f889a7191560 in term 0.
I20260811 17:11:29.673605 30935 raft_consensus.cc:2454] T 6ff551f236fc4bc08f9522775587d3b3 P de09adfa8acb494abed24ae33281ef95 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31677abfedd14f438297f889a7191560 in term 0.
I20260811 17:11:29.674160 30587 leader_election.cc:302] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31677abfedd14f438297f889a7191560, 3f652faaa74045a0a3e6cdec66c497b7; no voters:
I20260811 17:11:29.674506 30785 raft_consensus.cc:2781] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:11:29.674609 30785 raft_consensus.cc:482] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:11:29.674657 30785 raft_consensus.cc:3037] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:11:29.675792 30785 raft_consensus.cc:504] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 } } peers { permanent_uuid: "31677abfedd14f438297f889a7191560" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 39385 } } peers { permanent_uuid: "de09adfa8acb494abed24ae33281ef95" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 39971 } }
I20260811 17:11:29.676215 30785 leader_election.cc:288] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560 [CANDIDATE]: Term 1 election: Requested vote from peers 3f652faaa74045a0a3e6cdec66c497b7 (127.4.146.195:41425), de09adfa8acb494abed24ae33281ef95 (127.4.146.194:39971)
I20260811 17:11:29.676752 31182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ff551f236fc4bc08f9522775587d3b3" candidate_uuid: "31677abfedd14f438297f889a7191560" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f652faaa74045a0a3e6cdec66c497b7"
I20260811 17:11:29.676805 30935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ff551f236fc4bc08f9522775587d3b3" candidate_uuid: "31677abfedd14f438297f889a7191560" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de09adfa8acb494abed24ae33281ef95"
I20260811 17:11:29.676898 31182 raft_consensus.cc:3037] T 6ff551f236fc4bc08f9522775587d3b3 P 3f652faaa74045a0a3e6cdec66c497b7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:11:29.676972 30935 raft_consensus.cc:3037] T 6ff551f236fc4bc08f9522775587d3b3 P de09adfa8acb494abed24ae33281ef95 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:11:29.678121 30935 raft_consensus.cc:2454] T 6ff551f236fc4bc08f9522775587d3b3 P de09adfa8acb494abed24ae33281ef95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31677abfedd14f438297f889a7191560 in term 1.
I20260811 17:11:29.678150 31182 raft_consensus.cc:2454] T 6ff551f236fc4bc08f9522775587d3b3 P 3f652faaa74045a0a3e6cdec66c497b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31677abfedd14f438297f889a7191560 in term 1.
I20260811 17:11:29.678475 30587 leader_election.cc:302] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31677abfedd14f438297f889a7191560, de09adfa8acb494abed24ae33281ef95; no voters:
I20260811 17:11:29.678670 30785 raft_consensus.cc:2781] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:11:29.678870 30785 raft_consensus.cc:686] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560 [term 1 LEADER]: Becoming Leader. State: Replica: 31677abfedd14f438297f889a7191560, State: Running, Role: LEADER
I20260811 17:11:29.679201 30785 consensus_queue.cc:237] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 } } peers { permanent_uuid: "31677abfedd14f438297f889a7191560" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 39385 } } peers { permanent_uuid: "de09adfa8acb494abed24ae33281ef95" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 39971 } }
I20260811 17:11:29.682909 30445 catalog_manager.cc:5495] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31677abfedd14f438297f889a7191560 (127.4.146.193). New cstate: current_term: 1 leader_uuid: "31677abfedd14f438297f889a7191560" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31677abfedd14f438297f889a7191560" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 39385 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "de09adfa8acb494abed24ae33281ef95" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 39971 } health_report { overall_health: UNKNOWN } } }
I20260811 17:11:29.715327 31306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:29.710549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48416 (local address 127.4.146.193:39385)
0811 17:11:29.710957 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:29.710966 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:29.710981 (+ 15us) server_negotiation.cc:407] Connection header received
0811 17:11:29.711073 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:29.711076 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:29.711188 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:29.711316 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:11:29.711706 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.712301 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.713277 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:29.713522 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:29.713618 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:29.714236 (+ 618us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:11:29.714775 (+ 539us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:11:29.714887 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:29.715072 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 17:11:29.715159 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":180,"threads_started":1}
I20260811 17:11:29.720299 30935 raft_consensus.cc:1261] T 6ff551f236fc4bc08f9522775587d3b3 P de09adfa8acb494abed24ae33281ef95 [term 1 FOLLOWER]: Refusing update from remote peer 31677abfedd14f438297f889a7191560: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:11:29.720348 31182 raft_consensus.cc:1261] T 6ff551f236fc4bc08f9522775587d3b3 P 3f652faaa74045a0a3e6cdec66c497b7 [term 1 FOLLOWER]: Refusing update from remote peer 31677abfedd14f438297f889a7191560: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:11:29.721312 30785 consensus_queue.cc:1035] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de09adfa8acb494abed24ae33281ef95" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 39971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:11:29.721616 31298 consensus_queue.cc:1035] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f652faaa74045a0a3e6cdec66c497b7" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 41425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:11:29.729915 31312 mvcc.cc:205] Tried to move back new op lower bound from 7317374114685980672 to 7317374114529333248. Current Snapshot: MvccSnapshot[applied={T|T < 7317374114685980672}]
I20260811 17:11:29.730266 31310 mvcc.cc:205] Tried to move back new op lower bound from 7317374114685980672 to 7317374114529333248. Current Snapshot: MvccSnapshot[applied={T|T < 7317374114685980672}]
I20260811 17:11:29.741430 30444 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:52776:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:11:29.741689 30444 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:52776:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:11:29.744370 30444 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321: Sending DeleteTablet for 3 replicas of tablet 6ff551f236fc4bc08f9522775587d3b3
I20260811 17:11:29.745242 30665 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ff551f236fc4bc08f9522775587d3b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:11:29 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:40832
I20260811 17:11:29.745680 31329 tablet_replica.cc:330] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560: stopping tablet replica
I20260811 17:11:29.745611 31147 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ff551f236fc4bc08f9522775587d3b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:11:29 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:51330
I20260811 17:11:29.745689 30898 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ff551f236fc4bc08f9522775587d3b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:11:29 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:47716
I20260811 17:11:29.745867 31035 tablet_replica.cc:330] T 6ff551f236fc4bc08f9522775587d3b3 P de09adfa8acb494abed24ae33281ef95: stopping tablet replica
I20260811 17:11:29.745986 31035 raft_consensus.cc:2229] T 6ff551f236fc4bc08f9522775587d3b3 P de09adfa8acb494abed24ae33281ef95 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:11:29.745995 31329 raft_consensus.cc:2229] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560 [term 1 LEADER]: Raft consensus shutting down.
I20260811 17:11:29.746160 31035 raft_consensus.cc:2258] T 6ff551f236fc4bc08f9522775587d3b3 P de09adfa8acb494abed24ae33281ef95 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:11:29.746165 31330 tablet_replica.cc:330] T 6ff551f236fc4bc08f9522775587d3b3 P 3f652faaa74045a0a3e6cdec66c497b7: stopping tablet replica
I20260811 17:11:29.746519 31329 raft_consensus.cc:2258] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:11:29.746537 31330 raft_consensus.cc:2229] T 6ff551f236fc4bc08f9522775587d3b3 P 3f652faaa74045a0a3e6cdec66c497b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:11:29.747215 31330 raft_consensus.cc:2258] T 6ff551f236fc4bc08f9522775587d3b3 P 3f652faaa74045a0a3e6cdec66c497b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:11:29.747232 31035 ts_tablet_manager.cc:1905] T 6ff551f236fc4bc08f9522775587d3b3 P de09adfa8acb494abed24ae33281ef95: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:11:29.747238 31329 ts_tablet_manager.cc:1905] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:11:29.749202 31330 ts_tablet_manager.cc:1905] T 6ff551f236fc4bc08f9522775587d3b3 P 3f652faaa74045a0a3e6cdec66c497b7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:11:29.750036 31035 ts_tablet_manager.cc:1918] T 6ff551f236fc4bc08f9522775587d3b3 P de09adfa8acb494abed24ae33281ef95: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:11:29.750137 31035 log.cc:1196] T 6ff551f236fc4bc08f9522775587d3b3 P de09adfa8acb494abed24ae33281ef95: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/wal/wals/6ff551f236fc4bc08f9522775587d3b3
I20260811 17:11:29.750293 31329 ts_tablet_manager.cc:1918] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:11:29.750423 31035 ts_tablet_manager.cc:1939] T 6ff551f236fc4bc08f9522775587d3b3 P de09adfa8acb494abed24ae33281ef95: Deleting consensus metadata
I20260811 17:11:29.750455 31329 log.cc:1196] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/wal/wals/6ff551f236fc4bc08f9522775587d3b3
I20260811 17:11:29.750856 31329 ts_tablet_manager.cc:1939] T 6ff551f236fc4bc08f9522775587d3b3 P 31677abfedd14f438297f889a7191560: Deleting consensus metadata
I20260811 17:11:29.751156 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 30516
I20260811 17:11:29.762163 30422 catalog_manager.cc:4841] TS de09adfa8acb494abed24ae33281ef95 (127.4.146.194:39971): tablet 6ff551f236fc4bc08f9522775587d3b3 (table test-table [id=040c0666c37e4c189b4329ab559d527b]) successfully deleted
I20260811 17:11:29.764679 31330 ts_tablet_manager.cc:1918] T 6ff551f236fc4bc08f9522775587d3b3 P 3f652faaa74045a0a3e6cdec66c497b7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:11:29.764873 31330 log.cc:1196] T 6ff551f236fc4bc08f9522775587d3b3 P 3f652faaa74045a0a3e6cdec66c497b7: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/6ff551f236fc4bc08f9522775587d3b3
I20260811 17:11:29.765228 31330 ts_tablet_manager.cc:1939] T 6ff551f236fc4bc08f9522775587d3b3 P 3f652faaa74045a0a3e6cdec66c497b7: Deleting consensus metadata
I20260811 17:11:29.766621 30422 catalog_manager.cc:4841] TS 3f652faaa74045a0a3e6cdec66c497b7 (127.4.146.195:41425): tablet 6ff551f236fc4bc08f9522775587d3b3 (table test-table [id=040c0666c37e4c189b4329ab559d527b]) successfully deleted
W20260811 17:11:29.770035 30423 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.146.193:39385 (error 108)
I20260811 17:11:29.770212 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 30777
I20260811 17:11:29.788234 30786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:29.787765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:39385 (local address 127.0.0.1:48426)
0811 17:11:29.787938 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:29.788025 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.193:39385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260811 17:11:29.788498 30423 catalog_manager.cc:4584] TS 31677abfedd14f438297f889a7191560 (127.4.146.193:39385): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6ff551f236fc4bc08f9522775587d3b3: Network error: Client connection negotiation failed: client connection to 127.4.146.193:39385: connect: Connection refused (error 111)
I20260811 17:11:29.794129 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 31030
I20260811 17:11:29.808777 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 30392
I20260811 17:11:29.832541 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:34867
--webserver_interface=127.4.146.254
--webserver_port=43375
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:34867
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:11:29.955123 31333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:29.955466 31333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:29.955513 31333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:29.959990 31333 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:11:29.960146 31333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:29.960172 31333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:29.960191 31333 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:11:29.960207 31333 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:11:29.966053 31333 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:34867
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:34867
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=43375
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31333
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:29.967254 31333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:29.968361 31333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 17:11:29.978299 31333 server_base.cc:1034] running on GCE node
W20260811 17:11:29.978240 31343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:29.978248 31347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:29.978248 31340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:29.979385 31333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:29.980872 31333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:29.982085 31333 hybrid_clock.cc:648] HybridClock initialized: now 1786468289982057 us; error 48 us; skew 500 ppm
Aug 11 17:11:29 dist-test-slave-7vjv krb5kdc[29403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468289, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:29.985453 31333 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:11:29.986590 31333 webserver.cc:460] Webserver started at http://127.4.146.254:43375/ using document root <none> and password file <none>
I20260811 17:11:29.987224 31333 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:29.987327 31333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:11:29.991708 31333 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 17:11:29.994300 31357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:29.995839 31333 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 17:11:29.996028 31333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "b06fd163bb9e4d359523e1e6945f5321"
format_stamp: "Formatted at 2026-08-11 17:11:27 on dist-test-slave-7vjv"
server_key: "5a81fd86dba2308b856e37e1e89189a5"
server_key_iv: "8885787c5bcc7d9617616553b672d606"
server_key_version: "encryptionkey@0"
I20260811 17:11:29.996771 31333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:30.008344 31333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:30.012516 31333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:30.012795 31333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:30.021965 31333 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:34867
I20260811 17:11:30.022302 31454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:34867 every 8 connection(s)
I20260811 17:11:30.023231 31333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:11:30.028348 31456 sys_catalog.cc:263] Verifying existing consensus state
I20260811 17:11:30.030484 31456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321: Bootstrap starting.
I20260811 17:11:30.031556 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 31333
I20260811 17:11:30.032198 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:39385
--local_ip_for_outbound_sockets=127.4.146.193
--tserver_master_addrs=127.4.146.254:34867
--webserver_port=41013
--webserver_interface=127.4.146.193
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 17:11:30.050242 31456 log.cc:824] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321: Log is configured to *not* fsync() on all Append() calls
I20260811 17:11:30.063912 31456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 17:11:30.064455 31456 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321: Bootstrap complete.
I20260811 17:11:30.068915 31456 raft_consensus.cc:348] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fd163bb9e4d359523e1e6945f5321" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34867 } }
I20260811 17:11:30.069428 31456 raft_consensus.cc:729] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06fd163bb9e4d359523e1e6945f5321, State: Initialized, Role: FOLLOWER
I20260811 17:11:30.069972 31456 consensus_queue.cc:260] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fd163bb9e4d359523e1e6945f5321" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34867 } }
I20260811 17:11:30.070142 31456 raft_consensus.cc:388] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:11:30.070227 31456 raft_consensus.cc:482] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:11:30.070353 31456 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [term 2 FOLLOWER]: Advancing to term 3
I20260811 17:11:30.072618 31456 raft_consensus.cc:504] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fd163bb9e4d359523e1e6945f5321" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34867 } }
I20260811 17:11:30.072994 31456 leader_election.cc:302] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b06fd163bb9e4d359523e1e6945f5321; no voters:
I20260811 17:11:30.073405 31456 leader_election.cc:288] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 17:11:30.073498 31463 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 17:11:30.073724 31463 raft_consensus.cc:686] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [term 3 LEADER]: Becoming Leader. State: Replica: b06fd163bb9e4d359523e1e6945f5321, State: Running, Role: LEADER
I20260811 17:11:30.074054 31463 consensus_queue.cc:237] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fd163bb9e4d359523e1e6945f5321" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34867 } }
I20260811 17:11:30.074795 31456 sys_catalog.cc:564] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:11:30.075124 31466 sys_catalog.cc:455] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b06fd163bb9e4d359523e1e6945f5321. Latest consensus state: current_term: 3 leader_uuid: "b06fd163bb9e4d359523e1e6945f5321" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fd163bb9e4d359523e1e6945f5321" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34867 } } }
I20260811 17:11:30.075265 31466 sys_catalog.cc:458] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [sys.catalog]: This master's current role is: LEADER
I20260811 17:11:30.075664 31464 sys_catalog.cc:455] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "b06fd163bb9e4d359523e1e6945f5321" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fd163bb9e4d359523e1e6945f5321" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34867 } } }
I20260811 17:11:30.075794 31464 sys_catalog.cc:458] T 00000000000000000000000000000000 P b06fd163bb9e4d359523e1e6945f5321 [sys.catalog]: This master's current role is: LEADER
I20260811 17:11:30.076232 31469 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:11:30.083693 31469 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:11:30.084666 31469 catalog_manager.cc:1259] Loaded cluster ID: b86e4a94001c477c9db32fee45b062a7
I20260811 17:11:30.084760 31469 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 17:11:30.086305 31469 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f9516b589ad google::LogMessage::Fail() at ??:0
@ 0x7f9516b5b88a google::LogMessage::SendToLog() at ??:0
@ 0x7f9516b584de google::LogMessage::Flush() at ??:0
@ 0x7f9516b59a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f9521497fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f9521498d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f9521495579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f95214d9640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f9518daa3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f9518daac83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f9518dac3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f9518d9b512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f951a3df6db start_thread at ??:0
@ 0x7f951565661f clone at ??:0
W20260811 17:11:30.199555 31458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:30.200011 31458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:30.200150 31458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:30.206409 31458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:30.206522 31458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:30.206617 31458 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:11:30.215525 31458 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:39385
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=41013
--tserver_master_addrs=127.4.146.254:34867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31458
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:30.217115 31458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:30.218670 31458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:30.231995 31534 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:30.232060 31530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:30.232259 31458 server_base.cc:1034] running on GCE node
W20260811 17:11:30.232007 31531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:30.233145 31458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:30.234081 31458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:30.235313 31458 hybrid_clock.cc:648] HybridClock initialized: now 1786468290235267 us; error 58 us; skew 500 ppm
Aug 11 17:11:30 dist-test-slave-7vjv krb5kdc[29403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468290, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:30.239503 31458 init.cc:377] Logged in from keytab as kudu/127.4.146.193@KRBTEST.COM (short username kudu)
I20260811 17:11:30.240936 31458 webserver.cc:460] Webserver started at http://127.4.146.193:41013/ using document root <none> and password file <none>
I20260811 17:11:30.241734 31458 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:30.241844 31458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:11:30.247543 31458 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 17:11:30.250592 31545 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:30.252451 31458 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:11:30.252604 31458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "31677abfedd14f438297f889a7191560"
format_stamp: "Formatted at 2026-08-11 17:11:27 on dist-test-slave-7vjv"
server_key: "7fed74da281e59d33ae53a06f99e4831"
server_key_iv: "b48902092c228a48daefc5a2a94487ef"
server_key_version: "encryptionkey@0"
I20260811 17:11:30.253407 31458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:30.270731 31458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:30.275537 31458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:30.275784 31458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:30.276715 31458 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:11:30.278152 31458 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:11:30.278232 31458 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:30.278301 31458 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:11:30.278342 31458 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:30.292066 31458 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:39385
I20260811 17:11:30.292152 31742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:39385 every 8 connection(s)
I20260811 17:11:30.293701 31458 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:11:30.302646 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 31458
I20260811 17:11:30.303221 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:39971
--local_ip_for_outbound_sockets=127.4.146.194
--tserver_master_addrs=127.4.146.254:34867
--webserver_port=34777
--webserver_interface=127.4.146.194
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:11:30.365046 31746 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:11:30.296486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.193:58045)
0811 17:11:30.297349 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:30.297413 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:30.298308 (+ 895us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:30.363941 (+ 65633us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":617,"thread_start_us":162,"threads_started":1}
W20260811 17:11:30.365737 31744 heartbeater.cc:644] Failed to heartbeat to 127.4.146.254:34867 (0 consecutive failures): Network error: Failed to ping master at 127.4.146.254:34867: Client connection negotiation failed: client connection to 127.4.146.254:34867: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 17:11:30.366546 31746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:30.366233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.193:49387)
0811 17:11:30.366385 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:30.366471 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260811 17:11:30.367347 31746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:30.367100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.193:60403)
0811 17:11:30.367231 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:30.367281 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260811 17:11:30.367633 31744 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 17:11:30.445963 31747 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:30.446292 31747 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:30.446341 31747 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:30.450953 31747 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:30.451061 31747 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:30.451130 31747 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:11:30.456956 31747 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:39971
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=34777
--tserver_master_addrs=127.4.146.254:34867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31747
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:30.458259 31747 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:30.459546 31747 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:30.470307 31760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:30.470433 31747 server_base.cc:1034] running on GCE node
W20260811 17:11:30.470367 31755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:30.470383 31757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:30.471108 31747 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:30.471832 31747 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:30.473028 31747 hybrid_clock.cc:648] HybridClock initialized: now 1786468290473000 us; error 40 us; skew 500 ppm
Aug 11 17:11:30 dist-test-slave-7vjv krb5kdc[29403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468290, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:30.476048 31747 init.cc:377] Logged in from keytab as kudu/127.4.146.194@KRBTEST.COM (short username kudu)
I20260811 17:11:30.477030 31747 webserver.cc:460] Webserver started at http://127.4.146.194:34777/ using document root <none> and password file <none>
I20260811 17:11:30.477581 31747 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:30.477649 31747 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:11:30.481855 31747 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 17:11:30.484393 31774 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:30.485949 31747 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:11:30.486081 31747 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "de09adfa8acb494abed24ae33281ef95"
format_stamp: "Formatted at 2026-08-11 17:11:27 on dist-test-slave-7vjv"
server_key: "aa15c91eda6b215a2b890368c23906cf"
server_key_iv: "28cbea4fd61cf347e8a94bdf38b5f531"
server_key_version: "encryptionkey@0"
I20260811 17:11:30.486773 31747 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:30.509446 31747 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:30.513309 31747 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:30.513554 31747 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:30.514266 31747 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:11:30.515232 31747 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:11:30.515282 31747 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:30.515352 31747 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:11:30.515385 31747 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:30.525714 31747 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:39971
I20260811 17:11:30.525739 31994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:39971 every 8 connection(s)
I20260811 17:11:30.526904 31747 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:11:30.531100 32001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:30.529353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.194:47617)
0811 17:11:30.530117 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:30.530238 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":141,"threads_started":1}
W20260811 17:11:30.531644 31997 heartbeater.cc:644] Failed to heartbeat to 127.4.146.254:34867 (0 consecutive failures): Network error: Failed to ping master at 127.4.146.254:34867: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
I20260811 17:11:30.532397 32001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:30.532171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.194:34625)
0811 17:11:30.532287 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:30.532338 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 17:11:30.533167 32001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:30.532817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.194:52431)
0811 17:11:30.532995 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:30.533085 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260811 17:11:30.533259 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 31747
W20260811 17:11:30.533430 31997 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 17:11:30.533790 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:41425
--local_ip_for_outbound_sockets=127.4.146.195
--tserver_master_addrs=127.4.146.254:34867
--webserver_port=41907
--webserver_interface=127.4.146.195
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45521
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:11:30.658560 32002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:30.658923 32002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:30.659021 32002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:30.663421 32002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:30.663501 32002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:30.663566 32002 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:11:30.669422 32002 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45521
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:41425
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=41907
--tserver_master_addrs=127.4.146.254:34867
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32002
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:30.670673 32002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:30.671841 32002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:30.683002 32008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:30.683171 32011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:30.683082 32009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:30.683571 32002 server_base.cc:1034] running on GCE node
I20260811 17:11:30.684173 32002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:30.684975 32002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:30.686173 32002 hybrid_clock.cc:648] HybridClock initialized: now 1786468290686131 us; error 57 us; skew 500 ppm
Aug 11 17:11:30 dist-test-slave-7vjv krb5kdc[29403](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468290, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:30.693542 32002 init.cc:377] Logged in from keytab as kudu/127.4.146.195@KRBTEST.COM (short username kudu)
I20260811 17:11:30.694857 32002 webserver.cc:460] Webserver started at http://127.4.146.195:41907/ using document root <none> and password file <none>
I20260811 17:11:30.695509 32002 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:30.695611 32002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:11:30.699939 32002 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:11:30.702571 32021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:30.704206 32002 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:11:30.704365 32002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "3f652faaa74045a0a3e6cdec66c497b7"
format_stamp: "Formatted at 2026-08-11 17:11:28 on dist-test-slave-7vjv"
server_key: "d628f94c18cb4e69bc4a90e14d527df3"
server_key_iv: "f60e4d23babd531758447d66f4f5d763"
server_key_version: "encryptionkey@0"
I20260811 17:11:30.705005 32002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:30.747480 32002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:30.751483 32002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:30.751755 32002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:30.752492 32002 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:11:30.753466 32002 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:11:30.753545 32002 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:30.753628 32002 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:11:30.753679 32002 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:30.764209 32002 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:41425
I20260811 17:11:30.764268 32214 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:41425 every 8 connection(s)
I20260811 17:11:30.765362 32002 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:11:30.769559 32221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:30.767800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.195:57311)
0811 17:11:30.768627 (+ 827us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:30.768749 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":128,"threads_started":1}
W20260811 17:11:30.770077 32217 heartbeater.cc:644] Failed to heartbeat to 127.4.146.254:34867 (0 consecutive failures): Network error: Failed to ping master at 127.4.146.254:34867: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
I20260811 17:11:30.770797 32221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:30.770519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.195:38423)
0811 17:11:30.770668 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:30.770729 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 17:11:30.771559 32221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:30.771261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.195:43491)
0811 17:11:30.771406 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:30.771459 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 17:11:30.771771 32217 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 17:11:30.774428 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 32002
I20260811 17:11:31.369724 32223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:31.369096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.193:38341)
0811 17:11:31.369476 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:31.369554 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":95,"threads_started":1}
I20260811 17:11:31.534715 32224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:31.534188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.194:42845)
0811 17:11:31.534475 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:31.534562 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":79,"threads_started":1}
I20260811 17:11:31.773098 32225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:31.772623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.195:58921)
0811 17:11:31.772902 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:31.772969 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":82,"threads_started":1}
I20260811 17:11:32.371845 32227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:32.370927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.193:55451)
0811 17:11:32.371509 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:32.371684 (+ 175us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":144,"threads_started":1}
I20260811 17:11:32.536793 32228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:32.536006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.194:60499)
0811 17:11:32.536546 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:32.536633 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":225,"threads_started":1}
I20260811 17:11:32.775508 32229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:32.774641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.195:37267)
0811 17:11:32.775249 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:32.775337 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":205,"threads_started":1}
I20260811 17:11:33.374082 32231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:33.373314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.193:43643)
0811 17:11:33.373827 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:33.373905 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":106,"threads_started":1}
I20260811 17:11:33.538681 32233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:33.538057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.194:53475)
0811 17:11:33.538437 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:33.538549 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":95,"threads_started":1}
I20260811 17:11:33.777272 32234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:33.776631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.195:47387)
0811 17:11:33.777014 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:33.777085 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":125,"threads_started":1}
I20260811 17:11:34.376044 32236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:34.375521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.193:50683)
0811 17:11:34.375830 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:34.375893 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":112,"threads_started":1}
I20260811 17:11:34.540472 32237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:34.539927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.194:51527)
0811 17:11:34.540294 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:34.540364 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":88,"threads_started":1}
I20260811 17:11:34.779073 32238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:34.778509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.195:32937)
0811 17:11:34.778891 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:34.778968 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":110,"threads_started":1}
I20260811 17:11:35.377496 32240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:35.376995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.193:51783)
0811 17:11:35.377329 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:35.377392 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":251,"thread_start_us":88,"threads_started":1}
I20260811 17:11:35.542004 32241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:35.541510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.194:54835)
0811 17:11:35.541828 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:35.541897 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":95,"threads_started":1}
I20260811 17:11:35.780648 32242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:35.780137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.195:44333)
0811 17:11:35.780465 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:35.780536 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":105,"threads_started":1}
I20260811 17:11:36.378981 32244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:36.378496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.193:59215)
0811 17:11:36.378798 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:36.378866 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":93,"threads_started":1}
I20260811 17:11:36.543443 32245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:36.542959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.194:45889)
0811 17:11:36.543271 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:36.543338 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":116,"threads_started":1}
I20260811 17:11:36.782109 32247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:36.781623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.195:35053)
0811 17:11:36.781928 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:36.781992 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":93,"threads_started":1}
I20260811 17:11:37.380735 32252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:37.380162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.193:55019)
0811 17:11:37.380564 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:37.380629 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":103,"threads_started":1}
I20260811 17:11:37.544981 32253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:37.544398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.194:38231)
0811 17:11:37.544768 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:37.544853 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":93,"threads_started":1}
I20260811 17:11:37.783560 32254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:37.782988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.195:42701)
0811 17:11:37.783398 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:37.783459 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":93,"threads_started":1}
I20260811 17:11:38.382097 32255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:38.381565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.193:37727)
0811 17:11:38.381889 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:38.381956 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":82,"threads_started":1}
I20260811 17:11:38.546595 32257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:38.545992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.194:40597)
0811 17:11:38.546376 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:38.546432 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":122,"threads_started":1}
I20260811 17:11:38.785135 32258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:38.784638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.195:46603)
0811 17:11:38.784926 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:38.785001 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":86,"threads_started":1}
I20260811 17:11:39.383821 32259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:39.383191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.193:45969)
0811 17:11:39.383597 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:39.383685 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":88,"threads_started":1}
I20260811 17:11:39.548159 32260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:39.547490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.194:45673)
0811 17:11:39.547883 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:39.547968 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":140,"threads_started":1}
I20260811 17:11:39.786772 32261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:39.786178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.195:45737)
0811 17:11:39.786508 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:39.786633 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":99,"threads_started":1}
I20260811 17:11:40.385324 32262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:40.384780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.193:53281)
0811 17:11:40.385125 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:40.385212 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":96,"threads_started":1}
I20260811 17:11:40.549618 32268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:40.549122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.194:46723)
0811 17:11:40.549426 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:40.549491 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":85,"threads_started":1}
I20260811 17:11:40.788693 32270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:40.787853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.195:60855)
0811 17:11:40.788507 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:40.788588 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":82,"threads_started":1}
I20260811 17:11:41.387020 32273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:41.386512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.193:54815)
0811 17:11:41.386841 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:41.386914 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":85,"threads_started":1}
I20260811 17:11:41.551318 32274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:41.550718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.194:34293)
0811 17:11:41.551127 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:41.551206 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":109,"threads_started":1}
I20260811 17:11:41.790102 32275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:41.789608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.195:48239)
0811 17:11:41.789923 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:41.789990 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":90,"threads_started":1}
I20260811 17:11:42.388762 32279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:42.388133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.193:53039)
0811 17:11:42.388546 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:42.388629 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":98,"threads_started":1}
I20260811 17:11:42.552819 32282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:42.552306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.194:54731)
0811 17:11:42.552627 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:42.552706 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":89,"threads_started":1}
I20260811 17:11:42.791563 32283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:42.791060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.195:48569)
0811 17:11:42.791391 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:42.791453 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":132,"threads_started":1}
I20260811 17:11:43.390255 32286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:43.389711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.193:41847)
0811 17:11:43.390064 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:43.390147 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":86,"threads_started":1}
I20260811 17:11:43.554672 32287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:43.553981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.194:55557)
0811 17:11:43.554380 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:43.554462 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":104,"threads_started":1}
I20260811 17:11:43.793387 32292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:43.792674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.195:51823)
0811 17:11:43.793182 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:43.793266 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":225,"threads_started":1}
I20260811 17:11:44.391842 32293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:44.391284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.193:56755)
0811 17:11:44.391666 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:44.391736 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":182,"threads_started":1}
I20260811 17:11:44.556521 32294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:44.555919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.194:54841)
0811 17:11:44.556312 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:44.556373 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":167,"threads_started":1}
I20260811 17:11:44.794849 32295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:44.794349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.195:47893)
0811 17:11:44.794675 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:44.794743 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":106,"threads_started":1}
I20260811 17:11:45.393472 32302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:45.392981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.193:39511)
0811 17:11:45.393300 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:45.393368 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":100,"threads_started":1}
I20260811 17:11:45.558097 32303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:45.557590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.194:46547)
0811 17:11:45.557894 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:45.557963 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":104,"threads_started":1}
I20260811 17:11:45.780335 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 31458
I20260811 17:11:45.796584 32304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:45.796079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34867 (local address 127.4.146.195:57637)
0811 17:11:45.796415 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:45.796483 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:34867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":91,"threads_started":1}
I20260811 17:11:45.798448 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 31747
I20260811 17:11:45.820261 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 32002
2026-08-11T17:11:45Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (20128 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:11:45 dist-test-slave-7vjv krb5kdc[32310](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:11:45 dist-test-slave-7vjv krb5kdc[32310](info): set up 2 sockets
Aug 11 17:11:45 dist-test-slave-7vjv krb5kdc[32310](info): commencing operation
krb5kdc: starting...
W20260811 17:11:47.216009 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.353s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:11:47 dist-test-slave-7vjv krb5kdc[32310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468307, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:11:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:11:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:11:47.369635 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:40985
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:40985
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:11:47.500393 32338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:47.500728 32338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:47.500772 32338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:47.505088 32338 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 17:11:47.505172 32338 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 17:11:47.505188 32338 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 17:11:47.505203 32338 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:11:47.505223 32338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:47.505240 32338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:47.505256 32338 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:11:47.505311 32338 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:11:47.510959 32338 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:40985
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:40985
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32338
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:47.512439 32338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:47.513620 32338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:47.523808 32348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:47.523811 32350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:47.524040 32338 server_base.cc:1034] running on GCE node
W20260811 17:11:47.523808 32354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:47.525250 32338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:47.526578 32338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:47.527758 32338 hybrid_clock.cc:648] HybridClock initialized: now 1786468307527686 us; error 97 us; skew 500 ppm
Aug 11 17:11:47 dist-test-slave-7vjv krb5kdc[32310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468307, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:47.531082 32338 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:11:47.532210 32338 webserver.cc:460] Webserver started at http://127.4.146.254:34763/ using document root <none> and password file <none>
I20260811 17:11:47.532887 32338 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:47.532992 32338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:11:47.533260 32338 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:11:47.535701 32338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "cf33be911cfb49fb834a6bc618ccf62c"
format_stamp: "Formatted at 2026-08-11 17:11:47 on dist-test-slave-7vjv"
server_key: "1a6e986481a2c4fb90181d6c64ead87a"
server_key_iv: "1960b77ee957da7e337c14312fdb6e3e"
server_key_version: "encryptionkey@0"
I20260811 17:11:47.536377 32338 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "cf33be911cfb49fb834a6bc618ccf62c"
format_stamp: "Formatted at 2026-08-11 17:11:47 on dist-test-slave-7vjv"
server_key: "1a6e986481a2c4fb90181d6c64ead87a"
server_key_iv: "1960b77ee957da7e337c14312fdb6e3e"
server_key_version: "encryptionkey@0"
I20260811 17:11:47.540900 32338 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 17:11:47.544291 32366 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:47.545807 32338 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 17:11:47.546036 32338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "cf33be911cfb49fb834a6bc618ccf62c"
format_stamp: "Formatted at 2026-08-11 17:11:47 on dist-test-slave-7vjv"
server_key: "1a6e986481a2c4fb90181d6c64ead87a"
server_key_iv: "1960b77ee957da7e337c14312fdb6e3e"
server_key_version: "encryptionkey@0"
I20260811 17:11:47.546188 32338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:47.561322 32338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:47.565091 32338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:47.565338 32338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:47.573424 32338 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:40985
I20260811 17:11:47.573781 32465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:40985 every 8 connection(s)
I20260811 17:11:47.574572 32338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:11:47.577890 32468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:11:47.578991 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 32338
I20260811 17:11:47.579126 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:11:47.579486 4683 external_mini_cluster.cc:1428] Setting key 3044b24eab88eed1ba3237464ec0f250
I20260811 17:11:47.585750 32468 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c: Bootstrap starting.
I20260811 17:11:47.588622 32468 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c: Neither blocks nor log segments found. Creating new log.
I20260811 17:11:47.589452 32468 log.cc:824] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c: Log is configured to *not* fsync() on all Append() calls
Aug 11 17:11:47 dist-test-slave-7vjv krb5kdc[32310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468307, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:11:47.591956 32468 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c: No bootstrap required, opened a new log
I20260811 17:11:47.595762 32471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:47.581092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49804 (local address 127.4.146.254:40985)
0811 17:11:47.581591 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:47.581612 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:47.581659 (+ 47us) server_negotiation.cc:407] Connection header received
0811 17:11:47.582508 (+ 849us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:47.582535 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:47.583014 (+ 479us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:47.583410 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:47.584260 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:47.585773 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:47.586791 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:47.587503 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:47.587675 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:47.590637 (+ 2962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:47.590643 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:47.590658 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:47.590688 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:47.592674 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:47.593186 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:47.593192 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:47.593197 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:47.593318 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:47.593627 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:47.593630 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:47.593632 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:47.594073 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:47.594290 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:47.594612 (+ 322us) server_negotiation.cc:299] Negotiation successful
0811 17:11:47.594971 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":122,"threads_started":1}
I20260811 17:11:47.595753 32468 raft_consensus.cc:348] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf33be911cfb49fb834a6bc618ccf62c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40985 } }
I20260811 17:11:47.596139 32468 raft_consensus.cc:374] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:11:47.596225 32468 raft_consensus.cc:729] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33be911cfb49fb834a6bc618ccf62c, State: Initialized, Role: FOLLOWER
I20260811 17:11:47.596690 32468 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf33be911cfb49fb834a6bc618ccf62c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40985 } }
I20260811 17:11:47.596863 32468 raft_consensus.cc:388] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:11:47.596962 32468 raft_consensus.cc:482] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:11:47.597074 32468 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:11:47.598085 32468 raft_consensus.cc:504] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf33be911cfb49fb834a6bc618ccf62c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40985 } }
I20260811 17:11:47.598479 32468 leader_election.cc:302] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cf33be911cfb49fb834a6bc618ccf62c; no voters:
I20260811 17:11:47.598842 32468 leader_election.cc:288] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:11:47.598994 32476 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:11:47.599268 32476 raft_consensus.cc:686] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [term 1 LEADER]: Becoming Leader. State: Replica: cf33be911cfb49fb834a6bc618ccf62c, State: Running, Role: LEADER
I20260811 17:11:47.599709 32476 consensus_queue.cc:237] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf33be911cfb49fb834a6bc618ccf62c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40985 } }
I20260811 17:11:47.600203 32468 sys_catalog.cc:564] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:11:47.601608 32477 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cf33be911cfb49fb834a6bc618ccf62c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf33be911cfb49fb834a6bc618ccf62c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40985 } } }
I20260811 17:11:47.601735 32477 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [sys.catalog]: This master's current role is: LEADER
I20260811 17:11:47.602097 32478 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf33be911cfb49fb834a6bc618ccf62c. Latest consensus state: current_term: 1 leader_uuid: "cf33be911cfb49fb834a6bc618ccf62c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf33be911cfb49fb834a6bc618ccf62c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40985 } } }
I20260811 17:11:47.602193 32478 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [sys.catalog]: This master's current role is: LEADER
I20260811 17:11:47.602818 32490 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:11:47.606288 32490 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:11:47.613408 32490 catalog_manager.cc:1347] Generated new cluster ID: ffcb8416fea24c4aaef0d59b3373a2dc
I20260811 17:11:47.613538 32490 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:11:47.628206 32490 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:11:47.629395 32490 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:11:47.636399 32490 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c: Generated new TSK 0
I20260811 17:11:47.637306 32490 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
I20260811 17:11:47.672227 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:40985
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:11:47.797844 32512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:47.798177 32512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:47.798223 32512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:47.802758 32512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:47.802846 32512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:47.802910 32512 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:11:47.808635 32512 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:40985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32512
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:47.809892 32512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:47.811015 32512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:47.822324 32520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:47.822477 32521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:47.822330 32526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:47.822721 32512 server_base.cc:1034] running on GCE node
I20260811 17:11:47.823534 32512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:47.824568 32512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:47.825834 32512 hybrid_clock.cc:648] HybridClock initialized: now 1786468307825791 us; error 61 us; skew 500 ppm
Aug 11 17:11:47 dist-test-slave-7vjv krb5kdc[32310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468307, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:47.829334 32512 init.cc:377] Logged in from keytab as kudu/127.4.146.193@KRBTEST.COM (short username kudu)
I20260811 17:11:47.830389 32512 webserver.cc:460] Webserver started at http://127.4.146.193:36519/ using document root <none> and password file <none>
I20260811 17:11:47.831038 32512 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:47.831141 32512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:11:47.831403 32512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:11:47.833779 32512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "d095952ff2e14f209629059f866ef8a9"
format_stamp: "Formatted at 2026-08-11 17:11:47 on dist-test-slave-7vjv"
server_key: "72ebaae51a7c21c4198e168d99e96751"
server_key_iv: "6dcbb9dca2de8c1c31707b6ae3169917"
server_key_version: "encryptionkey@0"
I20260811 17:11:47.834430 32512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "d095952ff2e14f209629059f866ef8a9"
format_stamp: "Formatted at 2026-08-11 17:11:47 on dist-test-slave-7vjv"
server_key: "72ebaae51a7c21c4198e168d99e96751"
server_key_iv: "6dcbb9dca2de8c1c31707b6ae3169917"
server_key_version: "encryptionkey@0"
I20260811 17:11:47.838791 32512 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 17:11:47.841650 32539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:47.843156 32512 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 17:11:47.843343 32512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "d095952ff2e14f209629059f866ef8a9"
format_stamp: "Formatted at 2026-08-11 17:11:47 on dist-test-slave-7vjv"
server_key: "72ebaae51a7c21c4198e168d99e96751"
server_key_iv: "6dcbb9dca2de8c1c31707b6ae3169917"
server_key_version: "encryptionkey@0"
I20260811 17:11:47.843502 32512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:47.869395 32512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:47.873243 32512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:47.873478 32512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:47.874183 32512 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:11:47.875134 32512 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:11:47.875207 32512 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:47.875280 32512 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:11:47.875325 32512 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:47.886013 32512 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:32977
I20260811 17:11:47.886072 32743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:32977 every 8 connection(s)
I20260811 17:11:47.887015 32512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:11:47.891698 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 32512
I20260811 17:11:47.891878 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
I20260811 17:11:47.892535 4683 external_mini_cluster.cc:1428] Setting key 58c180cf30560bee33a43ca7b3c34d7b
Aug 11 17:11:47 dist-test-slave-7vjv krb5kdc[32310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468307, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.146.194@KRBTEST.COM; defaulting to no policy
I20260811 17:11:47.906369 32471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:47.889258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:54221 (local address 127.4.146.254:40985)
0811 17:11:47.889450 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:47.889455 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:47.890480 (+ 1025us) server_negotiation.cc:407] Connection header received
0811 17:11:47.892577 (+ 2097us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:47.892581 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:47.892688 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:47.892794 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:47.894709 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:47.895336 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:47.897716 (+ 2380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:47.897976 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:47.898107 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:47.901692 (+ 3585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:47.901695 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:47.901698 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:47.901730 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:47.903634 (+ 1904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:47.904441 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:47.904453 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:47.904455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:47.904556 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:47.904996 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:47.904999 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:47.905001 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:47.905257 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:47.905382 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:47.906011 (+ 629us) server_negotiation.cc:299] Negotiation successful
0811 17:11:47.906177 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 17:11:47.907481 32747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:47.889655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.193:54221)
0811 17:11:47.890289 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:47.890341 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:47.892041 (+ 1700us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:47.893094 (+ 1053us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:47.893105 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:47.893780 (+ 675us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:47.894485 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:47.894514 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:47.895518 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:47.895525 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:47.897522 (+ 1997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:47.897545 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:47.898168 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:47.898172 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:47.898383 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:47.899110 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:47.899130 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:47.901441 (+ 2311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:47.903811 (+ 2370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:47.903819 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:47.903846 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:47.904289 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:47.904681 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:47.904685 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:47.904687 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:47.904872 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:47.905397 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:47.905408 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:47.905718 (+ 310us) client_negotiation.cc:769] Sending connection context
0811 17:11:47.905944 (+ 226us) client_negotiation.cc:240] Negotiation successful
0811 17:11:47.906424 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":141,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.194@KRBTEST.COM" created.
I20260811 17:11:47.909261 32744 heartbeater.cc:347] Connected to a master server at 127.4.146.254:40985
I20260811 17:11:47.909582 32744 heartbeater.cc:464] Registering TS with master...
I20260811 17:11:47.910218 32744 heartbeater.cc:511] Master 127.4.146.254:40985 requested a full tablet report, sending...
I20260811 17:11:47.912333 32399 ts_manager.cc:194] Registered new tserver with Master: d095952ff2e14f209629059f866ef8a9 (127.4.146.193:32977)
I20260811 17:11:47.914201 32399 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.193@KRBTEST.COM'} at 127.4.146.193:54221
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
I20260811 17:11:47.932722 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:40985
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:11:48.059695 32756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:48.060075 32756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:48.060207 32756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:48.064548 32756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:48.064656 32756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:48.064755 32756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:11:48.070369 32756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:40985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:48.071686 32756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:48.073062 32756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:48.083901 32766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:48.083969 32756 server_base.cc:1034] running on GCE node
W20260811 17:11:48.084244 303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:48.083894 32765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:48.085104 32756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:48.085798 32756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:48.087030 32756 hybrid_clock.cc:648] HybridClock initialized: now 1786468308086991 us; error 53 us; skew 500 ppm
Aug 11 17:11:48 dist-test-slave-7vjv krb5kdc[32310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468308, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:48.090845 32756 init.cc:377] Logged in from keytab as kudu/127.4.146.194@KRBTEST.COM (short username kudu)
I20260811 17:11:48.092052 32756 webserver.cc:460] Webserver started at http://127.4.146.194:39093/ using document root <none> and password file <none>
I20260811 17:11:48.092803 32756 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:48.092916 32756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:11:48.093194 32756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:11:48.095623 32756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "5bf5756645814013af53d03500d8c725"
format_stamp: "Formatted at 2026-08-11 17:11:48 on dist-test-slave-7vjv"
server_key: "62ec46be4a9b222486c37d8d2247f46e"
server_key_iv: "23252806c2ffd08f105ac7f1bdddef35"
server_key_version: "encryptionkey@0"
I20260811 17:11:48.096376 32756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "5bf5756645814013af53d03500d8c725"
format_stamp: "Formatted at 2026-08-11 17:11:48 on dist-test-slave-7vjv"
server_key: "62ec46be4a9b222486c37d8d2247f46e"
server_key_iv: "23252806c2ffd08f105ac7f1bdddef35"
server_key_version: "encryptionkey@0"
I20260811 17:11:48.101157 32756 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 17:11:48.104383 321 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:48.105813 32756 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:11:48.105991 32756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "5bf5756645814013af53d03500d8c725"
format_stamp: "Formatted at 2026-08-11 17:11:48 on dist-test-slave-7vjv"
server_key: "62ec46be4a9b222486c37d8d2247f46e"
server_key_iv: "23252806c2ffd08f105ac7f1bdddef35"
server_key_version: "encryptionkey@0"
I20260811 17:11:48.106138 32756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:48.127300 32756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:48.131186 32756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:48.131426 32756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:48.132169 32756 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:11:48.133111 32756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:11:48.133185 32756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:48.133256 32756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:11:48.133308 32756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:48.144750 32756 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:42699
I20260811 17:11:48.144780 526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:42699 every 8 connection(s)
I20260811 17:11:48.145742 32756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:11:48.152197 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 32756
I20260811 17:11:48.152360 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:11:48.152676 4683 external_mini_cluster.cc:1428] Setting key 48c66c9460b1080eace957a7086dde44
Aug 11 17:11:48 dist-test-slave-7vjv krb5kdc[32310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468308, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:11:48.163908 32471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:48.147900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:57919 (local address 127.4.146.254:40985)
0811 17:11:48.148078 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:48.148083 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:48.149302 (+ 1219us) server_negotiation.cc:407] Connection header received
0811 17:11:48.150999 (+ 1697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:48.151003 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:48.151076 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:48.151190 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:48.153043 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.153778 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.155500 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.155757 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.155856 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:48.158965 (+ 3109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:48.158972 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:48.158979 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:48.159018 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:48.161103 (+ 2085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:48.161900 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:48.161903 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:48.161904 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:48.161990 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:48.162480 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:48.162483 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:48.162484 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:48.162752 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:48.162835 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:48.163621 (+ 786us) server_negotiation.cc:299] Negotiation successful
0811 17:11:48.163772 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 17:11:48.165294 535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:48.148361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.194:57919)
0811 17:11:48.149106 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:48.149169 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:48.150700 (+ 1531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:48.151406 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:48.151415 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:48.151933 (+ 518us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:48.152810 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:48.152836 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.153974 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.153977 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:48.155341 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:48.155358 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.155943 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.155949 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:48.156239 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:48.157080 (+ 841us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:48.157110 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:48.158757 (+ 1647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:48.161278 (+ 2521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:48.161290 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:48.161316 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:48.161773 (+ 457us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:48.162106 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:48.162111 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:48.162114 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:48.162359 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:48.162876 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:48.162887 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:48.163338 (+ 451us) client_negotiation.cc:769] Sending connection context
0811 17:11:48.163571 (+ 233us) client_negotiation.cc:240] Negotiation successful
0811 17:11:48.164001 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":160,"threads_started":1}
WARNING: no policy specified for kudu/127.4.146.195@KRBTEST.COM; defaulting to no policy
I20260811 17:11:48.166815 528 heartbeater.cc:347] Connected to a master server at 127.4.146.254:40985
I20260811 17:11:48.167152 528 heartbeater.cc:464] Registering TS with master...
I20260811 17:11:48.167730 528 heartbeater.cc:511] Master 127.4.146.254:40985 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.195@KRBTEST.COM" created.
I20260811 17:11:48.169121 32399 ts_manager.cc:194] Registered new tserver with Master: 5bf5756645814013af53d03500d8c725 (127.4.146.194:42699)
I20260811 17:11:48.169966 32399 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.194@KRBTEST.COM'} at 127.4.146.194:57919
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
I20260811 17:11:48.188323 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:40985
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:11:48.340730 544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:11:48.341250 544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:11:48.341356 544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:11:48.348308 544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:11:48.348430 544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:11:48.348539 544 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:11:48.355106 544 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:40985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:11:48.356768 544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:11:48.358060 544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:11:48.369390 556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:48.369385 557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:11:48.369381 561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:11:48.369541 544 server_base.cc:1034] running on GCE node
I20260811 17:11:48.370235 544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:11:48.370960 544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:11:48.372191 544 hybrid_clock.cc:648] HybridClock initialized: now 1786468308372166 us; error 39 us; skew 500 ppm
Aug 11 17:11:48 dist-test-slave-7vjv krb5kdc[32310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468308, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:11:48.375478 544 init.cc:377] Logged in from keytab as kudu/127.4.146.195@KRBTEST.COM (short username kudu)
I20260811 17:11:48.376623 544 webserver.cc:460] Webserver started at http://127.4.146.195:44545/ using document root <none> and password file <none>
I20260811 17:11:48.377281 544 fs_manager.cc:359] Metadata directory not provided
I20260811 17:11:48.377388 544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:11:48.377665 544 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:11:48.380177 544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "ce5fbef16130442fbf4dcd603d52d041"
format_stamp: "Formatted at 2026-08-11 17:11:48 on dist-test-slave-7vjv"
server_key: "7697cfa7ccda754bedcc6d6056506e8c"
server_key_iv: "78b3fe0b88cb9869ccf38bf6defc15e6"
server_key_version: "encryptionkey@0"
I20260811 17:11:48.380935 544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "ce5fbef16130442fbf4dcd603d52d041"
format_stamp: "Formatted at 2026-08-11 17:11:48 on dist-test-slave-7vjv"
server_key: "7697cfa7ccda754bedcc6d6056506e8c"
server_key_iv: "78b3fe0b88cb9869ccf38bf6defc15e6"
server_key_version: "encryptionkey@0"
I20260811 17:11:48.385607 544 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260811 17:11:48.388746 574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:48.390301 544 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 17:11:48.390480 544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "ce5fbef16130442fbf4dcd603d52d041"
format_stamp: "Formatted at 2026-08-11 17:11:48 on dist-test-slave-7vjv"
server_key: "7697cfa7ccda754bedcc6d6056506e8c"
server_key_iv: "78b3fe0b88cb9869ccf38bf6defc15e6"
server_key_version: "encryptionkey@0"
I20260811 17:11:48.390632 544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:11:48.444492 544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:11:48.448523 544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:11:48.448776 544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:11:48.449476 544 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:11:48.450527 544 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:11:48.450608 544 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:48.450693 544 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:11:48.450765 544 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:11:48.462910 544 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:35515
I20260811 17:11:48.462929 788 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:35515 every 8 connection(s)
I20260811 17:11:48.463933 544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:11:48.469290 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 544
I20260811 17:11:48.469470 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:11:48.469775 4683 external_mini_cluster.cc:1428] Setting key 5cbde58de6f05f61c7e6474a7c7a44a6
Aug 11 17:11:48 dist-test-slave-7vjv krb5kdc[32310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468308, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:11:48.479876 32471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:48.466035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:57825 (local address 127.4.146.254:40985)
0811 17:11:48.466205 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:48.466210 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:48.467090 (+ 880us) server_negotiation.cc:407] Connection header received
0811 17:11:48.468736 (+ 1646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:48.468740 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:48.468808 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:48.468924 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:48.470521 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.471312 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.472688 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.472912 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.472999 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:48.475793 (+ 2794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:48.475796 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:48.475798 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:48.475826 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:48.477500 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:48.478128 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:48.478134 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:48.478136 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:48.478232 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:48.478635 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:48.478638 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:48.478640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:48.478850 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:48.478963 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:48.479546 (+ 583us) server_negotiation.cc:299] Negotiation successful
0811 17:11:48.479704 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 17:11:48.480847 792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:48.466343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.195:57825)
0811 17:11:48.466883 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:48.466934 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:48.468469 (+ 1535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:48.469142 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:48.469150 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:48.469686 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:11:48.470321 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:48.470343 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.471494 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.471497 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:48.472559 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:48.472569 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.473053 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.473056 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:48.473249 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:48.473913 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:11:48.473930 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:11:48.475581 (+ 1651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:11:48.477648 (+ 2067us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:48.477656 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:48.477677 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:48.478005 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:48.478339 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:11:48.478342 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:11:48.478344 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:11:48.478521 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:11:48.478980 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:11:48.478989 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:11:48.479290 (+ 301us) client_negotiation.cc:769] Sending connection context
0811 17:11:48.479503 (+ 213us) client_negotiation.cc:240] Negotiation successful
0811 17:11:48.479892 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":142,"threads_started":1}
I20260811 17:11:48.482160 790 heartbeater.cc:347] Connected to a master server at 127.4.146.254:40985
I20260811 17:11:48.482419 790 heartbeater.cc:464] Registering TS with master...
I20260811 17:11:48.482978 790 heartbeater.cc:511] Master 127.4.146.254:40985 requested a full tablet report, sending...
I20260811 17:11:48.484161 32397 ts_manager.cc:194] Registered new tserver with Master: ce5fbef16130442fbf4dcd603d52d041 (127.4.146.195:35515)
I20260811 17:11:48.484797 32397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.195@KRBTEST.COM'} at 127.4.146.195:57825
I20260811 17:11:48.496734 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 17:11:48.507752 32471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:48.499109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49806 (local address 127.4.146.254:40985)
0811 17:11:48.499345 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:48.499351 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:48.499620 (+ 269us) server_negotiation.cc:407] Connection header received
0811 17:11:48.499864 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:48.499867 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:48.499913 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:48.500007 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:11:48.500936 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.501480 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.502475 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.502714 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.502832 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:48.504456 (+ 1624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:11:48.504459 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:11:48.504461 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:11:48.504489 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:11:48.505888 (+ 1399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:48.506363 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:48.506366 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:48.506370 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:48.506461 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:11:48.506764 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:11:48.506767 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:11:48.506769 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:11:48.507027 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:11:48.507193 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:48.507446 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 17:11:48.507575 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260811 17:11:48.511667 32397 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49806:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 17:11:48.515095 32397 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:11:48.531644 812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:48.525820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50304 (local address 127.4.146.194:42699)
0811 17:11:48.526334 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:48.526347 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:48.526814 (+ 467us) server_negotiation.cc:407] Connection header received
0811 17:11:48.526894 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:48.526899 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:48.527074 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:48.527244 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:11:48.527732 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.528851 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.530279 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.530847 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.530982 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:48.531154 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:48.531346 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 17:11:48.531451 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":128,"threads_started":1}
I20260811 17:11:48.531628 808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:48.524980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:42699 (local address 127.0.0.1:50304)
0811 17:11:48.526543 (+ 1563us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:48.526559 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:48.526687 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:48.527434 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:48.527438 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:48.527458 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:11:48.527583 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:48.527590 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.529038 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.529042 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:48.530160 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:48.530168 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.530982 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.530986 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:48.531122 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:48.531166 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 17:11:48.531311 (+ 145us) client_negotiation.cc:240] Negotiation successful
0811 17:11:48.531451 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1480,"mutex_wait_us":2,"thread_start_us":112,"threads_started":1}
I20260811 17:11:48.532071 809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:48.525042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50750 (local address 127.4.146.193:32977)
0811 17:11:48.525424 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:48.525431 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:48.526259 (+ 828us) server_negotiation.cc:407] Connection header received
0811 17:11:48.526378 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:48.526385 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:48.526659 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:48.526814 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:11:48.527179 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.528334 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.530066 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.530917 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.531050 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:48.531196 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:48.531753 (+ 557us) server_negotiation.cc:299] Negotiation successful
0811 17:11:48.531874 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":129,"threads_started":1}
I20260811 17:11:48.532401 813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:48.526203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41254 (local address 127.4.146.195:35515)
0811 17:11:48.526586 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:48.526603 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:48.526775 (+ 172us) server_negotiation.cc:407] Connection header received
0811 17:11:48.526874 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:48.526879 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:48.527080 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:48.527244 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:11:48.527425 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.528490 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.529947 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.530917 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.531041 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:48.531196 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:48.532134 (+ 938us) server_negotiation.cc:299] Negotiation successful
0811 17:11:48.532252 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":140,"threads_started":1}
I20260811 17:11:48.532689 811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:48.525708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:35515 (local address 127.0.0.1:41254)
0811 17:11:48.526654 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:48.526668 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:48.526773 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:48.527215 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:48.527218 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:48.527240 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:11:48.527343 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:48.527349 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.528656 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.528661 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:48.529803 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:48.529814 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.531273 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.531277 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:48.531472 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:48.531574 (+ 102us) client_negotiation.cc:769] Sending connection context
0811 17:11:48.531656 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 17:11:48.532529 (+ 873us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":880,"mutex_wait_us":101,"thread_start_us":107,"threads_started":1}
I20260811 17:11:48.532934 803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:48.524895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:32977 (local address 127.0.0.1:50750)
0811 17:11:48.525874 (+ 979us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:48.525937 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:48.526091 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:48.526894 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:48.526900 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:48.526920 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:11:48.527051 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:48.527056 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.528471 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.528475 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:48.529941 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:48.529952 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.531273 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.531277 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:48.531479 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:48.531581 (+ 102us) client_negotiation.cc:769] Sending connection context
0811 17:11:48.531656 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 17:11:48.532788 (+ 1132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":781,"mutex_wait_us":1175,"thread_start_us":110,"threads_started":1}
I20260811 17:11:48.535379 402 tablet_service.cc:1467] Processing CreateTablet for tablet 64a5224d77184815a4c84158ee60ffdd (DEFAULT_TABLE table=test-table [id=64450c2c0a2340c784f4fff155a950ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:11:48.535828 32624 tablet_service.cc:1467] Processing CreateTablet for tablet 64a5224d77184815a4c84158ee60ffdd (DEFAULT_TABLE table=test-table [id=64450c2c0a2340c784f4fff155a950ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:11:48.535831 657 tablet_service.cc:1467] Processing CreateTablet for tablet 64a5224d77184815a4c84158ee60ffdd (DEFAULT_TABLE table=test-table [id=64450c2c0a2340c784f4fff155a950ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:11:48.536763 402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64a5224d77184815a4c84158ee60ffdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:11:48.536919 657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64a5224d77184815a4c84158ee60ffdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:11:48.536914 32624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64a5224d77184815a4c84158ee60ffdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:11:48.544270 814 tablet_bootstrap.cc:492] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725: Bootstrap starting.
I20260811 17:11:48.545451 816 tablet_bootstrap.cc:492] T 64a5224d77184815a4c84158ee60ffdd P ce5fbef16130442fbf4dcd603d52d041: Bootstrap starting.
I20260811 17:11:48.547446 816 tablet_bootstrap.cc:654] T 64a5224d77184815a4c84158ee60ffdd P ce5fbef16130442fbf4dcd603d52d041: Neither blocks nor log segments found. Creating new log.
I20260811 17:11:48.547649 814 tablet_bootstrap.cc:654] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725: Neither blocks nor log segments found. Creating new log.
I20260811 17:11:48.548499 815 tablet_bootstrap.cc:492] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9: Bootstrap starting.
I20260811 17:11:48.548792 814 log.cc:824] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725: Log is configured to *not* fsync() on all Append() calls
I20260811 17:11:48.548897 816 log.cc:824] T 64a5224d77184815a4c84158ee60ffdd P ce5fbef16130442fbf4dcd603d52d041: Log is configured to *not* fsync() on all Append() calls
I20260811 17:11:48.551273 816 tablet_bootstrap.cc:492] T 64a5224d77184815a4c84158ee60ffdd P ce5fbef16130442fbf4dcd603d52d041: No bootstrap required, opened a new log
I20260811 17:11:48.551260 814 tablet_bootstrap.cc:492] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725: No bootstrap required, opened a new log
I20260811 17:11:48.551260 815 tablet_bootstrap.cc:654] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9: Neither blocks nor log segments found. Creating new log.
I20260811 17:11:48.551501 816 ts_tablet_manager.cc:1397] T 64a5224d77184815a4c84158ee60ffdd P ce5fbef16130442fbf4dcd603d52d041: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 17:11:48.551502 814 ts_tablet_manager.cc:1397] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260811 17:11:48.552250 815 log.cc:824] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9: Log is configured to *not* fsync() on all Append() calls
I20260811 17:11:48.554894 815 tablet_bootstrap.cc:492] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9: No bootstrap required, opened a new log
I20260811 17:11:48.555207 815 ts_tablet_manager.cc:1397] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.005s
I20260811 17:11:48.555601 814 raft_consensus.cc:348] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } }
I20260811 17:11:48.555593 816 raft_consensus.cc:348] T 64a5224d77184815a4c84158ee60ffdd P ce5fbef16130442fbf4dcd603d52d041 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } }
I20260811 17:11:48.555922 816 raft_consensus.cc:374] T 64a5224d77184815a4c84158ee60ffdd P ce5fbef16130442fbf4dcd603d52d041 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:11:48.555922 814 raft_consensus.cc:374] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:11:48.555990 814 raft_consensus.cc:729] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bf5756645814013af53d03500d8c725, State: Initialized, Role: FOLLOWER
I20260811 17:11:48.556032 816 raft_consensus.cc:729] T 64a5224d77184815a4c84158ee60ffdd P ce5fbef16130442fbf4dcd603d52d041 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce5fbef16130442fbf4dcd603d52d041, State: Initialized, Role: FOLLOWER
I20260811 17:11:48.556602 814 consensus_queue.cc:260] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } }
I20260811 17:11:48.556604 816 consensus_queue.cc:260] T 64a5224d77184815a4c84158ee60ffdd P ce5fbef16130442fbf4dcd603d52d041 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } }
I20260811 17:11:48.557628 814 ts_tablet_manager.cc:1428] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 17:11:48.557780 816 ts_tablet_manager.cc:1428] T 64a5224d77184815a4c84158ee60ffdd P ce5fbef16130442fbf4dcd603d52d041: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 17:11:48.558146 790 heartbeater.cc:503] Master 127.4.146.254:40985 was elected leader, sending a full tablet report...
I20260811 17:11:48.558158 528 heartbeater.cc:503] Master 127.4.146.254:40985 was elected leader, sending a full tablet report...
I20260811 17:11:48.562086 815 raft_consensus.cc:348] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } }
I20260811 17:11:48.562427 815 raft_consensus.cc:374] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:11:48.562508 815 raft_consensus.cc:729] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d095952ff2e14f209629059f866ef8a9, State: Initialized, Role: FOLLOWER
I20260811 17:11:48.563073 815 consensus_queue.cc:260] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } }
I20260811 17:11:48.563927 32744 heartbeater.cc:503] Master 127.4.146.254:40985 was elected leader, sending a full tablet report...
I20260811 17:11:48.564425 815 ts_tablet_manager.cc:1428] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
W20260811 17:11:48.638595 32745 tablet.cc:2369] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 17:11:48.647145 533 tablet.cc:2369] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 17:11:48.715214 791 tablet.cc:2369] T 64a5224d77184815a4c84158ee60ffdd P ce5fbef16130442fbf4dcd603d52d041: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 17:11:48.769470 837 raft_consensus.cc:482] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:11:48.769779 837 raft_consensus.cc:504] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } }
I20260811 17:11:48.771088 837 leader_election.cc:288] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d095952ff2e14f209629059f866ef8a9 (127.4.146.193:32977), ce5fbef16130442fbf4dcd603d52d041 (127.4.146.195:35515)
I20260811 17:11:48.775734 842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:48.771899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:35515 (local address 127.4.146.194:41277)
0811 17:11:48.772238 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:48.772252 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:48.772367 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:48.772682 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:48.772685 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:48.772703 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:11:48.772856 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:48.772862 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.773607 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.773613 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:48.774558 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:48.774569 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.775243 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.775249 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:48.775361 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:48.775394 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 17:11:48.775468 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 17:11:48.775551 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":114,"threads_started":1}
I20260811 17:11:48.775727 813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:48.772122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:41277 (local address 127.4.146.195:35515)
0811 17:11:48.772280 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:48.772284 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:48.772380 (+ 96us) server_negotiation.cc:407] Connection header received
0811 17:11:48.772506 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:48.772509 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:48.772556 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:48.772642 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:11:48.772985 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.773490 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.774692 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.775111 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.775224 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:48.775314 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:48.775508 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 17:11:48.775595 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 17:11:48.775785 809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:48.771684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:52967 (local address 127.4.146.193:32977)
0811 17:11:48.771849 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:48.771854 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:48.771943 (+ 89us) server_negotiation.cc:407] Connection header received
0811 17:11:48.772287 (+ 344us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:48.772293 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:48.772356 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:48.772439 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:11:48.772868 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.773492 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.774733 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.775187 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.775310 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:48.775368 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:48.775588 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 17:11:48.775666 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 17:11:48.775777 840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:48.771436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:32977 (local address 127.4.146.194:52967)
0811 17:11:48.771787 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:48.771803 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:11:48.771986 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:11:48.772499 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:11:48.772502 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:11:48.772526 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:11:48.772707 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:48.772720 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.773650 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.773653 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:48.774572 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:11:48.774583 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.775330 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.775336 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:11:48.775429 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:48.775472 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 17:11:48.775553 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 17:11:48.775620 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":144,"threads_started":1}
I20260811 17:11:48.776854 32664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64a5224d77184815a4c84158ee60ffdd" candidate_uuid: "5bf5756645814013af53d03500d8c725" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d095952ff2e14f209629059f866ef8a9" is_pre_election: true
I20260811 17:11:48.776854 694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64a5224d77184815a4c84158ee60ffdd" candidate_uuid: "5bf5756645814013af53d03500d8c725" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce5fbef16130442fbf4dcd603d52d041" is_pre_election: true
I20260811 17:11:48.777263 694 raft_consensus.cc:2454] T 64a5224d77184815a4c84158ee60ffdd P ce5fbef16130442fbf4dcd603d52d041 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bf5756645814013af53d03500d8c725 in term 0.
I20260811 17:11:48.777263 32664 raft_consensus.cc:2454] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bf5756645814013af53d03500d8c725 in term 0.
I20260811 17:11:48.777842 323 leader_election.cc:302] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bf5756645814013af53d03500d8c725, ce5fbef16130442fbf4dcd603d52d041; no voters:
I20260811 17:11:48.778148 837 raft_consensus.cc:2781] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:11:48.778252 837 raft_consensus.cc:482] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:11:48.778302 837 raft_consensus.cc:3037] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:11:48.779466 837 raft_consensus.cc:504] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } }
I20260811 17:11:48.779884 837 leader_election.cc:288] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725 [CANDIDATE]: Term 1 election: Requested vote from peers d095952ff2e14f209629059f866ef8a9 (127.4.146.193:32977), ce5fbef16130442fbf4dcd603d52d041 (127.4.146.195:35515)
I20260811 17:11:48.780412 694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64a5224d77184815a4c84158ee60ffdd" candidate_uuid: "5bf5756645814013af53d03500d8c725" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce5fbef16130442fbf4dcd603d52d041"
I20260811 17:11:48.780412 32664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64a5224d77184815a4c84158ee60ffdd" candidate_uuid: "5bf5756645814013af53d03500d8c725" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d095952ff2e14f209629059f866ef8a9"
I20260811 17:11:48.780570 694 raft_consensus.cc:3037] T 64a5224d77184815a4c84158ee60ffdd P ce5fbef16130442fbf4dcd603d52d041 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:11:48.780570 32664 raft_consensus.cc:3037] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:11:48.782059 32664 raft_consensus.cc:2454] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bf5756645814013af53d03500d8c725 in term 1.
I20260811 17:11:48.782059 694 raft_consensus.cc:2454] T 64a5224d77184815a4c84158ee60ffdd P ce5fbef16130442fbf4dcd603d52d041 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bf5756645814013af53d03500d8c725 in term 1.
I20260811 17:11:48.782459 323 leader_election.cc:302] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bf5756645814013af53d03500d8c725, ce5fbef16130442fbf4dcd603d52d041; no voters:
I20260811 17:11:48.782697 837 raft_consensus.cc:2781] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:11:48.782940 837 raft_consensus.cc:686] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725 [term 1 LEADER]: Becoming Leader. State: Replica: 5bf5756645814013af53d03500d8c725, State: Running, Role: LEADER
I20260811 17:11:48.783325 837 consensus_queue.cc:237] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } }
I20260811 17:11:48.787226 32399 catalog_manager.cc:5495] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bf5756645814013af53d03500d8c725 (127.4.146.194). New cstate: current_term: 1 leader_uuid: "5bf5756645814013af53d03500d8c725" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } health_report { overall_health: UNKNOWN } } }
I20260811 17:11:48.831051 812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:48.826359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50314 (local address 127.4.146.194:42699)
0811 17:11:48.826577 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 17:11:48.826581 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:11:48.826598 (+ 17us) server_negotiation.cc:407] Connection header received
0811 17:11:48.826793 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:11:48.826796 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:11:48.826861 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:11:48.827022 (+ 161us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:11:48.827320 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.827846 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.829063 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:11:48.829337 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:11:48.829539 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:11:48.829968 (+ 429us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:11:48.830512 (+ 544us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:11:48.830689 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 17:11:48.830770 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 17:11:48.830852 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260811 17:11:48.838359 32664 raft_consensus.cc:1261] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9 [term 1 FOLLOWER]: Refusing update from remote peer 5bf5756645814013af53d03500d8c725: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:11:48.838359 694 raft_consensus.cc:1261] T 64a5224d77184815a4c84158ee60ffdd P ce5fbef16130442fbf4dcd603d52d041 [term 1 FOLLOWER]: Refusing update from remote peer 5bf5756645814013af53d03500d8c725: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:11:48.839332 843 consensus_queue.cc:1035] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:11:48.839649 837 consensus_queue.cc:1035] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:11:48.849295 852 mvcc.cc:205] Tried to move back new op lower bound from 7317374192993210368 to 7317374192779378688. Current Snapshot: MvccSnapshot[applied={T|T < 7317374192993210368}]
I20260811 17:11:48.852007 851 mvcc.cc:205] Tried to move back new op lower bound from 7317374192993210368 to 7317374192779378688. Current Snapshot: MvccSnapshot[applied={T|T < 7317374192993210368}]
I20260811 17:11:48.857935 32397 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:11:48.858151 32397 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:11:48.861177 32397 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c: Sending DeleteTablet for 3 replicas of tablet 64a5224d77184815a4c84158ee60ffdd
I20260811 17:11:48.862393 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 32512
I20260811 17:11:48.862309 32624 tablet_service.cc:1514] Processing DeleteTablet for tablet 64a5224d77184815a4c84158ee60ffdd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:11:48 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:50750
I20260811 17:11:48.862318 402 tablet_service.cc:1514] Processing DeleteTablet for tablet 64a5224d77184815a4c84158ee60ffdd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:11:48 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:50304
I20260811 17:11:48.874681 657 tablet_service.cc:1514] Processing DeleteTablet for tablet 64a5224d77184815a4c84158ee60ffdd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:11:48 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:41254
I20260811 17:11:48.875030 869 tablet_replica.cc:330] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725: stopping tablet replica
I20260811 17:11:48.875608 869 raft_consensus.cc:2229] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725 [term 1 LEADER]: Raft consensus shutting down.
I20260811 17:11:48.876157 869 raft_consensus.cc:2258] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:11:48.880147 869 ts_tablet_manager.cc:1905] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:11:48.880419 870 tablet_replica.cc:330] T 64a5224d77184815a4c84158ee60ffdd P ce5fbef16130442fbf4dcd603d52d041: stopping tablet replica
I20260811 17:11:48.880863 870 raft_consensus.cc:2229] T 64a5224d77184815a4c84158ee60ffdd P ce5fbef16130442fbf4dcd603d52d041 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:11:48.881459 870 raft_consensus.cc:2258] T 64a5224d77184815a4c84158ee60ffdd P ce5fbef16130442fbf4dcd603d52d041 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:11:48.883214 870 ts_tablet_manager.cc:1905] T 64a5224d77184815a4c84158ee60ffdd P ce5fbef16130442fbf4dcd603d52d041: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:11:48.883716 869 ts_tablet_manager.cc:1918] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:11:48.883883 869 log.cc:1196] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/wal/wals/64a5224d77184815a4c84158ee60ffdd
I20260811 17:11:48.884316 869 ts_tablet_manager.cc:1939] T 64a5224d77184815a4c84158ee60ffdd P 5bf5756645814013af53d03500d8c725: Deleting consensus metadata
I20260811 17:11:48.885785 32368 catalog_manager.cc:4841] TS 5bf5756645814013af53d03500d8c725 (127.4.146.194:42699): tablet 64a5224d77184815a4c84158ee60ffdd (table test-table [id=64450c2c0a2340c784f4fff155a950ac]) successfully deleted
I20260811 17:11:48.886857 870 ts_tablet_manager.cc:1918] T 64a5224d77184815a4c84158ee60ffdd P ce5fbef16130442fbf4dcd603d52d041: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:11:48.887009 870 log.cc:1196] T 64a5224d77184815a4c84158ee60ffdd P ce5fbef16130442fbf4dcd603d52d041: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/64a5224d77184815a4c84158ee60ffdd
W20260811 17:11:48.887173 32367 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.146.193:32977 (error 108)
I20260811 17:11:48.887426 870 ts_tablet_manager.cc:1939] T 64a5224d77184815a4c84158ee60ffdd P ce5fbef16130442fbf4dcd603d52d041: Deleting consensus metadata
I20260811 17:11:48.887496 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 32756
I20260811 17:11:48.906643 803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:11:48.906159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:32977 (local address 127.0.0.1:50766)
0811 17:11:48.906412 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0811 17:11:48.906515 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.193:32977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143}
W20260811 17:11:48.906904 32367 catalog_manager.cc:4584] TS d095952ff2e14f209629059f866ef8a9 (127.4.146.193:32977): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 64a5224d77184815a4c84158ee60ffdd: Network error: Client connection negotiation failed: client connection to 127.4.146.193:32977: connect: Connection refused (error 111)
I20260811 17:11:48.907212 32367 catalog_manager.cc:4841] TS ce5fbef16130442fbf4dcd603d52d041 (127.4.146.195:35515): tablet 64a5224d77184815a4c84158ee60ffdd (table test-table [id=64450c2c0a2340c784f4fff155a950ac]) successfully deleted
I20260811 17:11:48.912822 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 544
I20260811 17:11:48.934165 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 32338
I20260811 17:12:08.955432 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:40985
--webserver_interface=127.4.146.254
--webserver_port=34763
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:40985
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:12:09.079473 872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:09.079833 872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:09.079933 872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:09.084291 872 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 17:12:09.084388 872 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 17:12:09.084416 872 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 17:12:09.084443 872 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:12:09.084486 872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:09.084527 872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:09.084564 872 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:12:09.084600 872 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:12:09.090373 872 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:40985
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:40985
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=34763
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.872
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:09.091619 872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:09.092760 872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:09.108906 894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:09.108996 872 server_base.cc:1034] running on GCE node
W20260811 17:12:09.108906 892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:09.108906 891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:09.109964 872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:09.111303 872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:09.112510 872 hybrid_clock.cc:648] HybridClock initialized: now 1786468329112489 us; error 43 us; skew 500 ppm
Aug 11 17:12:09 dist-test-slave-7vjv krb5kdc[32310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468329, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:12:09.120203 872 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:12:09.121419 872 webserver.cc:460] Webserver started at http://127.4.146.254:34763/ using document root <none> and password file <none>
I20260811 17:12:09.122092 872 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:09.122220 872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:09.126720 872 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 17:12:09.129446 909 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:09.131011 872 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:12:09.131202 872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "cf33be911cfb49fb834a6bc618ccf62c"
format_stamp: "Formatted at 2026-08-11 17:11:47 on dist-test-slave-7vjv"
server_key: "1a6e986481a2c4fb90181d6c64ead87a"
server_key_iv: "1960b77ee957da7e337c14312fdb6e3e"
server_key_version: "encryptionkey@0"
I20260811 17:12:09.131938 872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:09.151378 872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:09.155133 872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:09.155443 872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:09.163942 872 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:40985
I20260811 17:12:09.164350 991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:40985 every 8 connection(s)
I20260811 17:12:09.165246 872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:12:09.170351 994 sys_catalog.cc:263] Verifying existing consensus state
I20260811 17:12:09.172479 994 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c: Bootstrap starting.
I20260811 17:12:09.175127 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 872
I20260811 17:12:09.175812 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:32977
--local_ip_for_outbound_sockets=127.4.146.193
--tserver_master_addrs=127.4.146.254:40985
--webserver_port=36519
--webserver_interface=127.4.146.193
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 17:12:09.193434 994 log.cc:824] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:09.204260 994 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 17:12:09.204725 994 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c: Bootstrap complete.
I20260811 17:12:09.209215 994 raft_consensus.cc:348] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf33be911cfb49fb834a6bc618ccf62c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40985 } }
I20260811 17:12:09.209648 994 raft_consensus.cc:729] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33be911cfb49fb834a6bc618ccf62c, State: Initialized, Role: FOLLOWER
I20260811 17:12:09.210234 994 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf33be911cfb49fb834a6bc618ccf62c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40985 } }
I20260811 17:12:09.210366 994 raft_consensus.cc:388] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:12:09.210467 994 raft_consensus.cc:482] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:12:09.210594 994 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [term 1 FOLLOWER]: Advancing to term 2
I20260811 17:12:09.212885 994 raft_consensus.cc:504] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf33be911cfb49fb834a6bc618ccf62c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40985 } }
I20260811 17:12:09.213263 994 leader_election.cc:302] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cf33be911cfb49fb834a6bc618ccf62c; no voters:
I20260811 17:12:09.213635 994 leader_election.cc:288] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 17:12:09.213737 1006 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [term 2 FOLLOWER]: Leader election won for term 2
I20260811 17:12:09.214002 1006 raft_consensus.cc:686] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [term 2 LEADER]: Becoming Leader. State: Replica: cf33be911cfb49fb834a6bc618ccf62c, State: Running, Role: LEADER
I20260811 17:12:09.214393 1006 consensus_queue.cc:237] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf33be911cfb49fb834a6bc618ccf62c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40985 } }
I20260811 17:12:09.214998 994 sys_catalog.cc:564] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:12:09.215999 1009 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf33be911cfb49fb834a6bc618ccf62c. Latest consensus state: current_term: 2 leader_uuid: "cf33be911cfb49fb834a6bc618ccf62c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf33be911cfb49fb834a6bc618ccf62c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40985 } } }
I20260811 17:12:09.216167 1009 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [sys.catalog]: This master's current role is: LEADER
I20260811 17:12:09.216202 1007 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "cf33be911cfb49fb834a6bc618ccf62c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf33be911cfb49fb834a6bc618ccf62c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40985 } } }
I20260811 17:12:09.216320 1007 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [sys.catalog]: This master's current role is: LEADER
I20260811 17:12:09.216727 1021 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:12:09.222137 1021 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:12:09.222961 1021 catalog_manager.cc:1259] Loaded cluster ID: ffcb8416fea24c4aaef0d59b3373a2dc
I20260811 17:12:09.223109 1021 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:12:09.225852 1021 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:12:09.226665 1021 catalog_manager.cc:5879] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c: Loaded TSK: 0
I20260811 17:12:09.243652 1021 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c: Generated new TSK 1
I20260811 17:12:09.243996 1021 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 17:12:09.307284 999 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:09.307600 999 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:09.307647 999 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:09.311975 999 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:09.312072 999 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:09.312247 999 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:12:09.318640 999 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:32977
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=36519
--tserver_master_addrs=127.4.146.254:40985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.999
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:09.319831 999 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:09.321002 999 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:09.333129 1051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:09.333118 1049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:09.333449 1054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:09.333771 999 server_base.cc:1034] running on GCE node
I20260811 17:12:09.334422 999 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:09.335326 999 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:09.336520 999 hybrid_clock.cc:648] HybridClock initialized: now 1786468329336482 us; error 58 us; skew 500 ppm
Aug 11 17:12:09 dist-test-slave-7vjv krb5kdc[32310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468329, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:12:09.340296 999 init.cc:377] Logged in from keytab as kudu/127.4.146.193@KRBTEST.COM (short username kudu)
I20260811 17:12:09.341459 999 webserver.cc:460] Webserver started at http://127.4.146.193:36519/ using document root <none> and password file <none>
I20260811 17:12:09.342150 999 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:09.342290 999 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:09.347210 999 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 17:12:09.349977 1064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:09.351554 999 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 17:12:09.351730 999 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "d095952ff2e14f209629059f866ef8a9"
format_stamp: "Formatted at 2026-08-11 17:11:47 on dist-test-slave-7vjv"
server_key: "72ebaae51a7c21c4198e168d99e96751"
server_key_iv: "6dcbb9dca2de8c1c31707b6ae3169917"
server_key_version: "encryptionkey@0"
I20260811 17:12:09.352455 999 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:09.386664 999 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:09.390794 999 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:09.391057 999 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:09.391765 999 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:12:09.393034 1079 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 17:12:09.397936 999 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 17:12:09.398056 999 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.001s sys 0.000s
I20260811 17:12:09.398159 999 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 17:12:09.400420 999 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 17:12:09.400512 999 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20260811 17:12:09.400947 1079 tablet_bootstrap.cc:492] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9: Bootstrap starting.
I20260811 17:12:09.412230 999 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:32977
I20260811 17:12:09.412351 1278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:32977 every 8 connection(s)
I20260811 17:12:09.413374 999 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:12:09.415805 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 999
I20260811 17:12:09.416478 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:42699
--local_ip_for_outbound_sockets=127.4.146.194
--tserver_master_addrs=127.4.146.254:40985
--webserver_port=39093
--webserver_interface=127.4.146.194
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 17:12:09.422385 1079 log.cc:824] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9: Log is configured to *not* fsync() on all Append() calls
Aug 11 17:12:09 dist-test-slave-7vjv krb5kdc[32310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468329, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:12:09.431790 1079 tablet_bootstrap.cc:492] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 17:12:09.432405 1079 tablet_bootstrap.cc:492] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9: Bootstrap complete.
I20260811 17:12:09.434041 1079 ts_tablet_manager.cc:1397] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9: Time spent bootstrapping tablet: real 0.033s user 0.018s sys 0.012s
I20260811 17:12:09.437446 1079 raft_consensus.cc:348] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } }
I20260811 17:12:09.438122 1079 raft_consensus.cc:729] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d095952ff2e14f209629059f866ef8a9, State: Initialized, Role: FOLLOWER
I20260811 17:12:09.438756 1079 consensus_queue.cc:260] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } }
I20260811 17:12:09.439142 1283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:09.415918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:58441 (local address 127.4.146.254:40985)
0811 17:12:09.416580 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:09.416602 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:09.420196 (+ 3594us) server_negotiation.cc:407] Connection header received
0811 17:12:09.421446 (+ 1250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:09.421462 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:09.421999 (+ 537us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:09.422458 (+ 459us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:09.424081 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.425948 (+ 1867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.427765 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.428715 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.428942 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:09.432481 (+ 3539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:09.432490 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:09.432509 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:12:09.432552 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:09.434948 (+ 2396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:09.435681 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:09.435688 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:09.435694 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:09.435861 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:09.436329 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:09.436333 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:09.436335 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:09.436859 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:09.437017 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:09.437787 (+ 770us) server_negotiation.cc:299] Negotiation successful
0811 17:12:09.438136 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":143,"threads_started":1}
I20260811 17:12:09.439450 1287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:09.415817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.193:58441)
0811 17:12:09.419930 (+ 4113us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:09.419987 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:09.420911 (+ 924us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:09.422553 (+ 1642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:09.422564 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:09.423099 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:12:09.423809 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:09.423834 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.426185 (+ 2351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.426189 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:09.427583 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:09.427598 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.428915 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.428920 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:09.429116 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:09.429899 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:12:09.429920 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:12:09.432171 (+ 2251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:12:09.435127 (+ 2956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:09.435134 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:09.435150 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:09.435538 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:09.435978 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:09.435981 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:09.435984 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:09.436222 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:09.437016 (+ 794us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:12:09.437023 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:12:09.437376 (+ 353us) client_negotiation.cc:769] Sending connection context
0811 17:12:09.437600 (+ 224us) client_negotiation.cc:240] Negotiation successful
0811 17:12:09.437974 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3857,"thread_start_us":190,"threads_started":1}
I20260811 17:12:09.440023 1079 ts_tablet_manager.cc:1428] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260811 17:12:09.442325 1279 heartbeater.cc:347] Connected to a master server at 127.4.146.254:40985
I20260811 17:12:09.442623 1279 heartbeater.cc:464] Registering TS with master...
I20260811 17:12:09.443239 1279 heartbeater.cc:511] Master 127.4.146.254:40985 requested a full tablet report, sending...
I20260811 17:12:09.446256 938 ts_manager.cc:194] Registered new tserver with Master: d095952ff2e14f209629059f866ef8a9 (127.4.146.193:32977)
I20260811 17:12:09.450582 938 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.193@KRBTEST.COM'} at 127.4.146.193:58441
I20260811 17:12:09.454021 1279 heartbeater.cc:503] Master 127.4.146.254:40985 was elected leader, sending a full tablet report...
Aug 11 17:12:09 dist-test-slave-7vjv krb5kdc[32310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468329, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for kudu/127.4.146.193@KRBTEST.COM
I20260811 17:12:09.462417 1294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:09.449712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35120 (local address 127.4.146.193:32977)
0811 17:12:09.450527 (+ 815us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:09.450541 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:09.450570 (+ 29us) server_negotiation.cc:407] Connection header received
0811 17:12:09.450655 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:09.450661 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:09.450884 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:09.451051 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:09.451965 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.452962 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.453959 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.454474 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.454614 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:09.457775 (+ 3161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:09.457784 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:09.457795 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:12:09.457823 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:09.459934 (+ 2111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:09.460675 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:09.460681 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:09.460682 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:09.460781 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:09.461146 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:09.461150 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:09.461152 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:09.461452 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:09.461573 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:09.462030 (+ 457us) server_negotiation.cc:299] Negotiation successful
0811 17:12:09.462264 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":684,"thread_start_us":156,"threads_started":1}
I20260811 17:12:09.462435 1292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:09.449619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:32977 (local address 127.0.0.1:35120)
0811 17:12:09.450095 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:09.450149 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:09.450297 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:09.451074 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:09.451080 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:09.451631 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:12:09.451788 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:09.451799 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.453103 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.453107 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:09.453806 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:09.453816 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.454645 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.454650 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:09.454791 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:09.455552 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:12:09.455570 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:12:09.457578 (+ 2008us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:12:09.460079 (+ 2501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:09.460123 (+ 44us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:09.460130 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:09.460504 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:09.460898 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:09.460901 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:09.460903 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:09.461020 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:09.461593 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:12:09.461600 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:12:09.461767 (+ 167us) client_negotiation.cc:769] Sending connection context
0811 17:12:09.461948 (+ 181us) client_negotiation.cc:240] Negotiation successful
0811 17:12:09.462221 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":140,"threads_started":1}
I20260811 17:12:09.463668 1153 tablet_service.cc:1514] Processing DeleteTablet for tablet 64a5224d77184815a4c84158ee60ffdd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:11:48 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:35120
I20260811 17:12:09.464775 1295 tablet_replica.cc:330] stopping tablet replica
I20260811 17:12:09.465175 1295 raft_consensus.cc:2229] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:12:09.465502 1295 raft_consensus.cc:2258] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:12:09.466780 1295 ts_tablet_manager.cc:1905] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:12:09.472661 1295 ts_tablet_manager.cc:1918] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:12:09.472827 1295 log.cc:1196] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/wal/wals/64a5224d77184815a4c84158ee60ffdd
I20260811 17:12:09.473352 1295 ts_tablet_manager.cc:1939] T 64a5224d77184815a4c84158ee60ffdd P d095952ff2e14f209629059f866ef8a9: Deleting consensus metadata
I20260811 17:12:09.475840 910 catalog_manager.cc:4841] TS d095952ff2e14f209629059f866ef8a9 (127.4.146.193:32977): tablet 64a5224d77184815a4c84158ee60ffdd (table test-table [id=64450c2c0a2340c784f4fff155a950ac]) successfully deleted
W20260811 17:12:09.561769 1288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:09.562093 1288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:09.562141 1288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:09.566341 1288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:09.566422 1288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:09.566486 1288 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:12:09.572233 1288 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:42699
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=39093
--tserver_master_addrs=127.4.146.254:40985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1288
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:09.573707 1288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:09.575021 1288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:09.586625 1306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:09.586625 1307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:09.586630 1312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:09.587049 1288 server_base.cc:1034] running on GCE node
I20260811 17:12:09.587625 1288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:09.588447 1288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:09.589668 1288 hybrid_clock.cc:648] HybridClock initialized: now 1786468329589630 us; error 54 us; skew 500 ppm
Aug 11 17:12:09 dist-test-slave-7vjv krb5kdc[32310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468329, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:12:09.592991 1288 init.cc:377] Logged in from keytab as kudu/127.4.146.194@KRBTEST.COM (short username kudu)
I20260811 17:12:09.594138 1288 webserver.cc:460] Webserver started at http://127.4.146.194:39093/ using document root <none> and password file <none>
I20260811 17:12:09.594781 1288 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:09.594911 1288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:09.599252 1288 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260811 17:12:09.601846 1331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:09.603385 1288 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 17:12:09.603592 1288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "5bf5756645814013af53d03500d8c725"
format_stamp: "Formatted at 2026-08-11 17:11:48 on dist-test-slave-7vjv"
server_key: "62ec46be4a9b222486c37d8d2247f46e"
server_key_iv: "23252806c2ffd08f105ac7f1bdddef35"
server_key_version: "encryptionkey@0"
I20260811 17:12:09.604377 1288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:09.630189 1288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:09.637389 1288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:09.637639 1288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:09.638330 1288 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:12:09.639273 1288 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:12:09.639359 1288 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:09.639451 1288 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:12:09.639503 1288 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:09.649983 1288 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:42699
I20260811 17:12:09.650051 1563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:42699 every 8 connection(s)
I20260811 17:12:09.651177 1288 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:12:09.657029 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 1288
I20260811 17:12:09.657583 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:35515
--local_ip_for_outbound_sockets=127.4.146.195
--tserver_master_addrs=127.4.146.254:40985
--webserver_port=44545
--webserver_interface=127.4.146.195
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 17:12:09 dist-test-slave-7vjv krb5kdc[32310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468329, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:12:09.669819 1283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:09.653537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:45597 (local address 127.4.146.254:40985)
0811 17:12:09.653708 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:09.653713 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:09.655293 (+ 1580us) server_negotiation.cc:407] Connection header received
0811 17:12:09.656306 (+ 1013us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:09.656309 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:09.656368 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:09.656459 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:09.658024 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.658965 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.660315 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.660789 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.660931 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:09.664560 (+ 3629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:09.664564 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:09.664567 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:12:09.664600 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:09.666447 (+ 1847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:09.667410 (+ 963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:09.667414 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:09.667415 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:09.667522 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:09.668191 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:09.668194 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:09.668196 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:09.668446 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:09.668542 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:09.669460 (+ 918us) server_negotiation.cc:299] Negotiation successful
0811 17:12:09.669669 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 17:12:09.671396 1568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:09.653994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.194:45597)
0811 17:12:09.655065 (+ 1071us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:09.655118 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:09.655981 (+ 863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:09.656659 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:09.656667 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:09.657073 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:12:09.657815 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:09.657833 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.659133 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.659164 (+ 31us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:09.660171 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:09.660189 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.660963 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.660965 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:09.661123 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:09.661836 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:12:09.661854 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:12:09.664157 (+ 2303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:12:09.666632 (+ 2475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:09.666644 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:09.666673 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:09.667215 (+ 542us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:09.667673 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:09.667679 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:09.667683 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:09.667956 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:09.668586 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:12:09.668597 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:12:09.669085 (+ 488us) client_negotiation.cc:769] Sending connection context
0811 17:12:09.669372 (+ 287us) client_negotiation.cc:240] Negotiation successful
0811 17:12:09.669943 (+ 571us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":843,"thread_start_us":664,"threads_started":1}
I20260811 17:12:09.673202 1565 heartbeater.cc:347] Connected to a master server at 127.4.146.254:40985
I20260811 17:12:09.673588 1565 heartbeater.cc:464] Registering TS with master...
I20260811 17:12:09.674199 1565 heartbeater.cc:511] Master 127.4.146.254:40985 requested a full tablet report, sending...
I20260811 17:12:09.675480 938 ts_manager.cc:194] Registered new tserver with Master: 5bf5756645814013af53d03500d8c725 (127.4.146.194:42699)
I20260811 17:12:09.676221 938 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.194@KRBTEST.COM'} at 127.4.146.194:45597
W20260811 17:12:09.790393 1569 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:09.790709 1569 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:09.790755 1569 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:09.795040 1569 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:09.795141 1569 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:09.795207 1569 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:12:09.801308 1569 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:35515
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=44545
--tserver_master_addrs=127.4.146.254:40985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1569
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:09.802560 1569 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:09.803694 1569 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:09.820015 1580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:09.820046 1581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:09.820026 1588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:09.820719 1569 server_base.cc:1034] running on GCE node
I20260811 17:12:09.821408 1569 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:09.822432 1569 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:09.823642 1569 hybrid_clock.cc:648] HybridClock initialized: now 1786468329823609 us; error 49 us; skew 500 ppm
Aug 11 17:12:09 dist-test-slave-7vjv krb5kdc[32310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468329, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:12:09.828042 1569 init.cc:377] Logged in from keytab as kudu/127.4.146.195@KRBTEST.COM (short username kudu)
I20260811 17:12:09.833985 1569 webserver.cc:460] Webserver started at http://127.4.146.195:44545/ using document root <none> and password file <none>
I20260811 17:12:09.834992 1569 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:09.835162 1569 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:09.842932 1569 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.001s sys 0.004s
I20260811 17:12:09.846283 1600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:09.848181 1569 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 17:12:09.848358 1569 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "ce5fbef16130442fbf4dcd603d52d041"
format_stamp: "Formatted at 2026-08-11 17:11:48 on dist-test-slave-7vjv"
server_key: "7697cfa7ccda754bedcc6d6056506e8c"
server_key_iv: "78b3fe0b88cb9869ccf38bf6defc15e6"
server_key_version: "encryptionkey@0"
I20260811 17:12:09.849229 1569 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:09.887683 1569 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:09.891064 1569 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:09.891237 1569 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:09.891819 1569 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:12:09.892789 1569 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:12:09.892840 1569 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:09.892884 1569 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:12:09.892899 1569 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:09.903023 1569 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:35515
I20260811 17:12:09.903047 1811 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:35515 every 8 connection(s)
I20260811 17:12:09.904258 1569 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:12:09.912047 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 1569
Aug 11 17:12:09 dist-test-slave-7vjv krb5kdc[32310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468329, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:12:09.921509 1283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:09.906339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:45793 (local address 127.4.146.254:40985)
0811 17:12:09.906478 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:09.906482 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:09.907372 (+ 890us) server_negotiation.cc:407] Connection header received
0811 17:12:09.909237 (+ 1865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:09.909241 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:09.909303 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:09.909413 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:09.910753 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.911281 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.912810 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.913117 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.913235 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:09.916594 (+ 3359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:09.916597 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:09.916599 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:12:09.916626 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:09.918397 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:09.919168 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:09.919171 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:09.919172 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:09.919258 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:09.919761 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:09.919767 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:09.919772 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:09.920128 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:09.920257 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:09.921106 (+ 849us) server_negotiation.cc:299] Negotiation successful
0811 17:12:09.921272 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 17:12:09.922588 1820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:09.912830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44562 (local address 127.4.146.254:40985)
0811 17:12:09.913130 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:09.913134 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:09.913245 (+ 111us) server_negotiation.cc:407] Connection header received
0811 17:12:09.913380 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:09.913383 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:09.913434 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:09.913570 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:09.914532 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.915294 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.916417 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.916735 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.916900 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:09.918594 (+ 1694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:09.918598 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:09.918600 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:12:09.918627 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:09.920561 (+ 1934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:09.921180 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:09.921183 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:09.921185 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:09.921287 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:09.921644 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:09.921648 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:09.921650 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:09.921864 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:09.922098 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:09.922259 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 17:12:09.922387 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":104,"threads_started":1}
I20260811 17:12:09.922588 1816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:09.906751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.195:45793)
0811 17:12:09.907220 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:09.907264 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:09.908998 (+ 1734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:09.909622 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:09.909629 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:09.910097 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:12:09.910597 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:09.910613 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.911413 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.911417 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:09.912688 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:09.912700 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.913348 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.913354 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:09.913579 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:09.914303 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:12:09.914320 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:12:09.916382 (+ 2062us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:12:09.918577 (+ 2195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:09.918584 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:09.918603 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:09.919060 (+ 457us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:09.919386 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:09.919391 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:09.919395 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:09.919613 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:09.920264 (+ 651us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:12:09.920275 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:12:09.920720 (+ 445us) client_negotiation.cc:769] Sending connection context
0811 17:12:09.920980 (+ 260us) client_negotiation.cc:240] Negotiation successful
0811 17:12:09.921404 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":131,"threads_started":1}
I20260811 17:12:09.923888 1812 heartbeater.cc:347] Connected to a master server at 127.4.146.254:40985
I20260811 17:12:09.924204 1812 heartbeater.cc:464] Registering TS with master...
I20260811 17:12:09.924818 1812 heartbeater.cc:511] Master 127.4.146.254:40985 requested a full tablet report, sending...
I20260811 17:12:09.925948 938 ts_manager.cc:194] Registered new tserver with Master: ce5fbef16130442fbf4dcd603d52d041 (127.4.146.195:35515)
I20260811 17:12:09.926492 938 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.195@KRBTEST.COM'} at 127.4.146.195:45793
I20260811 17:12:09.937322 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 17:12:09.942092 1820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:09.937999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44566 (local address 127.4.146.254:40985)
0811 17:12:09.938142 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:09.938146 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:09.938329 (+ 183us) server_negotiation.cc:407] Connection header received
0811 17:12:09.938493 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:09.938495 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:09.938609 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:09.938705 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:12:09.938909 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.939468 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.940554 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.941006 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.941140 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:09.941508 (+ 368us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:12:09.941665 (+ 157us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 17:12:09.941939 (+ 274us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44566: token expired
Metrics: {"server-negotiator.queue_time_us":52}
W20260811 17:12:09.942224 1820 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44566: token expired
W20260811 17:12:09.942648 794 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.4.146.254:40985)
I20260811 17:12:09.951251 1820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:09.943084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44568 (local address 127.4.146.254:40985)
0811 17:12:09.943236 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:09.943242 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:09.943256 (+ 14us) server_negotiation.cc:407] Connection header received
0811 17:12:09.943402 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:09.943405 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:09.943455 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:09.943556 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:09.944357 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.944877 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.945709 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.945936 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.946053 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:09.947639 (+ 1586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:09.947644 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:09.947647 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:12:09.947682 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:09.949313 (+ 1631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:09.949810 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:09.949814 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:09.949816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:09.949910 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:09.950231 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:09.950236 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:09.950251 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:09.950467 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:09.950624 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:09.950906 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 17:12:09.951051 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 17:12:09.954176 938 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44568:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 17:12:09.957645 938 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:12:09.967517 1153 tablet_service.cc:1467] Processing CreateTablet for tablet 1c94cfaf624345cdbcd6436dcdbb6acb (DEFAULT_TABLE table=test-table [id=9c88bb64f599461a84b5683f211a5ab6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:12:09.968392 1153 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c94cfaf624345cdbcd6436dcdbb6acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:09.972100 1835 tablet_bootstrap.cc:492] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9: Bootstrap starting.
I20260811 17:12:09.973325 1835 tablet_bootstrap.cc:654] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:09.973487 1831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:09.966422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:42699 (local address 127.0.0.1:60016)
0811 17:12:09.966972 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:09.966987 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:09.967077 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:09.967950 (+ 873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:09.967954 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:09.967980 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:09.968189 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:09.968195 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.969472 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.969477 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:09.971180 (+ 1703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:09.971195 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.972882 (+ 1687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.972887 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:09.973005 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:09.973072 (+ 67us) client_negotiation.cc:769] Sending connection context
0811 17:12:09.973172 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 17:12:09.973300 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"mutex_wait_us":167,"thread_start_us":109,"threads_started":1}
I20260811 17:12:09.973754 1828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:09.966204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:35515 (local address 127.0.0.1:35292)
0811 17:12:09.966595 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:09.966613 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:09.966721 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:09.967892 (+ 1171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:09.967895 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:09.967914 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:09.968167 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:09.968177 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.969612 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.969616 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:09.971185 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:09.971195 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.973305 (+ 2110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.973309 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:09.973423 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:09.973447 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 17:12:09.973504 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 17:12:09.973593 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":227,"thread_start_us":109,"threads_started":1}
I20260811 17:12:09.974138 1834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:09.966933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60016 (local address 127.4.146.194:42699)
0811 17:12:09.967295 (+ 362us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:09.967308 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:09.967331 (+ 23us) server_negotiation.cc:407] Connection header received
0811 17:12:09.967408 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:09.967412 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:09.967607 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:09.967802 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:09.968364 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.969316 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.971363 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.972457 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.972592 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:09.972795 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:09.973779 (+ 984us) server_negotiation.cc:299] Negotiation successful
0811 17:12:09.973922 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":134,"threads_started":1}
I20260811 17:12:09.974632 1832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:09.966394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35292 (local address 127.4.146.195:35515)
0811 17:12:09.967338 (+ 944us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:09.967351 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:09.967376 (+ 25us) server_negotiation.cc:407] Connection header received
0811 17:12:09.967460 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:09.967466 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:09.967697 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:09.968077 (+ 380us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:09.968308 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.969477 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.972193 (+ 2716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:09.973152 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:09.974052 (+ 900us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:09.974256 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:09.974321 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 17:12:09.974434 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":837,"thread_start_us":163,"threads_started":1}
I20260811 17:12:09.975863 1835 tablet_bootstrap.cc:492] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9: No bootstrap required, opened a new log
I20260811 17:12:09.976019 1835 ts_tablet_manager.cc:1397] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260811 17:12:09.976639 1835 raft_consensus.cc:348] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } }
I20260811 17:12:09.976816 1835 raft_consensus.cc:374] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:09.976868 1835 raft_consensus.cc:729] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d095952ff2e14f209629059f866ef8a9, State: Initialized, Role: FOLLOWER
I20260811 17:12:09.977021 1835 consensus_queue.cc:260] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } }
I20260811 17:12:09.977449 1835 ts_tablet_manager.cc:1428] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 17:12:09.977859 1443 tablet_service.cc:1467] Processing CreateTablet for tablet 1c94cfaf624345cdbcd6436dcdbb6acb (DEFAULT_TABLE table=test-table [id=9c88bb64f599461a84b5683f211a5ab6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:12:09.977849 1691 tablet_service.cc:1467] Processing CreateTablet for tablet 1c94cfaf624345cdbcd6436dcdbb6acb (DEFAULT_TABLE table=test-table [id=9c88bb64f599461a84b5683f211a5ab6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:12:09.979185 1443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c94cfaf624345cdbcd6436dcdbb6acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:09.979190 1691 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c94cfaf624345cdbcd6436dcdbb6acb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:09.988752 1841 tablet_bootstrap.cc:492] T 1c94cfaf624345cdbcd6436dcdbb6acb P 5bf5756645814013af53d03500d8c725: Bootstrap starting.
I20260811 17:12:09.989360 1842 tablet_bootstrap.cc:492] T 1c94cfaf624345cdbcd6436dcdbb6acb P ce5fbef16130442fbf4dcd603d52d041: Bootstrap starting.
I20260811 17:12:09.992138 1841 tablet_bootstrap.cc:654] T 1c94cfaf624345cdbcd6436dcdbb6acb P 5bf5756645814013af53d03500d8c725: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:09.992211 1842 tablet_bootstrap.cc:654] T 1c94cfaf624345cdbcd6436dcdbb6acb P ce5fbef16130442fbf4dcd603d52d041: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:09.993254 1841 log.cc:824] T 1c94cfaf624345cdbcd6436dcdbb6acb P 5bf5756645814013af53d03500d8c725: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:09.993254 1842 log.cc:824] T 1c94cfaf624345cdbcd6436dcdbb6acb P ce5fbef16130442fbf4dcd603d52d041: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:09.996127 1842 tablet_bootstrap.cc:492] T 1c94cfaf624345cdbcd6436dcdbb6acb P ce5fbef16130442fbf4dcd603d52d041: No bootstrap required, opened a new log
I20260811 17:12:09.996131 1841 tablet_bootstrap.cc:492] T 1c94cfaf624345cdbcd6436dcdbb6acb P 5bf5756645814013af53d03500d8c725: No bootstrap required, opened a new log
I20260811 17:12:09.996381 1841 ts_tablet_manager.cc:1397] T 1c94cfaf624345cdbcd6436dcdbb6acb P 5bf5756645814013af53d03500d8c725: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260811 17:12:09.996382 1842 ts_tablet_manager.cc:1397] T 1c94cfaf624345cdbcd6436dcdbb6acb P ce5fbef16130442fbf4dcd603d52d041: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260811 17:12:10.000850 1841 raft_consensus.cc:348] T 1c94cfaf624345cdbcd6436dcdbb6acb P 5bf5756645814013af53d03500d8c725 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } }
I20260811 17:12:10.000840 1842 raft_consensus.cc:348] T 1c94cfaf624345cdbcd6436dcdbb6acb P ce5fbef16130442fbf4dcd603d52d041 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } }
I20260811 17:12:10.001362 1841 raft_consensus.cc:374] T 1c94cfaf624345cdbcd6436dcdbb6acb P 5bf5756645814013af53d03500d8c725 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:10.001363 1842 raft_consensus.cc:374] T 1c94cfaf624345cdbcd6436dcdbb6acb P ce5fbef16130442fbf4dcd603d52d041 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:10.001446 1842 raft_consensus.cc:729] T 1c94cfaf624345cdbcd6436dcdbb6acb P ce5fbef16130442fbf4dcd603d52d041 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce5fbef16130442fbf4dcd603d52d041, State: Initialized, Role: FOLLOWER
I20260811 17:12:10.001446 1841 raft_consensus.cc:729] T 1c94cfaf624345cdbcd6436dcdbb6acb P 5bf5756645814013af53d03500d8c725 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bf5756645814013af53d03500d8c725, State: Initialized, Role: FOLLOWER
I20260811 17:12:10.002017 1842 consensus_queue.cc:260] T 1c94cfaf624345cdbcd6436dcdbb6acb P ce5fbef16130442fbf4dcd603d52d041 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } }
I20260811 17:12:10.002017 1841 consensus_queue.cc:260] T 1c94cfaf624345cdbcd6436dcdbb6acb P 5bf5756645814013af53d03500d8c725 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } }
I20260811 17:12:10.002913 1565 heartbeater.cc:503] Master 127.4.146.254:40985 was elected leader, sending a full tablet report...
I20260811 17:12:10.003167 1812 heartbeater.cc:503] Master 127.4.146.254:40985 was elected leader, sending a full tablet report...
I20260811 17:12:10.003248 1842 ts_tablet_manager.cc:1428] T 1c94cfaf624345cdbcd6436dcdbb6acb P ce5fbef16130442fbf4dcd603d52d041: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260811 17:12:10.004276 1841 ts_tablet_manager.cc:1428] T 1c94cfaf624345cdbcd6436dcdbb6acb P 5bf5756645814013af53d03500d8c725: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260811 17:12:10.074715 1840 raft_consensus.cc:482] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:12:10.075034 1840 raft_consensus.cc:504] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } }
I20260811 17:12:10.076742 1840 leader_election.cc:288] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ce5fbef16130442fbf4dcd603d52d041 (127.4.146.195:35515), 5bf5756645814013af53d03500d8c725 (127.4.146.194:42699)
I20260811 17:12:10.082587 1834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:10.077208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:39571 (local address 127.4.146.194:42699)
0811 17:12:10.077347 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:10.077352 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:10.077813 (+ 461us) server_negotiation.cc:407] Connection header received
0811 17:12:10.078020 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:10.078025 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:10.078097 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:10.078188 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:10.078477 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:10.079101 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:10.080941 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:10.081777 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:10.081949 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:10.082037 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:10.082313 (+ 276us) server_negotiation.cc:299] Negotiation successful
0811 17:12:10.082416 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 17:12:10.082597 1852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:10.076985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:42699 (local address 127.4.146.193:39571)
0811 17:12:10.077703 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:10.077717 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:10.077855 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:10.078240 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:10.078242 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:10.078256 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:10.078348 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:10.078354 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:10.079227 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:10.079232 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:10.080777 (+ 1545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:10.080791 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:10.081951 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:10.081956 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:10.082055 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:10.082108 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 17:12:10.082288 (+ 180us) client_negotiation.cc:240] Negotiation successful
0811 17:12:10.082407 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":645,"mutex_wait_us":459,"thread_start_us":122,"threads_started":1}
I20260811 17:12:10.083530 1481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c94cfaf624345cdbcd6436dcdbb6acb" candidate_uuid: "d095952ff2e14f209629059f866ef8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bf5756645814013af53d03500d8c725" is_pre_election: true
I20260811 17:12:10.083698 1832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:10.077144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:60501 (local address 127.4.146.195:35515)
0811 17:12:10.077369 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:10.077375 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:10.077664 (+ 289us) server_negotiation.cc:407] Connection header received
0811 17:12:10.077940 (+ 276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:10.077946 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:10.078009 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:10.078096 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:10.078383 (+ 287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:10.079305 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:10.082116 (+ 2811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:10.082995 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:10.083166 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:10.083248 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:10.083458 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 17:12:10.083564 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
I20260811 17:12:10.083988 1481 raft_consensus.cc:2454] T 1c94cfaf624345cdbcd6436dcdbb6acb P 5bf5756645814013af53d03500d8c725 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d095952ff2e14f209629059f866ef8a9 in term 0.
I20260811 17:12:10.084169 1848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:10.076985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:35515 (local address 127.4.146.193:60501)
0811 17:12:10.077549 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:10.077570 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:10.077785 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:10.078120 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:10.078123 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:10.078139 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:10.078260 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:10.078267 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:10.079436 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:10.079440 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:10.080777 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:10.080791 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:10.083135 (+ 2344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:10.083142 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:10.083264 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:10.083293 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 17:12:10.083856 (+ 563us) client_negotiation.cc:240] Negotiation successful
0811 17:12:10.083960 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"mutex_wait_us":82,"thread_start_us":120,"threads_started":1}
I20260811 17:12:10.084648 1066 leader_election.cc:302] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bf5756645814013af53d03500d8c725, d095952ff2e14f209629059f866ef8a9; no voters:
I20260811 17:12:10.085045 1840 raft_consensus.cc:2781] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:12:10.085041 1724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c94cfaf624345cdbcd6436dcdbb6acb" candidate_uuid: "d095952ff2e14f209629059f866ef8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce5fbef16130442fbf4dcd603d52d041" is_pre_election: true
I20260811 17:12:10.085170 1840 raft_consensus.cc:482] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:12:10.085225 1840 raft_consensus.cc:3037] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:10.085388 1724 raft_consensus.cc:2454] T 1c94cfaf624345cdbcd6436dcdbb6acb P ce5fbef16130442fbf4dcd603d52d041 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d095952ff2e14f209629059f866ef8a9 in term 0.
I20260811 17:12:10.086592 1840 raft_consensus.cc:504] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } }
I20260811 17:12:10.087004 1840 leader_election.cc:288] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [CANDIDATE]: Term 1 election: Requested vote from peers ce5fbef16130442fbf4dcd603d52d041 (127.4.146.195:35515), 5bf5756645814013af53d03500d8c725 (127.4.146.194:42699)
I20260811 17:12:10.087370 1724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c94cfaf624345cdbcd6436dcdbb6acb" candidate_uuid: "d095952ff2e14f209629059f866ef8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce5fbef16130442fbf4dcd603d52d041"
I20260811 17:12:10.087495 1481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c94cfaf624345cdbcd6436dcdbb6acb" candidate_uuid: "d095952ff2e14f209629059f866ef8a9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bf5756645814013af53d03500d8c725"
I20260811 17:12:10.087530 1724 raft_consensus.cc:3037] T 1c94cfaf624345cdbcd6436dcdbb6acb P ce5fbef16130442fbf4dcd603d52d041 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:10.087646 1481 raft_consensus.cc:3037] T 1c94cfaf624345cdbcd6436dcdbb6acb P 5bf5756645814013af53d03500d8c725 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:10.089143 1481 raft_consensus.cc:2454] T 1c94cfaf624345cdbcd6436dcdbb6acb P 5bf5756645814013af53d03500d8c725 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d095952ff2e14f209629059f866ef8a9 in term 1.
I20260811 17:12:10.089143 1724 raft_consensus.cc:2454] T 1c94cfaf624345cdbcd6436dcdbb6acb P ce5fbef16130442fbf4dcd603d52d041 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d095952ff2e14f209629059f866ef8a9 in term 1.
I20260811 17:12:10.089534 1065 leader_election.cc:302] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ce5fbef16130442fbf4dcd603d52d041, d095952ff2e14f209629059f866ef8a9; no voters:
I20260811 17:12:10.089762 1840 raft_consensus.cc:2781] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:12:10.090101 1840 raft_consensus.cc:686] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 1 LEADER]: Becoming Leader. State: Replica: d095952ff2e14f209629059f866ef8a9, State: Running, Role: LEADER
I20260811 17:12:10.090456 1840 consensus_queue.cc:237] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } }
I20260811 17:12:10.094575 937 catalog_manager.cc:5495] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 reported cstate change: term changed from 0 to 1, leader changed from <none> to d095952ff2e14f209629059f866ef8a9 (127.4.146.193). New cstate: current_term: 1 leader_uuid: "d095952ff2e14f209629059f866ef8a9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } health_report { overall_health: HEALTHY } } }
I20260811 17:12:10.135715 1859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:10.130943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35124 (local address 127.4.146.193:32977)
0811 17:12:10.131335 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:10.131341 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:10.131357 (+ 16us) server_negotiation.cc:407] Connection header received
0811 17:12:10.131441 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:10.131443 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:10.131500 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:10.131685 (+ 185us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:12:10.132405 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:10.132965 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:10.133867 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:10.134154 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:10.134276 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:10.134584 (+ 308us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:12:10.135085 (+ 501us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:12:10.135245 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:10.135422 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 17:12:10.135489 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":162,"threads_started":1}
I20260811 17:12:10.142284 1724 raft_consensus.cc:1261] T 1c94cfaf624345cdbcd6436dcdbb6acb P ce5fbef16130442fbf4dcd603d52d041 [term 1 FOLLOWER]: Refusing update from remote peer d095952ff2e14f209629059f866ef8a9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:12:10.142410 1481 raft_consensus.cc:1261] T 1c94cfaf624345cdbcd6436dcdbb6acb P 5bf5756645814013af53d03500d8c725 [term 1 FOLLOWER]: Refusing update from remote peer d095952ff2e14f209629059f866ef8a9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:12:10.143332 1853 consensus_queue.cc:1035] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:12:10.143625 1840 consensus_queue.cc:1035] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:12:10.151036 1861 mvcc.cc:205] Tried to move back new op lower bound from 7317374280253313024 to 7317374280053706752. Current Snapshot: MvccSnapshot[applied={T|T < 7317374280253313024}]
W20260811 17:12:10.155479 1814 tablet.cc:2369] T 1c94cfaf624345cdbcd6436dcdbb6acb P ce5fbef16130442fbf4dcd603d52d041: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 17:12:10.155666 1863 mvcc.cc:205] Tried to move back new op lower bound from 7317374280253313024 to 7317374280053706752. Current Snapshot: MvccSnapshot[applied={T|T < 7317374280253313024 or (T in {7317374280253313024})}]
I20260811 17:12:10.170231 937 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44568:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:12:10.170475 937 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44568:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:12:10.176308 1864 mvcc.cc:205] Tried to move back new op lower bound from 7317374280253313024 to 7317374280053706752. Current Snapshot: MvccSnapshot[applied={T|T < 7317374280253313024 or (T in {7317374280253313024})}]
I20260811 17:12:10.176375 937 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c: Sending DeleteTablet for 3 replicas of tablet 1c94cfaf624345cdbcd6436dcdbb6acb
I20260811 17:12:10.177297 1691 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c94cfaf624345cdbcd6436dcdbb6acb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:12:10 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:35292
I20260811 17:12:10.178565 1443 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c94cfaf624345cdbcd6436dcdbb6acb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:12:10 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:60016
I20260811 17:12:10.179621 1153 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c94cfaf624345cdbcd6436dcdbb6acb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:12:10 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:35120
I20260811 17:12:10.180692 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 999
I20260811 17:12:10.197250 1877 tablet_replica.cc:330] T 1c94cfaf624345cdbcd6436dcdbb6acb P 5bf5756645814013af53d03500d8c725: stopping tablet replica
I20260811 17:12:10.197299 1875 tablet_replica.cc:330] T 1c94cfaf624345cdbcd6436dcdbb6acb P ce5fbef16130442fbf4dcd603d52d041: stopping tablet replica
I20260811 17:12:10.197764 1877 raft_consensus.cc:2229] T 1c94cfaf624345cdbcd6436dcdbb6acb P 5bf5756645814013af53d03500d8c725 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:12:10.197763 1875 raft_consensus.cc:2229] T 1c94cfaf624345cdbcd6436dcdbb6acb P ce5fbef16130442fbf4dcd603d52d041 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:12:10.198282 1875 raft_consensus.cc:2258] T 1c94cfaf624345cdbcd6436dcdbb6acb P ce5fbef16130442fbf4dcd603d52d041 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:12:10.198282 1877 raft_consensus.cc:2258] T 1c94cfaf624345cdbcd6436dcdbb6acb P 5bf5756645814013af53d03500d8c725 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:12:10.200273 1877 ts_tablet_manager.cc:1905] T 1c94cfaf624345cdbcd6436dcdbb6acb P 5bf5756645814013af53d03500d8c725: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:12:10.200523 1875 ts_tablet_manager.cc:1905] T 1c94cfaf624345cdbcd6436dcdbb6acb P ce5fbef16130442fbf4dcd603d52d041: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:12:10.203749 1877 ts_tablet_manager.cc:1918] T 1c94cfaf624345cdbcd6436dcdbb6acb P 5bf5756645814013af53d03500d8c725: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:12:10.203749 1875 ts_tablet_manager.cc:1918] T 1c94cfaf624345cdbcd6436dcdbb6acb P ce5fbef16130442fbf4dcd603d52d041: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:12:10.203909 1877 log.cc:1196] T 1c94cfaf624345cdbcd6436dcdbb6acb P 5bf5756645814013af53d03500d8c725: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/wal/wals/1c94cfaf624345cdbcd6436dcdbb6acb
I20260811 17:12:10.203909 1875 log.cc:1196] T 1c94cfaf624345cdbcd6436dcdbb6acb P ce5fbef16130442fbf4dcd603d52d041: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/1c94cfaf624345cdbcd6436dcdbb6acb
I20260811 17:12:10.204371 1875 ts_tablet_manager.cc:1939] T 1c94cfaf624345cdbcd6436dcdbb6acb P ce5fbef16130442fbf4dcd603d52d041: Deleting consensus metadata
I20260811 17:12:10.204372 1877 ts_tablet_manager.cc:1939] T 1c94cfaf624345cdbcd6436dcdbb6acb P 5bf5756645814013af53d03500d8c725: Deleting consensus metadata
I20260811 17:12:10.204967 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 1288
W20260811 17:12:10.210911 910 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.146.193:32977 (error 108)
I20260811 17:12:10.216391 910 catalog_manager.cc:4841] TS ce5fbef16130442fbf4dcd603d52d041 (127.4.146.195:35515): tablet 1c94cfaf624345cdbcd6436dcdbb6acb (table test-table [id=9c88bb64f599461a84b5683f211a5ab6]) successfully deleted
I20260811 17:12:10.220691 1831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:10.220071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:32977 (local address 127.0.0.1:35132)
0811 17:12:10.220421 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:10.220550 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.193:32977: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217}
W20260811 17:12:10.221247 910 catalog_manager.cc:4584] TS d095952ff2e14f209629059f866ef8a9 (127.4.146.193:32977): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1c94cfaf624345cdbcd6436dcdbb6acb: Network error: Client connection negotiation failed: client connection to 127.4.146.193:32977: connect: Connection refused (error 111)
I20260811 17:12:10.227510 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 1569
I20260811 17:12:10.228891 1831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:10.228475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:42699 (local address 127.0.0.1:60022)
0811 17:12:10.228717 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:10.228780 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.194:42699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
I20260811 17:12:10.243155 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 872
I20260811 17:12:30.265162 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:40985
--webserver_interface=127.4.146.254
--webserver_port=34763
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:40985
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:12:30.394587 1883 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:30.394899 1883 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:30.394942 1883 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:30.399150 1883 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 17:12:30.399217 1883 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 17:12:30.399233 1883 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 17:12:30.399248 1883 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:12:30.399291 1883 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:30.399326 1883 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:30.399359 1883 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:12:30.399400 1883 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:12:30.405112 1883 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:40985
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:40985
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=34763
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1883
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:30.406315 1883 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:30.407431 1883 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:30.417502 1892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:30.417549 1883 server_base.cc:1034] running on GCE node
W20260811 17:12:30.417495 1891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:30.417503 1895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:30.418555 1883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:30.419828 1883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:30.421145 1883 hybrid_clock.cc:648] HybridClock initialized: now 1786468350421094 us; error 65 us; skew 500 ppm
Aug 11 17:12:30 dist-test-slave-7vjv krb5kdc[32310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468350, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:12:30.424507 1883 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:12:30.425617 1883 webserver.cc:460] Webserver started at http://127.4.146.254:34763/ using document root <none> and password file <none>
I20260811 17:12:30.426246 1883 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:30.426350 1883 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:30.430788 1883 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 17:12:30.433418 1918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:30.434898 1883 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:12:30.435097 1883 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "cf33be911cfb49fb834a6bc618ccf62c"
format_stamp: "Formatted at 2026-08-11 17:11:47 on dist-test-slave-7vjv"
server_key: "1a6e986481a2c4fb90181d6c64ead87a"
server_key_iv: "1960b77ee957da7e337c14312fdb6e3e"
server_key_version: "encryptionkey@0"
I20260811 17:12:30.435738 1883 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:30.459067 1883 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:30.462585 1883 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:30.462874 1883 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:30.470805 1883 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:40985
I20260811 17:12:30.471135 2003 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:40985 every 8 connection(s)
I20260811 17:12:30.471992 1883 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:12:30.475333 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 1883
I20260811 17:12:30.475888 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:32977
--local_ip_for_outbound_sockets=127.4.146.193
--tserver_master_addrs=127.4.146.254:40985
--webserver_port=36519
--webserver_interface=127.4.146.193
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 17:12:30.477136 2006 sys_catalog.cc:263] Verifying existing consensus state
I20260811 17:12:30.479523 2006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c: Bootstrap starting.
I20260811 17:12:30.498683 2006 log.cc:824] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:30.510408 2006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 17:12:30.510862 2006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c: Bootstrap complete.
I20260811 17:12:30.515100 2006 raft_consensus.cc:348] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf33be911cfb49fb834a6bc618ccf62c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40985 } }
I20260811 17:12:30.515501 2006 raft_consensus.cc:729] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf33be911cfb49fb834a6bc618ccf62c, State: Initialized, Role: FOLLOWER
I20260811 17:12:30.516007 2006 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf33be911cfb49fb834a6bc618ccf62c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40985 } }
I20260811 17:12:30.516206 2006 raft_consensus.cc:388] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:12:30.516283 2006 raft_consensus.cc:482] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:12:30.516390 2006 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [term 2 FOLLOWER]: Advancing to term 3
I20260811 17:12:30.518499 2006 raft_consensus.cc:504] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf33be911cfb49fb834a6bc618ccf62c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40985 } }
I20260811 17:12:30.518853 2006 leader_election.cc:302] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cf33be911cfb49fb834a6bc618ccf62c; no voters:
I20260811 17:12:30.519214 2006 leader_election.cc:288] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 17:12:30.519305 2017 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [term 3 FOLLOWER]: Leader election won for term 3
I20260811 17:12:30.519538 2017 raft_consensus.cc:686] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [term 3 LEADER]: Becoming Leader. State: Replica: cf33be911cfb49fb834a6bc618ccf62c, State: Running, Role: LEADER
I20260811 17:12:30.519863 2017 consensus_queue.cc:237] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf33be911cfb49fb834a6bc618ccf62c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40985 } }
I20260811 17:12:30.520596 2006 sys_catalog.cc:564] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:12:30.521297 2019 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "cf33be911cfb49fb834a6bc618ccf62c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf33be911cfb49fb834a6bc618ccf62c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40985 } } }
I20260811 17:12:30.521428 2019 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [sys.catalog]: This master's current role is: LEADER
I20260811 17:12:30.522109 2020 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf33be911cfb49fb834a6bc618ccf62c. Latest consensus state: current_term: 3 leader_uuid: "cf33be911cfb49fb834a6bc618ccf62c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cf33be911cfb49fb834a6bc618ccf62c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40985 } } }
I20260811 17:12:30.522287 2020 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c [sys.catalog]: This master's current role is: LEADER
I20260811 17:12:30.522735 2026 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:12:30.528260 2026 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:12:30.528968 2026 catalog_manager.cc:1259] Loaded cluster ID: ffcb8416fea24c4aaef0d59b3373a2dc
I20260811 17:12:30.529042 2026 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:12:30.531723 2026 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:12:30.532577 2026 catalog_manager.cc:5879] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c: Loaded TSK: 0
I20260811 17:12:30.532689 2026 catalog_manager.cc:5879] T 00000000000000000000000000000000 P cf33be911cfb49fb834a6bc618ccf62c: Loaded TSK: 1
F20260811 17:12:30.533595 2026 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7ffb36d599ad google::LogMessage::Fail() at ??:0
@ 0x7ffb36d5c88a google::LogMessage::SendToLog() at ??:0
@ 0x7ffb36d594de google::LogMessage::Flush() at ??:0
@ 0x7ffb36d5aa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7ffb39a1d18d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7ffb39a15f0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7ffb416be7bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7ffb4169899c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7ffb41699178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7ffb416dadf8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7ffb416f982b std::function<>::operator()() at ??:0
@ 0x7ffb41698b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7ffb41699f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7ffb41696579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7ffb416da640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7ffb38fab3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7ffb38fabc83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7ffb38fad3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7ffb38f9c512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7ffb3a5e06db start_thread at ??:0
@ 0x7ffb3585761f clone at ??:0
W20260811 17:12:30.642575 2009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:30.642861 2009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:30.642907 2009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:30.647284 2009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:30.647360 2009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:30.647423 2009 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:12:30.653319 2009 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:32977
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=36519
--tserver_master_addrs=127.4.146.254:40985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2009
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:30.654568 2009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:30.655682 2009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:30.666205 2094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:30.666206 2093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:30.666405 2009 server_base.cc:1034] running on GCE node
W20260811 17:12:30.666616 2098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:30.667070 2009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:30.667802 2009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:30.669005 2009 hybrid_clock.cc:648] HybridClock initialized: now 1786468350668985 us; error 38 us; skew 500 ppm
Aug 11 17:12:30 dist-test-slave-7vjv krb5kdc[32310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468350, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:12:30.672022 2009 init.cc:377] Logged in from keytab as kudu/127.4.146.193@KRBTEST.COM (short username kudu)
I20260811 17:12:30.673112 2009 webserver.cc:460] Webserver started at http://127.4.146.193:36519/ using document root <none> and password file <none>
I20260811 17:12:30.673738 2009 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:30.673807 2009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:30.678233 2009 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 17:12:30.680701 2115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:30.682130 2009 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:12:30.682293 2009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "d095952ff2e14f209629059f866ef8a9"
format_stamp: "Formatted at 2026-08-11 17:11:47 on dist-test-slave-7vjv"
server_key: "72ebaae51a7c21c4198e168d99e96751"
server_key_iv: "6dcbb9dca2de8c1c31707b6ae3169917"
server_key_version: "encryptionkey@0"
I20260811 17:12:30.682883 2009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:30.714146 2009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:30.717895 2009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:30.718137 2009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:30.718917 2009 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:12:30.720238 2127 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 17:12:30.726563 2009 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 17:12:30.726704 2009 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.007s user 0.000s sys 0.000s
I20260811 17:12:30.726820 2009 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 17:12:30.729012 2009 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 17:12:30.729106 2009 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.002s sys 0.000s
I20260811 17:12:30.729425 2127 tablet_bootstrap.cc:492] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9: Bootstrap starting.
I20260811 17:12:30.741882 2009 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:32977
I20260811 17:12:30.742218 2349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:32977 every 8 connection(s)
I20260811 17:12:30.743152 2009 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:12:30.746052 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 2009
I20260811 17:12:30.746676 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:42699
--local_ip_for_outbound_sockets=127.4.146.194
--tserver_master_addrs=127.4.146.254:40985
--webserver_port=39093
--webserver_interface=127.4.146.194
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 17:12:30.755584 2127 log.cc:824] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:30.763209 2127 tablet_bootstrap.cc:492] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 17:12:30.763700 2127 tablet_bootstrap.cc:492] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9: Bootstrap complete.
I20260811 17:12:30.765096 2127 ts_tablet_manager.cc:1397] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9: Time spent bootstrapping tablet: real 0.036s user 0.021s sys 0.011s
I20260811 17:12:30.767663 2127 raft_consensus.cc:348] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } }
I20260811 17:12:30.768174 2127 raft_consensus.cc:729] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d095952ff2e14f209629059f866ef8a9, State: Initialized, Role: FOLLOWER
I20260811 17:12:30.768713 2127 consensus_queue.cc:260] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } }
I20260811 17:12:30.769763 2127 ts_tablet_manager.cc:1428] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
W20260811 17:12:30.803892 2354 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:12:30.745492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.193:36233)
0811 17:12:30.746897 (+ 1405us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:30.746991 (+ 94us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:30.748416 (+ 1425us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:30.803043 (+ 54627us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1127,"thread_start_us":170,"threads_started":1}
W20260811 17:12:30.804489 2352 heartbeater.cc:644] Failed to heartbeat to 127.4.146.254:40985 (0 consecutive failures): Network error: Failed to ping master at 127.4.146.254:40985: Client connection negotiation failed: client connection to 127.4.146.254:40985: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 17:12:30.805445 2354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:30.805150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.193:57285)
0811 17:12:30.805290 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:30.805361 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 17:12:30.806190 2354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:30.805991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.193:36629)
0811 17:12:30.806090 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:30.806133 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 17:12:30.806376 2352 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 17:12:30.886744 2355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:30.887105 2355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:30.887210 2355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:30.891450 2355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:30.891534 2355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:30.891601 2355 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:12:30.897133 2355 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:42699
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=39093
--tserver_master_addrs=127.4.146.254:40985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2355
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:30.898468 2355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:30.899602 2355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:30.909988 2373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:30.909992 2369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:30.910064 2355 server_base.cc:1034] running on GCE node
W20260811 17:12:30.909992 2370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:30.910925 2355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:30.911679 2355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:30.912879 2355 hybrid_clock.cc:648] HybridClock initialized: now 1786468350912866 us; error 34 us; skew 500 ppm
Aug 11 17:12:30 dist-test-slave-7vjv krb5kdc[32310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468350, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:12:30.915874 2355 init.cc:377] Logged in from keytab as kudu/127.4.146.194@KRBTEST.COM (short username kudu)
I20260811 17:12:30.916817 2355 webserver.cc:460] Webserver started at http://127.4.146.194:39093/ using document root <none> and password file <none>
I20260811 17:12:30.917389 2355 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:30.917454 2355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:30.921659 2355 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 17:12:30.923842 2381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:30.925262 2355 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:12:30.925400 2355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "5bf5756645814013af53d03500d8c725"
format_stamp: "Formatted at 2026-08-11 17:11:48 on dist-test-slave-7vjv"
server_key: "62ec46be4a9b222486c37d8d2247f46e"
server_key_iv: "23252806c2ffd08f105ac7f1bdddef35"
server_key_version: "encryptionkey@0"
I20260811 17:12:30.925987 2355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:30.941838 2355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:30.945132 2355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:30.945297 2355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:30.945849 2355 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:12:30.946667 2355 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:12:30.946717 2355 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:30.946759 2355 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:12:30.946774 2355 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:30.956264 2355 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:42699
I20260811 17:12:30.956346 2606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:42699 every 8 connection(s)
I20260811 17:12:30.957377 2355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:12:30.958563 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 2355
I20260811 17:12:30.959120 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:35515
--local_ip_for_outbound_sockets=127.4.146.195
--tserver_master_addrs=127.4.146.254:40985
--webserver_port=44545
--webserver_interface=127.4.146.195
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 17:12:30.962325 2609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:30.960015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.194:35029)
0811 17:12:30.960639 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:30.960809 (+ 170us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":130,"threads_started":1}
W20260811 17:12:30.962945 2607 heartbeater.cc:644] Failed to heartbeat to 127.4.146.254:40985 (0 consecutive failures): Network error: Failed to ping master at 127.4.146.254:40985: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
I20260811 17:12:30.963685 2609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:30.963423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.194:51221)
0811 17:12:30.963551 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:30.963609 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 17:12:30.964646 2609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:30.964299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.194:54049)
0811 17:12:30.964487 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:30.964555 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260811 17:12:30.964920 2607 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 17:12:31.080269 2611 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:31.080587 2611 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:31.080634 2611 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:31.084852 2611 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:31.084934 2611 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:31.085033 2611 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:12:31.090863 2611 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:35515
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=44545
--tserver_master_addrs=127.4.146.254:40985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2611
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:31.092134 2611 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:31.093274 2611 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:31.104043 2617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:31.104053 2621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:31.104066 2625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:31.104550 2611 server_base.cc:1034] running on GCE node
I20260811 17:12:31.105088 2611 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:31.105886 2611 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:31.107084 2611 hybrid_clock.cc:648] HybridClock initialized: now 1786468351107065 us; error 40 us; skew 500 ppm
Aug 11 17:12:31 dist-test-slave-7vjv krb5kdc[32310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468351, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:12:31.110221 2611 init.cc:377] Logged in from keytab as kudu/127.4.146.195@KRBTEST.COM (short username kudu)
I20260811 17:12:31.111343 2611 webserver.cc:460] Webserver started at http://127.4.146.195:44545/ using document root <none> and password file <none>
I20260811 17:12:31.111991 2611 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:31.112066 2611 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:31.116479 2611 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:12:31.118897 2639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:31.120491 2611 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:12:31.120632 2611 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "ce5fbef16130442fbf4dcd603d52d041"
format_stamp: "Formatted at 2026-08-11 17:11:48 on dist-test-slave-7vjv"
server_key: "7697cfa7ccda754bedcc6d6056506e8c"
server_key_iv: "78b3fe0b88cb9869ccf38bf6defc15e6"
server_key_version: "encryptionkey@0"
I20260811 17:12:31.121246 2611 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:31.143206 2611 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:31.147218 2611 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:31.147460 2611 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:31.148221 2611 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:12:31.149214 2611 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:12:31.149266 2611 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:31.149338 2611 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:12:31.149371 2611 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:31.160893 2611 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:35515
I20260811 17:12:31.160915 2846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:35515 every 8 connection(s)
I20260811 17:12:31.162127 2611 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:12:31.166916 2850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:31.164746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.195:44411)
0811 17:12:31.165451 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:31.165589 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":147,"threads_started":1}
W20260811 17:12:31.167486 2847 heartbeater.cc:644] Failed to heartbeat to 127.4.146.254:40985 (0 consecutive failures): Network error: Failed to ping master at 127.4.146.254:40985: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
I20260811 17:12:31.168318 2850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:31.168006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.195:40195)
0811 17:12:31.168190 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:31.168253 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260811 17:12:31.168835 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 2611
I20260811 17:12:31.169099 2850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:31.168837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.195:50905)
0811 17:12:31.168996 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:31.169045 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 17:12:31.169330 2847 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 17:12:31.807711 2855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:31.807150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.193:51675)
0811 17:12:31.807524 (+ 374us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:31.807592 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":98,"threads_started":1}
I20260811 17:12:31.966064 2858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:31.965602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.194:51341)
0811 17:12:31.965887 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:31.965949 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":97,"threads_started":1}
I20260811 17:12:31.980615 2859 raft_consensus.cc:482] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:12:31.980918 2859 raft_consensus.cc:504] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } }
I20260811 17:12:31.982170 2859 leader_election.cc:288] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce5fbef16130442fbf4dcd603d52d041 (127.4.146.195:35515), 5bf5756645814013af53d03500d8c725 (127.4.146.194:42699)
Aug 11 17:12:31 dist-test-slave-7vjv krb5kdc[32310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468350, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for kudu/127.4.146.195@KRBTEST.COM
Aug 11 17:12:31 dist-test-slave-7vjv krb5kdc[32310](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468350, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for kudu/127.4.146.194@KRBTEST.COM
I20260811 17:12:32.000394 2861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:31.982729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:41933 (local address 127.4.146.195:35515)
0811 17:12:31.983137 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:31.983154 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:31.983208 (+ 54us) server_negotiation.cc:407] Connection header received
0811 17:12:31.984242 (+ 1034us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:31.984254 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:31.984788 (+ 534us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:31.985180 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:31.987278 (+ 2098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:31.988619 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:31.990230 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:31.990955 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:31.991095 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:31.994390 (+ 3295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:31.994395 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:31.994410 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:12:31.994445 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:31.997173 (+ 2728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:31.998098 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:31.998105 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:31.998111 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:31.998249 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:31.998636 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:31.998639 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:31.998641 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:31.999083 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:31.999268 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:31.999884 (+ 616us) server_negotiation.cc:299] Negotiation successful
0811 17:12:32.000199 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":148,"threads_started":1}
I20260811 17:12:32.000379 2860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:31.982510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:42699 (local address 127.4.146.193:42265)
0811 17:12:31.983018 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:31.983033 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:31.983144 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:31.985316 (+ 2172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:31.985324 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:31.986065 (+ 741us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:12:31.987046 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:31.987071 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:31.989826 (+ 2755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:31.989829 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:31.990577 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:31.990590 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:31.991442 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:31.991445 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:31.991515 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:31.992195 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:12:31.992225 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:12:31.994425 (+ 2200us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:12:31.997282 (+ 2857us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:31.997290 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:31.997306 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:31.997870 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:31.998337 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:31.998340 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:31.998342 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:31.998500 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:31.999250 (+ 750us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:12:31.999257 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:12:31.999527 (+ 270us) client_negotiation.cc:769] Sending connection context
0811 17:12:31.999751 (+ 224us) client_negotiation.cc:240] Negotiation successful
0811 17:12:32.000163 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"mutex_wait_us":302,"spinlock_wait_cycles":44672,"thread_start_us":86,"threads_started":1}
I20260811 17:12:32.000411 2855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:31.982510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:35515 (local address 127.4.146.193:41933)
0811 17:12:31.982690 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:31.982711 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:31.982841 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:31.985316 (+ 2475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:31.985324 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:31.986065 (+ 741us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:12:31.987046 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:31.987071 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:31.988820 (+ 1749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:31.988824 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:31.990065 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:31.990077 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:31.991094 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:31.991098 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:31.991340 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:31.992233 (+ 893us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:12:31.992246 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:12:31.994093 (+ 1847us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:12:31.997298 (+ 3205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:31.997300 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:31.997306 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:31.997870 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:31.998393 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:31.998395 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:31.998397 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:31.998508 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:31.999262 (+ 754us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:12:31.999266 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:12:31.999524 (+ 258us) client_negotiation.cc:769] Sending connection context
0811 17:12:31.999751 (+ 227us) client_negotiation.cc:240] Negotiation successful
0811 17:12:32.000237 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62,"mutex_wait_us":353,"spinlock_wait_cycles":31488}
I20260811 17:12:32.000427 2862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:31.982821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:42265 (local address 127.4.146.194:42699)
0811 17:12:31.983292 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:31.983317 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:31.983352 (+ 35us) server_negotiation.cc:407] Connection header received
0811 17:12:31.984303 (+ 951us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:31.984310 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:31.984788 (+ 478us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:31.985180 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:31.988256 (+ 3076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:31.989602 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:31.990732 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:31.991308 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:31.991484 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:31.994654 (+ 3170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:31.994660 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:31.994673 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:12:31.994707 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:31.997099 (+ 2392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:31.998035 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:31.998043 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:31.998049 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:31.998211 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:31.998608 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:31.998614 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:31.998618 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:31.999083 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:31.999259 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:31.999897 (+ 638us) server_negotiation.cc:299] Negotiation successful
0811 17:12:32.000229 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":129,"threads_started":1}
W20260811 17:12:32.003294 2117 leader_election.cc:341] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ce5fbef16130442fbf4dcd603d52d041 (127.4.146.195:35515): Not found: Tablet not found: 1c94cfaf624345cdbcd6436dcdbb6acb
W20260811 17:12:32.003472 2118 leader_election.cc:341] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5bf5756645814013af53d03500d8c725 (127.4.146.194:42699): Not found: Tablet not found: 1c94cfaf624345cdbcd6436dcdbb6acb
I20260811 17:12:32.003595 2118 leader_election.cc:302] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d095952ff2e14f209629059f866ef8a9; no voters: 5bf5756645814013af53d03500d8c725, ce5fbef16130442fbf4dcd603d52d041
I20260811 17:12:32.003894 2859 raft_consensus.cc:2726] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 17:12:32.170486 2864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:32.169960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.195:60329)
0811 17:12:32.170300 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:32.170371 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":100,"threads_started":1}
I20260811 17:12:32.809222 2865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:32.808724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.193:57679)
0811 17:12:32.809033 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:32.809100 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":85,"threads_started":1}
I20260811 17:12:32.967394 2866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:32.966912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.194:42929)
0811 17:12:32.967220 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:32.967288 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":83,"threads_started":1}
I20260811 17:12:33.171945 2868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:33.171454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.195:41725)
0811 17:12:33.171749 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:33.171819 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":90,"threads_started":1}
I20260811 17:12:33.810634 2870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:33.810133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.193:36695)
0811 17:12:33.810463 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:33.810522 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":97,"threads_started":1}
I20260811 17:12:33.968789 2871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:33.968342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.194:40573)
0811 17:12:33.968613 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:33.968684 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":82,"threads_started":1}
I20260811 17:12:34.027374 2872 raft_consensus.cc:482] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:12:34.027673 2872 raft_consensus.cc:504] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } }
I20260811 17:12:34.028296 2872 leader_election.cc:288] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce5fbef16130442fbf4dcd603d52d041 (127.4.146.195:35515), 5bf5756645814013af53d03500d8c725 (127.4.146.194:42699)
W20260811 17:12:34.029297 2118 leader_election.cc:341] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5bf5756645814013af53d03500d8c725 (127.4.146.194:42699): Not found: Tablet not found: 1c94cfaf624345cdbcd6436dcdbb6acb
W20260811 17:12:34.029420 2117 leader_election.cc:341] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ce5fbef16130442fbf4dcd603d52d041 (127.4.146.195:35515): Not found: Tablet not found: 1c94cfaf624345cdbcd6436dcdbb6acb
I20260811 17:12:34.029618 2117 leader_election.cc:302] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d095952ff2e14f209629059f866ef8a9; no voters: 5bf5756645814013af53d03500d8c725, ce5fbef16130442fbf4dcd603d52d041
I20260811 17:12:34.029809 2872 raft_consensus.cc:2726] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 17:12:34.173434 2873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:34.172968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.195:36093)
0811 17:12:34.173261 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:34.173330 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":85,"threads_started":1}
I20260811 17:12:34.812036 2875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:34.811607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.193:48041)
0811 17:12:34.811875 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:34.811936 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":80,"threads_started":1}
I20260811 17:12:34.970259 2876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:34.969752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.194:47271)
0811 17:12:34.970082 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:34.970155 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":94,"threads_started":1}
I20260811 17:12:35.174844 2877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:35.174383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.195:37757)
0811 17:12:35.174647 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:35.174722 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":103,"threads_started":1}
I20260811 17:12:35.813772 2879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:35.813232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.193:40473)
0811 17:12:35.813595 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:35.813661 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":95,"threads_started":1}
I20260811 17:12:35.971787 2881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:35.971253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.194:52469)
0811 17:12:35.971603 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:35.971679 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":104,"threads_started":1}
I20260811 17:12:36.176259 2889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:36.175726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.195:54127)
0811 17:12:36.176025 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:36.176090 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":86,"threads_started":1}
I20260811 17:12:36.728314 2890 raft_consensus.cc:482] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:12:36.728494 2890 raft_consensus.cc:504] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } }
I20260811 17:12:36.729130 2890 leader_election.cc:288] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce5fbef16130442fbf4dcd603d52d041 (127.4.146.195:35515), 5bf5756645814013af53d03500d8c725 (127.4.146.194:42699)
W20260811 17:12:36.730048 2117 leader_election.cc:341] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ce5fbef16130442fbf4dcd603d52d041 (127.4.146.195:35515): Not found: Tablet not found: 1c94cfaf624345cdbcd6436dcdbb6acb
W20260811 17:12:36.730190 2118 leader_election.cc:341] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5bf5756645814013af53d03500d8c725 (127.4.146.194:42699): Not found: Tablet not found: 1c94cfaf624345cdbcd6436dcdbb6acb
I20260811 17:12:36.730293 2118 leader_election.cc:302] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d095952ff2e14f209629059f866ef8a9; no voters: 5bf5756645814013af53d03500d8c725, ce5fbef16130442fbf4dcd603d52d041
I20260811 17:12:36.730508 2890 raft_consensus.cc:2726] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 17:12:36.815153 2891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:36.814663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.193:54397)
0811 17:12:36.814954 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:36.815048 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":100,"threads_started":1}
I20260811 17:12:36.973169 2893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:36.972744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.194:34509)
0811 17:12:36.972999 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:36.973066 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":80,"threads_started":1}
I20260811 17:12:37.177726 2894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:37.177235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.195:42437)
0811 17:12:37.177558 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:37.177623 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":89,"threads_started":1}
I20260811 17:12:37.816785 2896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:37.816254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.193:58921)
0811 17:12:37.816583 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:37.816677 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":80,"threads_started":1}
I20260811 17:12:37.974822 2897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:37.974234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.194:54363)
0811 17:12:37.974632 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:37.974707 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":95,"threads_started":1}
I20260811 17:12:38.179317 2898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:38.178780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.195:59191)
0811 17:12:38.179120 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:38.179212 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":85,"threads_started":1}
I20260811 17:12:38.818285 2902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:38.817787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.193:45167)
0811 17:12:38.818102 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:38.818175 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":83,"threads_started":1}
I20260811 17:12:38.976418 2903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:38.975842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.194:37915)
0811 17:12:38.976244 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:38.976314 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":85,"threads_started":1}
I20260811 17:12:39.180943 2904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:39.180406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.195:36699)
0811 17:12:39.180758 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:39.180832 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":93,"threads_started":1}
I20260811 17:12:39.819710 2905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:39.819188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.193:45177)
0811 17:12:39.819507 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:39.819573 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":94,"threads_started":1}
I20260811 17:12:39.977929 2906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:39.977409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.194:50871)
0811 17:12:39.977762 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:39.977827 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":91,"threads_started":1}
I20260811 17:12:40.182415 2907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:40.181952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.195:57867)
0811 17:12:40.182242 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:40.182310 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":87,"threads_started":1}
I20260811 17:12:40.638019 2908 raft_consensus.cc:482] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:12:40.638172 2908 raft_consensus.cc:504] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } }
I20260811 17:12:40.638741 2908 leader_election.cc:288] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce5fbef16130442fbf4dcd603d52d041 (127.4.146.195:35515), 5bf5756645814013af53d03500d8c725 (127.4.146.194:42699)
W20260811 17:12:40.639716 2118 leader_election.cc:341] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5bf5756645814013af53d03500d8c725 (127.4.146.194:42699): Not found: Tablet not found: 1c94cfaf624345cdbcd6436dcdbb6acb
W20260811 17:12:40.639827 2117 leader_election.cc:341] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ce5fbef16130442fbf4dcd603d52d041 (127.4.146.195:35515): Not found: Tablet not found: 1c94cfaf624345cdbcd6436dcdbb6acb
I20260811 17:12:40.639951 2117 leader_election.cc:302] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d095952ff2e14f209629059f866ef8a9; no voters: 5bf5756645814013af53d03500d8c725, ce5fbef16130442fbf4dcd603d52d041
I20260811 17:12:40.640192 2908 raft_consensus.cc:2726] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 17:12:40.821321 2918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:40.820794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.193:42795)
0811 17:12:40.821110 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:40.821211 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":97,"threads_started":1}
I20260811 17:12:40.979440 2919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:40.978955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.194:48859)
0811 17:12:40.979273 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:40.979338 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":102,"threads_started":1}
I20260811 17:12:41.184042 2924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:41.183476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.195:60067)
0811 17:12:41.183818 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:41.183893 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":105,"threads_started":1}
I20260811 17:12:41.822597 2926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:41.822149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.193:58449)
0811 17:12:41.822432 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:41.822494 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":79,"threads_started":1}
I20260811 17:12:41.980983 2927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:41.980484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.194:36363)
0811 17:12:41.980802 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:41.980877 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":112,"threads_started":1}
I20260811 17:12:42.185472 2928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:42.184925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.195:41683)
0811 17:12:42.185273 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:42.185352 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":80,"threads_started":1}
I20260811 17:12:42.824013 2934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:42.823518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.193:42157)
0811 17:12:42.823822 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:42.823905 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":92,"threads_started":1}
I20260811 17:12:42.982437 2935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:42.981901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.194:56639)
0811 17:12:42.982257 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:42.982330 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":103,"threads_started":1}
I20260811 17:12:43.187000 2936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:43.186510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.195:46165)
0811 17:12:43.186809 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:43.186888 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":133,"threads_started":1}
I20260811 17:12:43.576530 2937 raft_consensus.cc:482] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:12:43.576756 2937 raft_consensus.cc:504] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ce5fbef16130442fbf4dcd603d52d041" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 35515 } } peers { permanent_uuid: "5bf5756645814013af53d03500d8c725" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42699 } } peers { permanent_uuid: "d095952ff2e14f209629059f866ef8a9" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 32977 } }
I20260811 17:12:43.577255 2937 leader_election.cc:288] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ce5fbef16130442fbf4dcd603d52d041 (127.4.146.195:35515), 5bf5756645814013af53d03500d8c725 (127.4.146.194:42699)
W20260811 17:12:43.578265 2117 leader_election.cc:341] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ce5fbef16130442fbf4dcd603d52d041 (127.4.146.195:35515): Not found: Tablet not found: 1c94cfaf624345cdbcd6436dcdbb6acb
W20260811 17:12:43.578500 2118 leader_election.cc:341] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5bf5756645814013af53d03500d8c725 (127.4.146.194:42699): Not found: Tablet not found: 1c94cfaf624345cdbcd6436dcdbb6acb
I20260811 17:12:43.578567 2118 leader_election.cc:302] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d095952ff2e14f209629059f866ef8a9; no voters: 5bf5756645814013af53d03500d8c725, ce5fbef16130442fbf4dcd603d52d041
I20260811 17:12:43.578774 2937 raft_consensus.cc:2726] T 1c94cfaf624345cdbcd6436dcdbb6acb P d095952ff2e14f209629059f866ef8a9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 17:12:43.825453 2938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:43.824890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.193:41783)
0811 17:12:43.825207 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:43.825296 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":94,"threads_started":1}
I20260811 17:12:43.983872 2941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:43.983363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.194:40623)
0811 17:12:43.983689 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:43.983761 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":97,"threads_started":1}
I20260811 17:12:44.188460 2942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:44.187919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.195:34073)
0811 17:12:44.188283 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:44.188351 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":93,"threads_started":1}
I20260811 17:12:44.827059 2943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:44.826535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.193:58027)
0811 17:12:44.826829 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:44.826902 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":88,"threads_started":1}
I20260811 17:12:44.985437 2944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:44.984952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.194:44915)
0811 17:12:44.985258 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:44.985331 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":88,"threads_started":1}
I20260811 17:12:45.189757 2945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:45.189281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.195:37391)
0811 17:12:45.189597 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:45.189658 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":131,"threads_started":1}
I20260811 17:12:45.828787 2946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:45.828254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.193:37181)
0811 17:12:45.828562 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:45.828645 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":74,"threads_started":1}
I20260811 17:12:45.986999 2948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:45.986501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.194:58571)
0811 17:12:45.986791 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:45.986846 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":93,"threads_started":1}
I20260811 17:12:46.176587 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 2009
I20260811 17:12:46.191223 2950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:46.190778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:40985 (local address 127.4.146.195:48731)
0811 17:12:46.191048 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:46.191120 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.254:40985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":95,"threads_started":1}
I20260811 17:12:46.194159 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 2355
I20260811 17:12:46.213953 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 2611
2026-08-11T17:12:46Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (60392 ms)
[----------] 30 tests from SecurityITest (274334 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:12:46 dist-test-slave-7vjv krb5kdc[2954](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:12:46 dist-test-slave-7vjv krb5kdc[2954](info): set up 2 sockets
Aug 11 17:12:46 dist-test-slave-7vjv krb5kdc[2954](info): commencing operation
krb5kdc: starting...
W20260811 17:12:47.602079 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.347s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:12:47 dist-test-slave-7vjv krb5kdc[2954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468367, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:12:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:12:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:12:47.757428 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:35029
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:35769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:35029
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:12:47.884593 2977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:47.884936 2977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:47.884982 2977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:47.889406 2977 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:12:47.889494 2977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:47.889515 2977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:47.889533 2977 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:12:47.889555 2977 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:12:47.895376 2977 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:35769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:35029
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:35029
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2977
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:47.896711 2977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:47.897818 2977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:47.907460 2985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:47.907447 2988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:47.907447 2984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:47.908396 2977 server_base.cc:1034] running on GCE node
I20260811 17:12:47.909147 2977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:47.910501 2977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:47.911728 2977 hybrid_clock.cc:648] HybridClock initialized: now 1786468367911708 us; error 36 us; skew 500 ppm
Aug 11 17:12:47 dist-test-slave-7vjv krb5kdc[2954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468367, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:12:47.915019 2977 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:12:47.916239 2977 webserver.cc:460] Webserver started at http://127.4.146.254:36941/ using document root <none> and password file <none>
I20260811 17:12:47.916888 2977 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:47.916993 2977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:47.917246 2977 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:12:47.919665 2977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "a32ff216d44045e4b2104c700ff3422a"
format_stamp: "Formatted at 2026-08-11 17:12:47 on dist-test-slave-7vjv"
server_key: "d7a8bdeb5f18c41a81f84357f279785f"
server_key_iv: "b85cd72eea215ff470c83eb1dbd12f2b"
server_key_version: "encryptionkey@0"
I20260811 17:12:47.920409 2977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "a32ff216d44045e4b2104c700ff3422a"
format_stamp: "Formatted at 2026-08-11 17:12:47 on dist-test-slave-7vjv"
server_key: "d7a8bdeb5f18c41a81f84357f279785f"
server_key_iv: "b85cd72eea215ff470c83eb1dbd12f2b"
server_key_version: "encryptionkey@0"
I20260811 17:12:47.925093 2977 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 17:12:47.928471 2998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:47.930107 2977 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 17:12:47.930303 2977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "a32ff216d44045e4b2104c700ff3422a"
format_stamp: "Formatted at 2026-08-11 17:12:47 on dist-test-slave-7vjv"
server_key: "d7a8bdeb5f18c41a81f84357f279785f"
server_key_iv: "b85cd72eea215ff470c83eb1dbd12f2b"
server_key_version: "encryptionkey@0"
I20260811 17:12:47.930466 2977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:47.945250 2977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:47.949162 2977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:47.949404 2977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:47.957825 2977 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:35029
I20260811 17:12:47.957847 3106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:35029 every 8 connection(s)
I20260811 17:12:47.958917 2977 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:12:47.961948 3107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:47.967087 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 2977
I20260811 17:12:47.967265 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:12:47.967608 4683 external_mini_cluster.cc:1428] Setting key fd8297c17532ee30abd2697dd8535275
I20260811 17:12:47.968528 3107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a32ff216d44045e4b2104c700ff3422a: Bootstrap starting.
I20260811 17:12:47.971128 3107 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a32ff216d44045e4b2104c700ff3422a: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:47.971956 3107 log.cc:824] T 00000000000000000000000000000000 P a32ff216d44045e4b2104c700ff3422a: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:47.974138 3107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a32ff216d44045e4b2104c700ff3422a: No bootstrap required, opened a new log
Aug 11 17:12:47 dist-test-slave-7vjv krb5kdc[2954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468367, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:12:47.978106 3107 raft_consensus.cc:348] T 00000000000000000000000000000000 P a32ff216d44045e4b2104c700ff3422a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a32ff216d44045e4b2104c700ff3422a" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35029 } }
I20260811 17:12:47.978418 3107 raft_consensus.cc:374] T 00000000000000000000000000000000 P a32ff216d44045e4b2104c700ff3422a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:47.978544 3107 raft_consensus.cc:729] T 00000000000000000000000000000000 P a32ff216d44045e4b2104c700ff3422a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a32ff216d44045e4b2104c700ff3422a, State: Initialized, Role: FOLLOWER
I20260811 17:12:47.979132 3107 consensus_queue.cc:260] T 00000000000000000000000000000000 P a32ff216d44045e4b2104c700ff3422a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a32ff216d44045e4b2104c700ff3422a" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35029 } }
I20260811 17:12:47.979342 3107 raft_consensus.cc:388] T 00000000000000000000000000000000 P a32ff216d44045e4b2104c700ff3422a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:12:47.979449 3107 raft_consensus.cc:482] T 00000000000000000000000000000000 P a32ff216d44045e4b2104c700ff3422a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:12:47.979574 3107 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a32ff216d44045e4b2104c700ff3422a [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:47.980790 3107 raft_consensus.cc:504] T 00000000000000000000000000000000 P a32ff216d44045e4b2104c700ff3422a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a32ff216d44045e4b2104c700ff3422a" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35029 } }
I20260811 17:12:47.981223 3107 leader_election.cc:302] T 00000000000000000000000000000000 P a32ff216d44045e4b2104c700ff3422a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a32ff216d44045e4b2104c700ff3422a; no voters:
I20260811 17:12:47.981777 3107 leader_election.cc:288] T 00000000000000000000000000000000 P a32ff216d44045e4b2104c700ff3422a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:12:47.981875 3118 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a32ff216d44045e4b2104c700ff3422a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:12:47.982125 3118 raft_consensus.cc:686] T 00000000000000000000000000000000 P a32ff216d44045e4b2104c700ff3422a [term 1 LEADER]: Becoming Leader. State: Replica: a32ff216d44045e4b2104c700ff3422a, State: Running, Role: LEADER
I20260811 17:12:47.982527 3118 consensus_queue.cc:237] T 00000000000000000000000000000000 P a32ff216d44045e4b2104c700ff3422a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a32ff216d44045e4b2104c700ff3422a" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35029 } }
I20260811 17:12:47.983350 3107 sys_catalog.cc:564] T 00000000000000000000000000000000 P a32ff216d44045e4b2104c700ff3422a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:12:47.983928 3118 sys_catalog.cc:455] T 00000000000000000000000000000000 P a32ff216d44045e4b2104c700ff3422a [sys.catalog]: SysCatalogTable state changed. Reason: New leader a32ff216d44045e4b2104c700ff3422a. Latest consensus state: current_term: 1 leader_uuid: "a32ff216d44045e4b2104c700ff3422a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a32ff216d44045e4b2104c700ff3422a" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35029 } } }
I20260811 17:12:47.984294 3118 sys_catalog.cc:458] T 00000000000000000000000000000000 P a32ff216d44045e4b2104c700ff3422a [sys.catalog]: This master's current role is: LEADER
I20260811 17:12:47.984501 3119 sys_catalog.cc:455] T 00000000000000000000000000000000 P a32ff216d44045e4b2104c700ff3422a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a32ff216d44045e4b2104c700ff3422a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a32ff216d44045e4b2104c700ff3422a" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35029 } } }
I20260811 17:12:47.984637 3119 sys_catalog.cc:458] T 00000000000000000000000000000000 P a32ff216d44045e4b2104c700ff3422a [sys.catalog]: This master's current role is: LEADER
I20260811 17:12:47.985399 3115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:47.969290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52332 (local address 127.4.146.254:35029)
0811 17:12:47.969774 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:47.969793 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:47.969835 (+ 42us) server_negotiation.cc:407] Connection header received
0811 17:12:47.970603 (+ 768us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:47.970625 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:47.971003 (+ 378us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:47.971391 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:47.972434 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:47.973630 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:47.974742 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:47.975303 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:47.975531 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:47.978544 (+ 3013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:47.978551 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:47.978570 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:12:47.978609 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:47.981008 (+ 2399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:47.981650 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:47.981663 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:47.981669 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:47.981876 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:47.982297 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:47.982300 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:47.982302 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:47.982881 (+ 579us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:47.983136 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:47.983490 (+ 354us) server_negotiation.cc:299] Negotiation successful
0811 17:12:47.984133 (+ 643us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":165,"threads_started":1}
W20260811 17:12:47.989548 3158 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a32ff216d44045e4b2104c700ff3422a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 17:12:47.989696 3158 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 17:12:47.989784 3137 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:12:47.990644 3137 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:12:47.997836 3137 catalog_manager.cc:1347] Generated new cluster ID: 1d133b5a004f4f2d91c2cd805c65ba5c
I20260811 17:12:47.997954 3137 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:12:48.008720 3137 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:12:48.010124 3137 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:12:48.018549 3137 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a32ff216d44045e4b2104c700ff3422a: Generated new TSK 0
I20260811 17:12:48.019389 3137 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
I20260811 17:12:48.059868 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:35029
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:35769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:12:48.216717 3167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:48.217078 3167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:48.217132 3167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:48.221586 3167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:48.221683 3167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:48.221752 3167 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:12:48.227598 3167 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:35769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:35029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3167
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:48.228940 3167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:48.230116 3167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:48.241281 3181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:48.241420 3175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:48.241539 3173 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:48.242602 3167 server_base.cc:1034] running on GCE node
I20260811 17:12:48.243187 3167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:48.243947 3167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:48.245172 3167 hybrid_clock.cc:648] HybridClock initialized: now 1786468368245132 us; error 55 us; skew 500 ppm
Aug 11 17:12:48 dist-test-slave-7vjv krb5kdc[2954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468368, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:12:48.248695 3167 init.cc:377] Logged in from keytab as kudu/127.4.146.193@KRBTEST.COM (short username kudu)
I20260811 17:12:48.250005 3167 webserver.cc:460] Webserver started at http://127.4.146.193:34617/ using document root <none> and password file <none>
I20260811 17:12:48.250671 3167 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:48.250773 3167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:48.251026 3167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:12:48.253430 3167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "d6cc97d02c02464e805568e9b5b14122"
format_stamp: "Formatted at 2026-08-11 17:12:48 on dist-test-slave-7vjv"
server_key: "f8954db8569e2af2faabb54dfbb1de41"
server_key_iv: "892a6e06b37ed9b4e3045ae6200749ff"
server_key_version: "encryptionkey@0"
I20260811 17:12:48.254127 3167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "d6cc97d02c02464e805568e9b5b14122"
format_stamp: "Formatted at 2026-08-11 17:12:48 on dist-test-slave-7vjv"
server_key: "f8954db8569e2af2faabb54dfbb1de41"
server_key_iv: "892a6e06b37ed9b4e3045ae6200749ff"
server_key_version: "encryptionkey@0"
I20260811 17:12:48.258957 3167 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 17:12:48.262207 3193 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:48.263720 3167 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 17:12:48.263880 3167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "d6cc97d02c02464e805568e9b5b14122"
format_stamp: "Formatted at 2026-08-11 17:12:48 on dist-test-slave-7vjv"
server_key: "f8954db8569e2af2faabb54dfbb1de41"
server_key_iv: "892a6e06b37ed9b4e3045ae6200749ff"
server_key_version: "encryptionkey@0"
I20260811 17:12:48.264010 3167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:48.276899 3167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:48.280740 3167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:48.280973 3167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:48.281641 3167 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:12:48.282636 3167 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:12:48.282709 3167 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:48.282785 3167 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:12:48.282825 3167 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:48.293371 3167 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:35837
I20260811 17:12:48.293417 3411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:35837 every 8 connection(s)
I20260811 17:12:48.294401 3167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:12:48.300369 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 3167
I20260811 17:12:48.300531 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
I20260811 17:12:48.300859 4683 external_mini_cluster.cc:1428] Setting key d2bf67927cb400d8d0819f67d19bf46b
Aug 11 17:12:48 dist-test-slave-7vjv krb5kdc[2954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468368, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:12:48.310173 3115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:48.296552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:33861 (local address 127.4.146.254:35029)
0811 17:12:48.296709 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:48.296713 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:48.297611 (+ 898us) server_negotiation.cc:407] Connection header received
0811 17:12:48.298941 (+ 1330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:48.298943 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:48.298991 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:48.299075 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:48.300420 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.301230 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.302614 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.302991 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.303118 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:48.305996 (+ 2878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:48.306004 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:48.306006 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:12:48.306033 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:48.307597 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:48.308242 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:48.308246 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:48.308248 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:48.308335 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:48.308716 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:48.308720 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:48.308722 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:48.308940 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:48.309225 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:48.309822 (+ 597us) server_negotiation.cc:299] Negotiation successful
0811 17:12:48.309988 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 17:12:48.311103 3420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:48.296956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:35029 (local address 127.4.146.193:33861)
0811 17:12:48.297447 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:48.297500 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:48.298743 (+ 1243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:48.299251 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:48.299258 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:48.299667 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:12:48.300256 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:48.300273 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.301390 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.301395 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:48.302487 (+ 1092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:48.302499 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.303157 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.303160 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:48.303324 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:48.304185 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:12:48.304203 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:12:48.305790 (+ 1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:12:48.307746 (+ 1956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:48.307753 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:48.307772 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:48.308083 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:48.308434 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:48.308438 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:48.308440 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:48.308609 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:48.309201 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:12:48.309209 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:12:48.309540 (+ 331us) client_negotiation.cc:769] Sending connection context
0811 17:12:48.309758 (+ 218us) client_negotiation.cc:240] Negotiation successful
0811 17:12:48.310152 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":111,"threads_started":1}
WARNING: no policy specified for kudu/127.4.146.194@KRBTEST.COM; defaulting to no policy
I20260811 17:12:48.312633 3412 heartbeater.cc:347] Connected to a master server at 127.4.146.254:35029
I20260811 17:12:48.312922 3412 heartbeater.cc:464] Registering TS with master...
I20260811 17:12:48.313534 3412 heartbeater.cc:511] Master 127.4.146.254:35029 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.194@KRBTEST.COM" created.
I20260811 17:12:48.315423 3031 ts_manager.cc:194] Registered new tserver with Master: d6cc97d02c02464e805568e9b5b14122 (127.4.146.193:35837)
I20260811 17:12:48.316699 3031 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.193@KRBTEST.COM'} at 127.4.146.193:33861
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
I20260811 17:12:48.335196 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:35029
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:35769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:12:48.464246 3424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:48.464641 3424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:48.464694 3424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:48.469067 3424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:48.469174 3424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:48.469273 3424 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:12:48.475275 3424 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:35769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:35029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3424
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:48.476578 3424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:48.477689 3424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:48.488680 3438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:48.488649 3434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:48.488651 3435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:48.489223 3424 server_base.cc:1034] running on GCE node
I20260811 17:12:48.489768 3424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:48.490538 3424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:48.491734 3424 hybrid_clock.cc:648] HybridClock initialized: now 1786468368491711 us; error 35 us; skew 500 ppm
Aug 11 17:12:48 dist-test-slave-7vjv krb5kdc[2954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468368, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:12:48.495223 3424 init.cc:377] Logged in from keytab as kudu/127.4.146.194@KRBTEST.COM (short username kudu)
I20260811 17:12:48.496362 3424 webserver.cc:460] Webserver started at http://127.4.146.194:32869/ using document root <none> and password file <none>
I20260811 17:12:48.496986 3424 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:48.497083 3424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:48.497334 3424 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:12:48.499639 3424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "2cf1511557044ad48017055b58e2ebc1"
format_stamp: "Formatted at 2026-08-11 17:12:48 on dist-test-slave-7vjv"
server_key: "22b2785c2903e47db65eea77b29be7bf"
server_key_iv: "9067ea502ae42efad1579a0e48798ead"
server_key_version: "encryptionkey@0"
I20260811 17:12:48.500334 3424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "2cf1511557044ad48017055b58e2ebc1"
format_stamp: "Formatted at 2026-08-11 17:12:48 on dist-test-slave-7vjv"
server_key: "22b2785c2903e47db65eea77b29be7bf"
server_key_iv: "9067ea502ae42efad1579a0e48798ead"
server_key_version: "encryptionkey@0"
I20260811 17:12:48.504432 3424 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 17:12:48.507311 3453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:48.508819 3424 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:12:48.508972 3424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "2cf1511557044ad48017055b58e2ebc1"
format_stamp: "Formatted at 2026-08-11 17:12:48 on dist-test-slave-7vjv"
server_key: "22b2785c2903e47db65eea77b29be7bf"
server_key_iv: "9067ea502ae42efad1579a0e48798ead"
server_key_version: "encryptionkey@0"
I20260811 17:12:48.509104 3424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:48.547740 3424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:48.551808 3424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:48.552042 3424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:48.552721 3424 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:12:48.553634 3424 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:12:48.553702 3424 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:48.553771 3424 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:12:48.553815 3424 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:48.563623 3424 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:41677
I20260811 17:12:48.563642 3658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:41677 every 8 connection(s)
I20260811 17:12:48.564699 3424 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:12:48.566377 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 3424
I20260811 17:12:48.566550 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:12:48.566923 4683 external_mini_cluster.cc:1428] Setting key 089852760329ce579c74c05d98b1cd95
Aug 11 17:12:48 dist-test-slave-7vjv krb5kdc[2954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468368, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.146.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.195@KRBTEST.COM" created.
I20260811 17:12:48.583709 3115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:48.566799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:60329 (local address 127.4.146.254:35029)
0811 17:12:48.566942 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:48.566946 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:48.568140 (+ 1194us) server_negotiation.cc:407] Connection header received
0811 17:12:48.569834 (+ 1694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:48.569838 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:48.569895 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:48.569979 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:48.571652 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.572379 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.574453 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.574741 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.574860 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:48.578641 (+ 3781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:48.578645 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:48.578647 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:12:48.578680 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:48.580488 (+ 1808us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:48.581353 (+ 865us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:48.581356 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:48.581358 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:48.581456 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:48.581890 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:48.581892 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:48.581893 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:48.582315 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:48.582426 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:48.583286 (+ 860us) server_negotiation.cc:299] Negotiation successful
0811 17:12:48.583483 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 17:12:48.584949 3662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:48.567395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:35029 (local address 127.4.146.194:60329)
0811 17:12:48.567929 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:48.567979 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:48.569602 (+ 1623us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:48.570186 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:48.570195 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:48.570601 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:12:48.571436 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:48.571461 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.572550 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.572557 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:48.574233 (+ 1676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:48.574252 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.574954 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.574960 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:48.575243 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:48.576005 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:12:48.576036 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:12:48.578377 (+ 2341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:12:48.580718 (+ 2341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:48.580726 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:48.580746 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:48.581198 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:48.581592 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:48.581595 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:48.581596 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:48.581787 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:48.582514 (+ 727us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:12:48.582526 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:12:48.582860 (+ 334us) client_negotiation.cc:769] Sending connection context
0811 17:12:48.583238 (+ 378us) client_negotiation.cc:240] Negotiation successful
0811 17:12:48.583709 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":127,"threads_started":1}
I20260811 17:12:48.586511 3659 heartbeater.cc:347] Connected to a master server at 127.4.146.254:35029
I20260811 17:12:48.586820 3659 heartbeater.cc:464] Registering TS with master...
I20260811 17:12:48.587389 3659 heartbeater.cc:511] Master 127.4.146.254:35029 requested a full tablet report, sending...
I20260811 17:12:48.588672 3031 ts_manager.cc:194] Registered new tserver with Master: 2cf1511557044ad48017055b58e2ebc1 (127.4.146.194:41677)
I20260811 17:12:48.589293 3031 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.194@KRBTEST.COM'} at 127.4.146.194:60329
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
I20260811 17:12:48.604015 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:35029
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:35769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:12:48.729027 3665 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:48.729405 3665 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:48.729501 3665 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:48.733820 3665 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:48.733958 3665 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:48.734062 3665 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:12:48.740231 3665 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:35769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:35029
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3665
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:48.741519 3665 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:48.742686 3665 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:48.753254 3679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:48.753254 3675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:48.753268 3686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:48.753738 3665 server_base.cc:1034] running on GCE node
I20260811 17:12:48.754205 3665 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:48.754910 3665 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:48.756170 3665 hybrid_clock.cc:648] HybridClock initialized: now 1786468368756135 us; error 52 us; skew 500 ppm
Aug 11 17:12:48 dist-test-slave-7vjv krb5kdc[2954](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468368, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:12:48.759326 3665 init.cc:377] Logged in from keytab as kudu/127.4.146.195@KRBTEST.COM (short username kudu)
I20260811 17:12:48.760372 3665 webserver.cc:460] Webserver started at http://127.4.146.195:35361/ using document root <none> and password file <none>
I20260811 17:12:48.761008 3665 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:48.761106 3665 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:48.761348 3665 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:12:48.763684 3665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "6aa809b6fefe4c24a164b2c5f23b097e"
format_stamp: "Formatted at 2026-08-11 17:12:48 on dist-test-slave-7vjv"
server_key: "2d85a4ead538e3d4ee983a43147f8aa6"
server_key_iv: "a54bd67afd0e5f5b179f4409c8f8e662"
server_key_version: "encryptionkey@0"
I20260811 17:12:48.764344 3665 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "6aa809b6fefe4c24a164b2c5f23b097e"
format_stamp: "Formatted at 2026-08-11 17:12:48 on dist-test-slave-7vjv"
server_key: "2d85a4ead538e3d4ee983a43147f8aa6"
server_key_iv: "a54bd67afd0e5f5b179f4409c8f8e662"
server_key_version: "encryptionkey@0"
I20260811 17:12:48.768584 3665 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 17:12:48.771405 3707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:48.773077 3665 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:12:48.773248 3665 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "6aa809b6fefe4c24a164b2c5f23b097e"
format_stamp: "Formatted at 2026-08-11 17:12:48 on dist-test-slave-7vjv"
server_key: "2d85a4ead538e3d4ee983a43147f8aa6"
server_key_iv: "a54bd67afd0e5f5b179f4409c8f8e662"
server_key_version: "encryptionkey@0"
I20260811 17:12:48.773389 3665 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:48.788726 3665 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:48.792251 3665 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:48.792484 3665 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:48.793184 3665 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:12:48.794165 3665 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:12:48.794243 3665 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:48.794323 3665 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:12:48.794370 3665 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:48.805233 3665 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:34857
I20260811 17:12:48.805260 3912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:34857 every 8 connection(s)
I20260811 17:12:48.806324 3665 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:12:48.813256 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 3665
I20260811 17:12:48.813448 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:12:48.813782 4683 external_mini_cluster.cc:1428] Setting key 07af8ec0ff12c9fec4b210693e55a08c
Aug 11 17:12:48 dist-test-slave-7vjv krb5kdc[2954](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468368, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:12:48.822316 3115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:48.808683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:44799 (local address 127.4.146.254:35029)
0811 17:12:48.808842 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:48.808846 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:48.809777 (+ 931us) server_negotiation.cc:407] Connection header received
0811 17:12:48.811279 (+ 1502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:48.811283 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:48.811347 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:48.811456 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:48.812911 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.813589 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.814871 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.815292 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.815449 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:48.818278 (+ 2829us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:48.818281 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:48.818284 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:12:48.818319 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:48.819863 (+ 1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:48.820521 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:48.820525 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:48.820527 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:48.820622 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:48.821072 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:48.821075 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:48.821076 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:48.821282 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:48.821400 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:48.821970 (+ 570us) server_negotiation.cc:299] Negotiation successful
0811 17:12:48.822126 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 17:12:48.823225 3917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:48.809037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:35029 (local address 127.4.146.195:44799)
0811 17:12:48.809593 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:48.809642 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:48.811039 (+ 1397us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:48.811656 (+ 617us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:48.811664 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:48.812190 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:12:48.812747 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:48.812761 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.813722 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.813725 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:48.814730 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:48.814741 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.815508 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.815513 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:48.815713 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:48.816470 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:12:48.816496 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:12:48.818084 (+ 1588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:12:48.820001 (+ 1917us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:48.820009 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:48.820030 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:48.820399 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:48.820725 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:48.820728 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:48.820731 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:48.820896 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:48.821401 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:12:48.821410 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:12:48.821706 (+ 296us) client_negotiation.cc:769] Sending connection context
0811 17:12:48.821908 (+ 202us) client_negotiation.cc:240] Negotiation successful
0811 17:12:48.822290 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":136,"threads_started":1}
I20260811 17:12:48.824800 3915 heartbeater.cc:347] Connected to a master server at 127.4.146.254:35029
I20260811 17:12:48.825150 3915 heartbeater.cc:464] Registering TS with master...
I20260811 17:12:48.825752 3915 heartbeater.cc:511] Master 127.4.146.254:35029 requested a full tablet report, sending...
I20260811 17:12:48.827183 3031 ts_manager.cc:194] Registered new tserver with Master: 6aa809b6fefe4c24a164b2c5f23b097e (127.4.146.195:34857)
I20260811 17:12:48.827941 3031 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.195@KRBTEST.COM'} at 127.4.146.195:44799
I20260811 17:12:48.828572 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 17:12:48.839072 3115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:48.830634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52342 (local address 127.4.146.254:35029)
0811 17:12:48.830736 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:48.830739 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:48.830978 (+ 239us) server_negotiation.cc:407] Connection header received
0811 17:12:48.831110 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:48.831113 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:48.831154 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:48.831225 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:48.831900 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.832488 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.833515 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.833744 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.833828 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:48.835336 (+ 1508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:48.835340 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:48.835343 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:12:48.835368 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:48.837116 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:48.837639 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:48.837646 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:48.837649 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:48.837758 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:48.838054 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:48.838057 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:48.838058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:48.838300 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:48.838409 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:48.838714 (+ 305us) server_negotiation.cc:299] Negotiation successful
0811 17:12:48.838836 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 17:12:48.843590 3034 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52342:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 17:12:48.846853 3034 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:12:48.863950 3950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:48.858142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44824 (local address 127.4.146.193:35837)
0811 17:12:48.858835 (+ 693us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:48.858843 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:48.858970 (+ 127us) server_negotiation.cc:407] Connection header received
0811 17:12:48.859076 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:48.859081 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:48.859252 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:48.859394 (+ 142us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:48.859929 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.860920 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.862434 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.863134 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.863256 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:48.863424 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:48.863663 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 17:12:48.863777 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":592,"thread_start_us":117,"threads_started":1}
I20260811 17:12:48.863945 3941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:48.857967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:35837 (local address 127.0.0.1:44824)
0811 17:12:48.858855 (+ 888us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:48.858870 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:48.858964 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:48.859576 (+ 612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:48.859579 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:48.859596 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:48.859767 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:48.859775 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.861082 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.861086 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:48.862286 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:48.862297 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.863267 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.863271 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:48.863406 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:48.863460 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 17:12:48.863606 (+ 146us) client_negotiation.cc:240] Negotiation successful
0811 17:12:48.863757 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":828,"mutex_wait_us":3,"thread_start_us":143,"threads_started":1}
I20260811 17:12:48.864749 3942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:48.857102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:34857 (local address 127.0.0.1:45720)
0811 17:12:48.857828 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:48.858438 (+ 610us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:48.858566 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:48.859370 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:48.859377 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:48.859422 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:48.859643 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:48.859650 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.861737 (+ 2087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.861741 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:48.863004 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:48.863018 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.864267 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.864271 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:48.864391 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:48.864422 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 17:12:48.864475 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 17:12:48.864548 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"mutex_wait_us":52,"spinlock_wait_cycles":14720,"thread_start_us":112,"threads_started":1}
I20260811 17:12:48.865221 3945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:48.857502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59550 (local address 127.4.146.194:41677)
0811 17:12:48.857969 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:48.858036 (+ 67us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:48.858398 (+ 362us) server_negotiation.cc:407] Connection header received
0811 17:12:48.858732 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:48.858742 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:48.858994 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:48.859130 (+ 136us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:48.859787 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.861163 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.862944 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.863762 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.863870 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:48.864011 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:48.864933 (+ 922us) server_negotiation.cc:299] Negotiation successful
0811 17:12:48.865052 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":130,"threads_started":1}
I20260811 17:12:48.865253 3953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:48.858346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45720 (local address 127.4.146.195:34857)
0811 17:12:48.858816 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:48.858830 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:48.858857 (+ 27us) server_negotiation.cc:407] Connection header received
0811 17:12:48.858942 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:48.858949 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:48.859181 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:48.859370 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:48.860210 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.861567 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.863158 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.864078 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.864683 (+ 605us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:48.864881 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:48.864951 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 17:12:48.865079 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":126,"threads_started":1}
I20260811 17:12:48.864596 3946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:48.857331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:41677 (local address 127.0.0.1:59550)
0811 17:12:48.858270 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:48.858294 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:48.858522 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:48.859370 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:48.859377 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:48.859413 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:48.859632 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:48.859642 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.861368 (+ 1726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.861372 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:48.862791 (+ 1419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:48.862804 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.864139 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.864145 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:48.864255 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:48.864281 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 17:12:48.864358 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 17:12:48.864440 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":868,"mutex_wait_us":25,"spinlock_wait_cycles":5888,"thread_start_us":165,"threads_started":1}
I20260811 17:12:48.868109 3797 tablet_service.cc:1467] Processing CreateTablet for tablet ab124faaebf541e8a6f2b33fe8aa77f6 (DEFAULT_TABLE table=test-table [id=20ea2a7d674142428d73629fbb90fbba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:12:48.868458 3296 tablet_service.cc:1467] Processing CreateTablet for tablet ab124faaebf541e8a6f2b33fe8aa77f6 (DEFAULT_TABLE table=test-table [id=20ea2a7d674142428d73629fbb90fbba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:12:48.868458 3534 tablet_service.cc:1467] Processing CreateTablet for tablet ab124faaebf541e8a6f2b33fe8aa77f6 (DEFAULT_TABLE table=test-table [id=20ea2a7d674142428d73629fbb90fbba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:12:48.869351 3797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab124faaebf541e8a6f2b33fe8aa77f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:48.869570 3534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab124faaebf541e8a6f2b33fe8aa77f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:48.869568 3296 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab124faaebf541e8a6f2b33fe8aa77f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:48.876157 3954 tablet_bootstrap.cc:492] T ab124faaebf541e8a6f2b33fe8aa77f6 P 6aa809b6fefe4c24a164b2c5f23b097e: Bootstrap starting.
I20260811 17:12:48.878793 3957 tablet_bootstrap.cc:492] T ab124faaebf541e8a6f2b33fe8aa77f6 P 2cf1511557044ad48017055b58e2ebc1: Bootstrap starting.
I20260811 17:12:48.879071 3954 tablet_bootstrap.cc:654] T ab124faaebf541e8a6f2b33fe8aa77f6 P 6aa809b6fefe4c24a164b2c5f23b097e: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:48.880395 3954 log.cc:824] T ab124faaebf541e8a6f2b33fe8aa77f6 P 6aa809b6fefe4c24a164b2c5f23b097e: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:48.880574 3955 tablet_bootstrap.cc:492] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122: Bootstrap starting.
I20260811 17:12:48.881964 3957 tablet_bootstrap.cc:654] T ab124faaebf541e8a6f2b33fe8aa77f6 P 2cf1511557044ad48017055b58e2ebc1: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:48.882512 3954 tablet_bootstrap.cc:492] T ab124faaebf541e8a6f2b33fe8aa77f6 P 6aa809b6fefe4c24a164b2c5f23b097e: No bootstrap required, opened a new log
I20260811 17:12:48.882738 3954 ts_tablet_manager.cc:1397] T ab124faaebf541e8a6f2b33fe8aa77f6 P 6aa809b6fefe4c24a164b2c5f23b097e: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 17:12:48.882977 3957 log.cc:824] T ab124faaebf541e8a6f2b33fe8aa77f6 P 2cf1511557044ad48017055b58e2ebc1: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:48.883399 3955 tablet_bootstrap.cc:654] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:48.884559 3955 log.cc:824] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:48.885655 3957 tablet_bootstrap.cc:492] T ab124faaebf541e8a6f2b33fe8aa77f6 P 2cf1511557044ad48017055b58e2ebc1: No bootstrap required, opened a new log
I20260811 17:12:48.885880 3957 ts_tablet_manager.cc:1397] T ab124faaebf541e8a6f2b33fe8aa77f6 P 2cf1511557044ad48017055b58e2ebc1: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 17:12:48.886970 3955 tablet_bootstrap.cc:492] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122: No bootstrap required, opened a new log
I20260811 17:12:48.887193 3955 ts_tablet_manager.cc:1397] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 17:12:48.886961 3954 raft_consensus.cc:348] T ab124faaebf541e8a6f2b33fe8aa77f6 P 6aa809b6fefe4c24a164b2c5f23b097e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa809b6fefe4c24a164b2c5f23b097e" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 34857 } } peers { permanent_uuid: "2cf1511557044ad48017055b58e2ebc1" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41677 } } peers { permanent_uuid: "d6cc97d02c02464e805568e9b5b14122" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 35837 } }
I20260811 17:12:48.887293 3954 raft_consensus.cc:374] T ab124faaebf541e8a6f2b33fe8aa77f6 P 6aa809b6fefe4c24a164b2c5f23b097e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:48.887355 3954 raft_consensus.cc:729] T ab124faaebf541e8a6f2b33fe8aa77f6 P 6aa809b6fefe4c24a164b2c5f23b097e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aa809b6fefe4c24a164b2c5f23b097e, State: Initialized, Role: FOLLOWER
I20260811 17:12:48.887827 3954 consensus_queue.cc:260] T ab124faaebf541e8a6f2b33fe8aa77f6 P 6aa809b6fefe4c24a164b2c5f23b097e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa809b6fefe4c24a164b2c5f23b097e" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 34857 } } peers { permanent_uuid: "2cf1511557044ad48017055b58e2ebc1" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41677 } } peers { permanent_uuid: "d6cc97d02c02464e805568e9b5b14122" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 35837 } }
I20260811 17:12:48.888571 3915 heartbeater.cc:503] Master 127.4.146.254:35029 was elected leader, sending a full tablet report...
I20260811 17:12:48.888932 3954 ts_tablet_manager.cc:1428] T ab124faaebf541e8a6f2b33fe8aa77f6 P 6aa809b6fefe4c24a164b2c5f23b097e: Time spent starting tablet: real 0.006s user 0.001s sys 0.006s
I20260811 17:12:48.890581 3957 raft_consensus.cc:348] T ab124faaebf541e8a6f2b33fe8aa77f6 P 2cf1511557044ad48017055b58e2ebc1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa809b6fefe4c24a164b2c5f23b097e" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 34857 } } peers { permanent_uuid: "2cf1511557044ad48017055b58e2ebc1" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41677 } } peers { permanent_uuid: "d6cc97d02c02464e805568e9b5b14122" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 35837 } }
I20260811 17:12:48.890919 3957 raft_consensus.cc:374] T ab124faaebf541e8a6f2b33fe8aa77f6 P 2cf1511557044ad48017055b58e2ebc1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:48.890981 3957 raft_consensus.cc:729] T ab124faaebf541e8a6f2b33fe8aa77f6 P 2cf1511557044ad48017055b58e2ebc1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cf1511557044ad48017055b58e2ebc1, State: Initialized, Role: FOLLOWER
I20260811 17:12:48.891775 3957 consensus_queue.cc:260] T ab124faaebf541e8a6f2b33fe8aa77f6 P 2cf1511557044ad48017055b58e2ebc1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa809b6fefe4c24a164b2c5f23b097e" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 34857 } } peers { permanent_uuid: "2cf1511557044ad48017055b58e2ebc1" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41677 } } peers { permanent_uuid: "d6cc97d02c02464e805568e9b5b14122" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 35837 } }
I20260811 17:12:48.892418 3955 raft_consensus.cc:348] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa809b6fefe4c24a164b2c5f23b097e" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 34857 } } peers { permanent_uuid: "2cf1511557044ad48017055b58e2ebc1" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41677 } } peers { permanent_uuid: "d6cc97d02c02464e805568e9b5b14122" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 35837 } }
I20260811 17:12:48.892715 3955 raft_consensus.cc:374] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:48.892786 3955 raft_consensus.cc:729] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6cc97d02c02464e805568e9b5b14122, State: Initialized, Role: FOLLOWER
I20260811 17:12:48.892784 3659 heartbeater.cc:503] Master 127.4.146.254:35029 was elected leader, sending a full tablet report...
I20260811 17:12:48.893081 3957 ts_tablet_manager.cc:1428] T ab124faaebf541e8a6f2b33fe8aa77f6 P 2cf1511557044ad48017055b58e2ebc1: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20260811 17:12:48.893337 3955 consensus_queue.cc:260] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa809b6fefe4c24a164b2c5f23b097e" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 34857 } } peers { permanent_uuid: "2cf1511557044ad48017055b58e2ebc1" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41677 } } peers { permanent_uuid: "d6cc97d02c02464e805568e9b5b14122" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 35837 } }
I20260811 17:12:48.894110 3412 heartbeater.cc:503] Master 127.4.146.254:35029 was elected leader, sending a full tablet report...
I20260811 17:12:48.895543 3955 ts_tablet_manager.cc:1428] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260811 17:12:48.912573 3968 raft_consensus.cc:482] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:12:48.912828 3968 raft_consensus.cc:504] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa809b6fefe4c24a164b2c5f23b097e" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 34857 } } peers { permanent_uuid: "2cf1511557044ad48017055b58e2ebc1" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41677 } } peers { permanent_uuid: "d6cc97d02c02464e805568e9b5b14122" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 35837 } }
I20260811 17:12:48.914116 3968 leader_election.cc:288] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6aa809b6fefe4c24a164b2c5f23b097e (127.4.146.195:34857), 2cf1511557044ad48017055b58e2ebc1 (127.4.146.194:41677)
I20260811 17:12:48.918283 3945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:48.914567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:50987 (local address 127.4.146.194:41677)
0811 17:12:48.914714 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:48.914721 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:48.914993 (+ 272us) server_negotiation.cc:407] Connection header received
0811 17:12:48.915148 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:48.915151 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:48.915202 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:48.915287 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:48.915577 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.916138 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.917299 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.917718 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.917849 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:48.917908 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:48.918085 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 17:12:48.918156 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 17:12:48.918310 3969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:48.914461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:41677 (local address 127.4.146.193:50987)
0811 17:12:48.914888 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:48.914901 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:48.915039 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:48.915300 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:48.915302 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:48.915319 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:48.915460 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:48.915465 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.916252 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.916257 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:48.917164 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:48.917173 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.917845 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.917848 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:48.917947 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:48.917976 (+ 29us) client_negotiation.cc:769] Sending connection context
0811 17:12:48.918062 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 17:12:48.918136 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":370,"mutex_wait_us":33,"thread_start_us":127,"threads_started":1}
I20260811 17:12:48.918358 3953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:48.914499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:52267 (local address 127.4.146.195:34857)
0811 17:12:48.914689 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:48.914694 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:48.914965 (+ 271us) server_negotiation.cc:407] Connection header received
0811 17:12:48.915136 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:48.915140 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:48.915188 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:48.915266 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:48.915594 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.916144 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.917290 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.917781 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.917911 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:48.917967 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:48.918166 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 17:12:48.918237 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 17:12:48.918381 3970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:48.914359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:34857 (local address 127.4.146.193:52267)
0811 17:12:48.914860 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:48.914872 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:48.915015 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:48.915289 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:48.915292 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:48.915308 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:48.915478 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:48.915483 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.916261 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.916266 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:48.917156 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:48.917166 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.917903 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.917906 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:48.918034 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:48.918061 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 17:12:48.918147 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 17:12:48.918222 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"mutex_wait_us":35,"spinlock_wait_cycles":19840,"thread_start_us":153,"threads_started":1}
I20260811 17:12:48.919229 3834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab124faaebf541e8a6f2b33fe8aa77f6" candidate_uuid: "d6cc97d02c02464e805568e9b5b14122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aa809b6fefe4c24a164b2c5f23b097e" is_pre_election: true
I20260811 17:12:48.919229 3576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab124faaebf541e8a6f2b33fe8aa77f6" candidate_uuid: "d6cc97d02c02464e805568e9b5b14122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cf1511557044ad48017055b58e2ebc1" is_pre_election: true
I20260811 17:12:48.919548 3576 raft_consensus.cc:2454] T ab124faaebf541e8a6f2b33fe8aa77f6 P 2cf1511557044ad48017055b58e2ebc1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6cc97d02c02464e805568e9b5b14122 in term 0.
I20260811 17:12:48.919564 3834 raft_consensus.cc:2454] T ab124faaebf541e8a6f2b33fe8aa77f6 P 6aa809b6fefe4c24a164b2c5f23b097e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6cc97d02c02464e805568e9b5b14122 in term 0.
I20260811 17:12:48.920138 3197 leader_election.cc:302] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2cf1511557044ad48017055b58e2ebc1, 6aa809b6fefe4c24a164b2c5f23b097e, d6cc97d02c02464e805568e9b5b14122; no voters:
I20260811 17:12:48.920495 3968 raft_consensus.cc:2781] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:12:48.920624 3968 raft_consensus.cc:482] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:12:48.920696 3968 raft_consensus.cc:3037] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:48.921868 3968 raft_consensus.cc:504] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa809b6fefe4c24a164b2c5f23b097e" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 34857 } } peers { permanent_uuid: "2cf1511557044ad48017055b58e2ebc1" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41677 } } peers { permanent_uuid: "d6cc97d02c02464e805568e9b5b14122" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 35837 } }
I20260811 17:12:48.922353 3968 leader_election.cc:288] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122 [CANDIDATE]: Term 1 election: Requested vote from peers 6aa809b6fefe4c24a164b2c5f23b097e (127.4.146.195:34857), 2cf1511557044ad48017055b58e2ebc1 (127.4.146.194:41677)
I20260811 17:12:48.922780 3834 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab124faaebf541e8a6f2b33fe8aa77f6" candidate_uuid: "d6cc97d02c02464e805568e9b5b14122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6aa809b6fefe4c24a164b2c5f23b097e"
I20260811 17:12:48.922922 3834 raft_consensus.cc:3037] T ab124faaebf541e8a6f2b33fe8aa77f6 P 6aa809b6fefe4c24a164b2c5f23b097e [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:48.923034 3576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab124faaebf541e8a6f2b33fe8aa77f6" candidate_uuid: "d6cc97d02c02464e805568e9b5b14122" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cf1511557044ad48017055b58e2ebc1"
I20260811 17:12:48.923264 3576 raft_consensus.cc:3037] T ab124faaebf541e8a6f2b33fe8aa77f6 P 2cf1511557044ad48017055b58e2ebc1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:48.924643 3834 raft_consensus.cc:2454] T ab124faaebf541e8a6f2b33fe8aa77f6 P 6aa809b6fefe4c24a164b2c5f23b097e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6cc97d02c02464e805568e9b5b14122 in term 1.
I20260811 17:12:48.924808 3576 raft_consensus.cc:2454] T ab124faaebf541e8a6f2b33fe8aa77f6 P 2cf1511557044ad48017055b58e2ebc1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6cc97d02c02464e805568e9b5b14122 in term 1.
I20260811 17:12:48.925118 3196 leader_election.cc:302] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aa809b6fefe4c24a164b2c5f23b097e, d6cc97d02c02464e805568e9b5b14122; no voters:
I20260811 17:12:48.925330 3968 raft_consensus.cc:2781] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:12:48.925604 3968 raft_consensus.cc:686] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122 [term 1 LEADER]: Becoming Leader. State: Replica: d6cc97d02c02464e805568e9b5b14122, State: Running, Role: LEADER
I20260811 17:12:48.925992 3968 consensus_queue.cc:237] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa809b6fefe4c24a164b2c5f23b097e" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 34857 } } peers { permanent_uuid: "2cf1511557044ad48017055b58e2ebc1" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41677 } } peers { permanent_uuid: "d6cc97d02c02464e805568e9b5b14122" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 35837 } }
I20260811 17:12:48.929579 3031 catalog_manager.cc:5495] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122 reported cstate change: term changed from 0 to 1, leader changed from <none> to d6cc97d02c02464e805568e9b5b14122 (127.4.146.193). New cstate: current_term: 1 leader_uuid: "d6cc97d02c02464e805568e9b5b14122" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa809b6fefe4c24a164b2c5f23b097e" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 34857 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2cf1511557044ad48017055b58e2ebc1" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6cc97d02c02464e805568e9b5b14122" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 35837 } health_report { overall_health: HEALTHY } } }
I20260811 17:12:48.950300 3950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:48.946013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44830 (local address 127.4.146.193:35837)
0811 17:12:48.946165 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:48.946169 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:48.946182 (+ 13us) server_negotiation.cc:407] Connection header received
0811 17:12:48.946260 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:48.946262 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:48.946318 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:48.946410 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:12:48.946701 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.947594 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.948581 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:48.948797 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:48.948898 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:48.949365 (+ 467us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:12:48.949810 (+ 445us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:12:48.949904 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:48.950051 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 17:12:48.950109 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 17:12:48.956797 3834 raft_consensus.cc:1261] T ab124faaebf541e8a6f2b33fe8aa77f6 P 6aa809b6fefe4c24a164b2c5f23b097e [term 1 FOLLOWER]: Refusing update from remote peer d6cc97d02c02464e805568e9b5b14122: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:12:48.956797 3576 raft_consensus.cc:1261] T ab124faaebf541e8a6f2b33fe8aa77f6 P 2cf1511557044ad48017055b58e2ebc1 [term 1 FOLLOWER]: Refusing update from remote peer d6cc97d02c02464e805568e9b5b14122: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:12:48.957595 3971 consensus_queue.cc:1035] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6aa809b6fefe4c24a164b2c5f23b097e" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 34857 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:12:48.957888 3968 consensus_queue.cc:1035] T ab124faaebf541e8a6f2b33fe8aa77f6 P d6cc97d02c02464e805568e9b5b14122 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2cf1511557044ad48017055b58e2ebc1" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:12:48.967893 3977 mvcc.cc:205] Tried to move back new op lower bound from 7317374439239036928 to 7317374439123898368. Current Snapshot: MvccSnapshot[applied={T|T < 7317374439239036928}]
I20260811 17:12:48.977451 3031 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52342:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:12:48.977689 3031 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52342:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:12:48.977732 3979 mvcc.cc:205] Tried to move back new op lower bound from 7317374439239036928 to 7317374439123898368. Current Snapshot: MvccSnapshot[applied={T|T < 7317374439239036928}]
I20260811 17:12:48.980602 3031 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a32ff216d44045e4b2104c700ff3422a: Sending DeleteTablet for 3 replicas of tablet ab124faaebf541e8a6f2b33fe8aa77f6
I20260811 17:12:48.981516 3534 tablet_service.cc:1514] Processing DeleteTablet for tablet ab124faaebf541e8a6f2b33fe8aa77f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:12:48 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:59550
I20260811 17:12:48.981583 3797 tablet_service.cc:1514] Processing DeleteTablet for tablet ab124faaebf541e8a6f2b33fe8aa77f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:12:48 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:45720
I20260811 17:12:48.982416 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 3167
I20260811 17:12:48.982405 3296 tablet_service.cc:1514] Processing DeleteTablet for tablet ab124faaebf541e8a6f2b33fe8aa77f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:12:48 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:44824
I20260811 17:12:48.994751 3989 tablet_replica.cc:330] T ab124faaebf541e8a6f2b33fe8aa77f6 P 6aa809b6fefe4c24a164b2c5f23b097e: stopping tablet replica
I20260811 17:12:48.995247 3989 raft_consensus.cc:2229] T ab124faaebf541e8a6f2b33fe8aa77f6 P 6aa809b6fefe4c24a164b2c5f23b097e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:12:48.995690 3989 raft_consensus.cc:2258] T ab124faaebf541e8a6f2b33fe8aa77f6 P 6aa809b6fefe4c24a164b2c5f23b097e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:12:48.996206 3988 tablet_replica.cc:330] T ab124faaebf541e8a6f2b33fe8aa77f6 P 2cf1511557044ad48017055b58e2ebc1: stopping tablet replica
I20260811 17:12:48.996587 3988 raft_consensus.cc:2229] T ab124faaebf541e8a6f2b33fe8aa77f6 P 2cf1511557044ad48017055b58e2ebc1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:12:48.996915 3988 raft_consensus.cc:2258] T ab124faaebf541e8a6f2b33fe8aa77f6 P 2cf1511557044ad48017055b58e2ebc1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:12:48.997643 3989 ts_tablet_manager.cc:1905] T ab124faaebf541e8a6f2b33fe8aa77f6 P 6aa809b6fefe4c24a164b2c5f23b097e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:12:48.998647 3988 ts_tablet_manager.cc:1905] T ab124faaebf541e8a6f2b33fe8aa77f6 P 2cf1511557044ad48017055b58e2ebc1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:12:49.000321 3989 ts_tablet_manager.cc:1918] T ab124faaebf541e8a6f2b33fe8aa77f6 P 6aa809b6fefe4c24a164b2c5f23b097e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:12:49.000444 3989 log.cc:1196] T ab124faaebf541e8a6f2b33fe8aa77f6 P 6aa809b6fefe4c24a164b2c5f23b097e: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/ab124faaebf541e8a6f2b33fe8aa77f6
I20260811 17:12:49.000837 3989 ts_tablet_manager.cc:1939] T ab124faaebf541e8a6f2b33fe8aa77f6 P 6aa809b6fefe4c24a164b2c5f23b097e: Deleting consensus metadata
I20260811 17:12:49.002218 3001 catalog_manager.cc:4841] TS 6aa809b6fefe4c24a164b2c5f23b097e (127.4.146.195:34857): tablet ab124faaebf541e8a6f2b33fe8aa77f6 (table test-table [id=20ea2a7d674142428d73629fbb90fbba]) successfully deleted
I20260811 17:12:49.002380 3988 ts_tablet_manager.cc:1918] T ab124faaebf541e8a6f2b33fe8aa77f6 P 2cf1511557044ad48017055b58e2ebc1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:12:49.002506 3988 log.cc:1196] T ab124faaebf541e8a6f2b33fe8aa77f6 P 2cf1511557044ad48017055b58e2ebc1: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786468091870818-4683-0/minicluster-data/ts-1/wal/wals/ab124faaebf541e8a6f2b33fe8aa77f6
I20260811 17:12:49.002893 3988 ts_tablet_manager.cc:1939] T ab124faaebf541e8a6f2b33fe8aa77f6 P 2cf1511557044ad48017055b58e2ebc1: Deleting consensus metadata
W20260811 17:12:49.003142 3001 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.146.193:35837 (error 108)
W20260811 17:12:49.004384 3946 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:12:49.003969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:35837 (local address 127.0.0.1:44840)
0811 17:12:49.004190 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:49.004258 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.193:35837: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 17:12:49.004521 3005 catalog_manager.cc:4841] TS 2cf1511557044ad48017055b58e2ebc1 (127.4.146.194:41677): tablet ab124faaebf541e8a6f2b33fe8aa77f6 (table test-table [id=20ea2a7d674142428d73629fbb90fbba]) successfully deleted
W20260811 17:12:49.004629 3001 catalog_manager.cc:4584] TS d6cc97d02c02464e805568e9b5b14122 (127.4.146.193:35837): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ab124faaebf541e8a6f2b33fe8aa77f6: Network error: Client connection negotiation failed: client connection to 127.4.146.193:35837: connect: Connection reset by peer (error 104)
I20260811 17:12:49.004691 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 3424
I20260811 17:12:49.019554 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 3665
I20260811 17:12:49.030030 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 2977
2026-08-11T17:12:49Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2809 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T17:12:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:12:49Z Disabled control of system clock
I20260811 17:12:49.075778 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:39539
--webserver_interface=127.4.146.254
--webserver_port=0
--builtin_ntp_servers=127.4.146.212:36875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:39539
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 17:12:49.196017 4005 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:49.196365 4005 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:49.196403 4005 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:49.200600 4005 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:12:49.200685 4005 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:49.200702 4005 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:49.200721 4005 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:12:49.200736 4005 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:12:49.205731 4005 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:36875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:39539
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:39539
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4005
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:49.206918 4005 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:49.208443 4005 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:49.217590 4015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:49.217633 4014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:49.217633 4019 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:49.217998 4005 server_base.cc:1034] running on GCE node
I20260811 17:12:49.218804 4005 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:49.220177 4005 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:49.221392 4005 hybrid_clock.cc:648] HybridClock initialized: now 1786468369221359 us; error 49 us; skew 500 ppm
I20260811 17:12:49.223630 4005 webserver.cc:460] Webserver started at http://127.4.146.254:41873/ using document root <none> and password file <none>
I20260811 17:12:49.224344 4005 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:49.224445 4005 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:49.224704 4005 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:12:49.226953 4005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "028992367db2457d9a6fb0a38c1e7df6"
format_stamp: "Formatted at 2026-08-11 17:12:49 on dist-test-slave-7vjv"
server_key: "bac8ba9a273cce6d4b2f2783c55f9ba5"
server_key_iv: "abdea5463facbdb5bd615212b553b614"
server_key_version: "encryptionkey@0"
I20260811 17:12:49.227595 4005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "028992367db2457d9a6fb0a38c1e7df6"
format_stamp: "Formatted at 2026-08-11 17:12:49 on dist-test-slave-7vjv"
server_key: "bac8ba9a273cce6d4b2f2783c55f9ba5"
server_key_iv: "abdea5463facbdb5bd615212b553b614"
server_key_version: "encryptionkey@0"
I20260811 17:12:49.231637 4005 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 17:12:49.234508 4027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:49.235885 4005 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 17:12:49.236064 4005 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "028992367db2457d9a6fb0a38c1e7df6"
format_stamp: "Formatted at 2026-08-11 17:12:49 on dist-test-slave-7vjv"
server_key: "bac8ba9a273cce6d4b2f2783c55f9ba5"
server_key_iv: "abdea5463facbdb5bd615212b553b614"
server_key_version: "encryptionkey@0"
I20260811 17:12:49.236255 4005 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:49.249213 4005 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:49.249961 4005 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:49.250178 4005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:49.257874 4005 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:39539
I20260811 17:12:49.257884 4128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:39539 every 8 connection(s)
I20260811 17:12:49.258889 4005 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:12:49.262213 4129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:49.263588 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 4005
I20260811 17:12:49.263777 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:12:49.264139 4683 external_mini_cluster.cc:1428] Setting key 90e290b00d16e44761050da9ef75b18f
I20260811 17:12:49.268869 4129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 028992367db2457d9a6fb0a38c1e7df6: Bootstrap starting.
I20260811 17:12:49.271883 4129 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 028992367db2457d9a6fb0a38c1e7df6: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:49.272763 4129 log.cc:824] T 00000000000000000000000000000000 P 028992367db2457d9a6fb0a38c1e7df6: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:49.274150 4134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:49.265651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36862 (local address 127.4.146.254:39539)
0811 17:12:49.266307 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:49.266325 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:49.266362 (+ 37us) server_negotiation.cc:407] Connection header received
0811 17:12:49.267075 (+ 713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:49.267093 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:49.267503 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:49.267799 (+ 296us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:49.268239 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:49.269292 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:49.270597 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:49.271114 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:49.271244 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:49.272223 (+ 979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:49.272228 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:49.272244 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:12:49.272677 (+ 433us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:49.272738 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:12:49.272760 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:49.272842 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:49.273043 (+ 201us) server_negotiation.cc:299] Negotiation successful
0811 17:12:49.273356 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":139,"threads_started":1}
I20260811 17:12:49.275102 4129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 028992367db2457d9a6fb0a38c1e7df6: No bootstrap required, opened a new log
I20260811 17:12:49.279066 4129 raft_consensus.cc:348] T 00000000000000000000000000000000 P 028992367db2457d9a6fb0a38c1e7df6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "028992367db2457d9a6fb0a38c1e7df6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 39539 } }
I20260811 17:12:49.279300 4129 raft_consensus.cc:374] T 00000000000000000000000000000000 P 028992367db2457d9a6fb0a38c1e7df6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:49.279335 4129 raft_consensus.cc:729] T 00000000000000000000000000000000 P 028992367db2457d9a6fb0a38c1e7df6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 028992367db2457d9a6fb0a38c1e7df6, State: Initialized, Role: FOLLOWER
I20260811 17:12:49.279773 4129 consensus_queue.cc:260] T 00000000000000000000000000000000 P 028992367db2457d9a6fb0a38c1e7df6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "028992367db2457d9a6fb0a38c1e7df6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 39539 } }
I20260811 17:12:49.279902 4129 raft_consensus.cc:388] T 00000000000000000000000000000000 P 028992367db2457d9a6fb0a38c1e7df6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:12:49.279950 4129 raft_consensus.cc:482] T 00000000000000000000000000000000 P 028992367db2457d9a6fb0a38c1e7df6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:12:49.280023 4129 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 028992367db2457d9a6fb0a38c1e7df6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:49.281008 4129 raft_consensus.cc:504] T 00000000000000000000000000000000 P 028992367db2457d9a6fb0a38c1e7df6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "028992367db2457d9a6fb0a38c1e7df6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 39539 } }
I20260811 17:12:49.281318 4129 leader_election.cc:302] T 00000000000000000000000000000000 P 028992367db2457d9a6fb0a38c1e7df6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 028992367db2457d9a6fb0a38c1e7df6; no voters:
I20260811 17:12:49.281584 4129 leader_election.cc:288] T 00000000000000000000000000000000 P 028992367db2457d9a6fb0a38c1e7df6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:12:49.281724 4142 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 028992367db2457d9a6fb0a38c1e7df6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:12:49.281980 4142 raft_consensus.cc:686] T 00000000000000000000000000000000 P 028992367db2457d9a6fb0a38c1e7df6 [term 1 LEADER]: Becoming Leader. State: Replica: 028992367db2457d9a6fb0a38c1e7df6, State: Running, Role: LEADER
I20260811 17:12:49.282299 4142 consensus_queue.cc:237] T 00000000000000000000000000000000 P 028992367db2457d9a6fb0a38c1e7df6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "028992367db2457d9a6fb0a38c1e7df6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 39539 } }
I20260811 17:12:49.282871 4129 sys_catalog.cc:564] T 00000000000000000000000000000000 P 028992367db2457d9a6fb0a38c1e7df6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:12:49.284574 4143 sys_catalog.cc:455] T 00000000000000000000000000000000 P 028992367db2457d9a6fb0a38c1e7df6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "028992367db2457d9a6fb0a38c1e7df6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "028992367db2457d9a6fb0a38c1e7df6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 39539 } } }
I20260811 17:12:49.284706 4143 sys_catalog.cc:458] T 00000000000000000000000000000000 P 028992367db2457d9a6fb0a38c1e7df6 [sys.catalog]: This master's current role is: LEADER
I20260811 17:12:49.285000 4144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 028992367db2457d9a6fb0a38c1e7df6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 028992367db2457d9a6fb0a38c1e7df6. Latest consensus state: current_term: 1 leader_uuid: "028992367db2457d9a6fb0a38c1e7df6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "028992367db2457d9a6fb0a38c1e7df6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 39539 } } }
I20260811 17:12:49.285104 4144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 028992367db2457d9a6fb0a38c1e7df6 [sys.catalog]: This master's current role is: LEADER
I20260811 17:12:49.285463 4151 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:12:49.288831 4151 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:12:49.294225 4151 catalog_manager.cc:1347] Generated new cluster ID: 6d39624959e2465dbac03459ccd40a9e
I20260811 17:12:49.294305 4151 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:12:49.302224 4151 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:12:49.303149 4151 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:12:49.307780 4151 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 028992367db2457d9a6fb0a38c1e7df6: Generated new TSK 0
I20260811 17:12:49.308619 4151 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:12:49.319660 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:39539
--builtin_ntp_servers=127.4.146.212:36875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 17:12:49.443178 4166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:49.443502 4166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:49.443578 4166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:49.448318 4166 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:49.448417 4166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:49.448518 4166 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:12:49.453640 4166 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:36875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:39539
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:49.454864 4166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:49.456403 4166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:49.467226 4176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:49.467294 4175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:49.467337 4181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:49.467751 4166 server_base.cc:1034] running on GCE node
I20260811 17:12:49.468438 4166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:49.469274 4166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:49.470520 4166 hybrid_clock.cc:648] HybridClock initialized: now 1786468369470504 us; error 44 us; skew 500 ppm
I20260811 17:12:49.472972 4166 webserver.cc:460] Webserver started at http://127.4.146.193:44965/ using document root <none> and password file <none>
I20260811 17:12:49.473657 4166 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:49.473764 4166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:49.474020 4166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:12:49.476356 4166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "37385fcd82c64830b76f23c2ade49658"
format_stamp: "Formatted at 2026-08-11 17:12:49 on dist-test-slave-7vjv"
server_key: "4e2e704a4c067ccf0c9422089c3e9357"
server_key_iv: "ea5f628f8c1dd3ef524e6fb20fb2374d"
server_key_version: "encryptionkey@0"
I20260811 17:12:49.476965 4166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "37385fcd82c64830b76f23c2ade49658"
format_stamp: "Formatted at 2026-08-11 17:12:49 on dist-test-slave-7vjv"
server_key: "4e2e704a4c067ccf0c9422089c3e9357"
server_key_iv: "ea5f628f8c1dd3ef524e6fb20fb2374d"
server_key_version: "encryptionkey@0"
I20260811 17:12:49.481091 4166 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 17:12:49.483942 4191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:49.485414 4166 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 17:12:49.485569 4166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "37385fcd82c64830b76f23c2ade49658"
format_stamp: "Formatted at 2026-08-11 17:12:49 on dist-test-slave-7vjv"
server_key: "4e2e704a4c067ccf0c9422089c3e9357"
server_key_iv: "ea5f628f8c1dd3ef524e6fb20fb2374d"
server_key_version: "encryptionkey@0"
I20260811 17:12:49.485698 4166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:49.503248 4166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:49.504067 4166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:49.504400 4166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:49.505089 4166 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:12:49.506194 4166 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:12:49.506273 4166 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:49.506364 4166 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:12:49.506408 4166 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:49.518296 4166 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:34525
I20260811 17:12:49.518337 4396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:34525 every 8 connection(s)
I20260811 17:12:49.519374 4166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:12:49.528764 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 4166
I20260811 17:12:49.528944 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
I20260811 17:12:49.529284 4683 external_mini_cluster.cc:1428] Setting key 64045a60662c56e526be0822b614b97d
I20260811 17:12:49.529879 4134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:49.521520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:46223 (local address 127.4.146.254:39539)
0811 17:12:49.521668 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:49.521672 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:49.522873 (+ 1201us) server_negotiation.cc:407] Connection header received
0811 17:12:49.524465 (+ 1592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:49.524469 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:49.524541 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:49.524650 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:49.525636 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:49.526204 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:49.527441 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:49.527681 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:49.527793 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:49.529307 (+ 1514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:49.529311 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:49.529314 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:12:49.529334 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:49.529362 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:12:49.529375 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:49.529463 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:49.529660 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 17:12:49.529747 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 17:12:49.531064 4402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:49.521941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:39539 (local address 127.4.146.193:46223)
0811 17:12:49.522706 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:49.522752 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:49.524224 (+ 1472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:49.524852 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:49.524860 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:49.524952 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:12:49.525476 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:49.525490 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:49.526349 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:49.526353 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:49.527304 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:49.527315 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:49.527859 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:49.527864 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:49.528051 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:49.528878 (+ 827us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 17:12:49.528880 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:12:49.529002 (+ 122us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 17:12:49.529117 (+ 115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:12:49.529480 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:12:49.529491 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:12:49.529497 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 17:12:49.529624 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 17:12:49.530020 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":140,"threads_started":1}
I20260811 17:12:49.531527 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:39539
--builtin_ntp_servers=127.4.146.212:36875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 17:12:49.532531 4397 heartbeater.cc:347] Connected to a master server at 127.4.146.254:39539
I20260811 17:12:49.532819 4397 heartbeater.cc:464] Registering TS with master...
I20260811 17:12:49.533529 4397 heartbeater.cc:511] Master 127.4.146.254:39539 requested a full tablet report, sending...
I20260811 17:12:49.535301 4056 ts_manager.cc:194] Registered new tserver with Master: 37385fcd82c64830b76f23c2ade49658 (127.4.146.193:34525)
I20260811 17:12:49.537084 4056 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.146.193:46223
W20260811 17:12:49.655843 4404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:49.656265 4404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:49.656314 4404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:49.660656 4404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:49.660718 4404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:49.660777 4404 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:12:49.665910 4404 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:36875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:39539
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4404
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:49.667038 4404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:49.668416 4404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:49.678539 4418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:49.678606 4422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:49.678622 4429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:49.679067 4404 server_base.cc:1034] running on GCE node
I20260811 17:12:49.679706 4404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:49.680557 4404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:49.681753 4404 hybrid_clock.cc:648] HybridClock initialized: now 1786468369681715 us; error 51 us; skew 500 ppm
I20260811 17:12:49.684070 4404 webserver.cc:460] Webserver started at http://127.4.146.194:41493/ using document root <none> and password file <none>
I20260811 17:12:49.684773 4404 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:49.684878 4404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:49.685087 4404 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:12:49.687404 4404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "514a9292382c4ac9b3cf6cddb0eda917"
format_stamp: "Formatted at 2026-08-11 17:12:49 on dist-test-slave-7vjv"
server_key: "c6f79be9aada031e3b7ea858a0ad4e63"
server_key_iv: "e2b14960e9059545cbb7807f8c6f1695"
server_key_version: "encryptionkey@0"
I20260811 17:12:49.687973 4404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "514a9292382c4ac9b3cf6cddb0eda917"
format_stamp: "Formatted at 2026-08-11 17:12:49 on dist-test-slave-7vjv"
server_key: "c6f79be9aada031e3b7ea858a0ad4e63"
server_key_iv: "e2b14960e9059545cbb7807f8c6f1695"
server_key_version: "encryptionkey@0"
I20260811 17:12:49.692305 4404 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260811 17:12:49.695182 4441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:49.696700 4404 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:12:49.696825 4404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "514a9292382c4ac9b3cf6cddb0eda917"
format_stamp: "Formatted at 2026-08-11 17:12:49 on dist-test-slave-7vjv"
server_key: "c6f79be9aada031e3b7ea858a0ad4e63"
server_key_iv: "e2b14960e9059545cbb7807f8c6f1695"
server_key_version: "encryptionkey@0"
I20260811 17:12:49.696981 4404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:49.727583 4404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:49.728741 4404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:49.729043 4404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:49.729837 4404 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:12:49.731055 4404 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:12:49.731113 4404 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:49.731187 4404 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:12:49.731225 4404 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:49.742384 4404 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:42763
I20260811 17:12:49.742416 4667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:42763 every 8 connection(s)
I20260811 17:12:49.743491 4404 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:12:49.751578 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 4404
I20260811 17:12:49.751761 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:12:49.752231 4683 external_mini_cluster.cc:1428] Setting key ecddb1c380f02934115482728a876449
I20260811 17:12:49.754505 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:39539
--builtin_ntp_servers=127.4.146.212:36875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 17:12:49.755522 4134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:49.745516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:55853 (local address 127.4.146.254:39539)
0811 17:12:49.745704 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:49.745707 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:49.747989 (+ 2282us) server_negotiation.cc:407] Connection header received
0811 17:12:49.749518 (+ 1529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:49.749521 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:49.749578 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:49.749684 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:49.750668 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:49.751231 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:49.753055 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:49.753347 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:49.753481 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:49.754898 (+ 1417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:49.754905 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:49.754910 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:12:49.754929 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:49.754956 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:12:49.754969 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:49.755063 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:49.755226 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 17:12:49.755308 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 17:12:49.756433 4673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:49.745984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:39539 (local address 127.4.146.194:55853)
0811 17:12:49.747795 (+ 1811us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:49.747844 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:49.749262 (+ 1418us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:49.749858 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:49.749865 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:49.749954 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:12:49.750512 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:49.750525 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:49.751398 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:49.751405 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:49.752883 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:49.752895 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:49.753555 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:49.753560 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:49.753803 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:49.754548 (+ 745us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 17:12:49.754551 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:12:49.754604 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 17:12:49.754712 (+ 108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:12:49.755081 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:12:49.755090 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:12:49.755094 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 17:12:49.755199 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 17:12:49.755451 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1382,"thread_start_us":196,"threads_started":1}
I20260811 17:12:49.757692 4670 heartbeater.cc:347] Connected to a master server at 127.4.146.254:39539
I20260811 17:12:49.758005 4670 heartbeater.cc:464] Registering TS with master...
I20260811 17:12:49.758670 4670 heartbeater.cc:511] Master 127.4.146.254:39539 requested a full tablet report, sending...
I20260811 17:12:49.759956 4056 ts_manager.cc:194] Registered new tserver with Master: 514a9292382c4ac9b3cf6cddb0eda917 (127.4.146.194:42763)
I20260811 17:12:49.760676 4056 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.146.194:55853
W20260811 17:12:49.880179 4676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:49.880569 4676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:49.880646 4676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:49.885099 4676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:49.885196 4676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:49.885293 4676 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:12:49.890758 4676 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:36875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:39539
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4676
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:49.892072 4676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:49.893723 4676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:49.904958 4695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:49.904949 4696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:49.904949 4700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:49.905293 4676 server_base.cc:1034] running on GCE node
I20260811 17:12:49.905854 4676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:49.906577 4676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:49.907781 4676 hybrid_clock.cc:648] HybridClock initialized: now 1786468369907764 us; error 28 us; skew 500 ppm
I20260811 17:12:49.910270 4676 webserver.cc:460] Webserver started at http://127.4.146.195:36241/ using document root <none> and password file <none>
I20260811 17:12:49.910948 4676 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:49.911036 4676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:49.911237 4676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:12:49.913825 4676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "07f6469aba2f4ccfb4e681640cb70230"
format_stamp: "Formatted at 2026-08-11 17:12:49 on dist-test-slave-7vjv"
server_key: "55ac69b90bf664864cc367ca1fd162e8"
server_key_iv: "4767aea710981f5e20c52f72d3a01aa0"
server_key_version: "encryptionkey@0"
I20260811 17:12:49.914480 4676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "07f6469aba2f4ccfb4e681640cb70230"
format_stamp: "Formatted at 2026-08-11 17:12:49 on dist-test-slave-7vjv"
server_key: "55ac69b90bf664864cc367ca1fd162e8"
server_key_iv: "4767aea710981f5e20c52f72d3a01aa0"
server_key_version: "encryptionkey@0"
I20260811 17:12:49.918990 4676 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 17:12:49.921988 4712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:49.923557 4676 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 17:12:49.923727 4676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "07f6469aba2f4ccfb4e681640cb70230"
format_stamp: "Formatted at 2026-08-11 17:12:49 on dist-test-slave-7vjv"
server_key: "55ac69b90bf664864cc367ca1fd162e8"
server_key_iv: "4767aea710981f5e20c52f72d3a01aa0"
server_key_version: "encryptionkey@0"
I20260811 17:12:49.923879 4676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:49.945122 4676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:49.945955 4676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:49.946193 4676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:49.946879 4676 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:12:49.947973 4676 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:12:49.948028 4676 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:49.948103 4676 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:12:49.948167 4676 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260811 17:12:49.958423 4676 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:37987
I20260811 17:12:49.958498 4933 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:37987 every 8 connection(s)
I20260811 17:12:49.959512 4676 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:12:49.963948 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 4676
I20260811 17:12:49.964134 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:12:49.964561 4683 external_mini_cluster.cc:1428] Setting key 7f86439321dc4eac66e94de035fb48c2
I20260811 17:12:49.971058 4134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:49.961652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:48355 (local address 127.4.146.254:39539)
0811 17:12:49.961800 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:49.961804 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:49.963113 (+ 1309us) server_negotiation.cc:407] Connection header received
0811 17:12:49.965325 (+ 2212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:49.965329 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:49.965397 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:49.965529 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:49.966720 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:49.967392 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:49.968816 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:49.969081 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:49.969206 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:49.970503 (+ 1297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:49.970512 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:49.970514 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:12:49.970529 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:49.970551 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:12:49.970559 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:49.970642 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:49.970820 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 17:12:49.970896 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 17:12:49.972054 4937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:49.962133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:39539 (local address 127.4.146.195:48355)
0811 17:12:49.962881 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:49.962941 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:49.965035 (+ 2094us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:49.965769 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:49.965779 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:49.965912 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:12:49.966563 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:49.966580 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:49.967547 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:49.967550 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:49.968679 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:49.968690 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:49.969258 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:49.969263 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:49.969467 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:49.970194 (+ 727us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 17:12:49.970196 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:12:49.970244 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 17:12:49.970322 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:12:49.970659 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:12:49.970675 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:12:49.970681 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 17:12:49.970820 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 17:12:49.971171 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":140,"threads_started":1}
I20260811 17:12:49.973343 4934 heartbeater.cc:347] Connected to a master server at 127.4.146.254:39539
I20260811 17:12:49.973639 4934 heartbeater.cc:464] Registering TS with master...
I20260811 17:12:49.974262 4934 heartbeater.cc:511] Master 127.4.146.254:39539 requested a full tablet report, sending...
I20260811 17:12:49.975471 4056 ts_manager.cc:194] Registered new tserver with Master: 07f6469aba2f4ccfb4e681640cb70230 (127.4.146.195:37987)
I20260811 17:12:49.976080 4056 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.146.195:48355
I20260811 17:12:49.979337 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 17:12:49.985697 4134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:49.981554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36988 (local address 127.4.146.254:39539)
0811 17:12:49.981717 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:49.981722 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:49.981856 (+ 134us) server_negotiation.cc:407] Connection header received
0811 17:12:49.982017 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:49.982024 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:49.982072 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:49.982157 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:49.982460 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:49.983028 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:49.983987 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:49.984285 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:49.984397 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:49.985263 (+ 866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:49.985266 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:49.985269 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:12:49.985282 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:49.985308 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:12:49.985316 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:49.985393 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:49.985484 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 17:12:49.985551 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 17:12:49.989305 4056 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36988:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 17:12:49.992903 4056 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:12:50.009979 4958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:50.003071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:37987 (local address 127.0.0.1:38352)
0811 17:12:50.004076 (+ 1005us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:50.004177 (+ 101us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:50.004355 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:50.005104 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:50.005110 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:50.005131 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:50.005298 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:50.005305 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:50.006631 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:50.006638 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:50.008046 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:50.008057 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:50.009345 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:50.009348 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:50.009475 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:50.009516 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 17:12:50.009653 (+ 137us) client_negotiation.cc:240] Negotiation successful
0811 17:12:50.009801 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":788,"thread_start_us":91,"threads_started":1}
I20260811 17:12:50.010035 4960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:50.003635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38352 (local address 127.4.146.195:37987)
0811 17:12:50.004184 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:50.004204 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:50.004535 (+ 331us) server_negotiation.cc:407] Connection header received
0811 17:12:50.004658 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:50.004665 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:50.004918 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:50.005102 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:50.005447 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:50.006489 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:50.008224 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:50.009178 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:50.009323 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:50.009565 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:50.009689 (+ 124us) server_negotiation.cc:299] Negotiation successful
0811 17:12:50.009812 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":121,"threads_started":1}
I20260811 17:12:50.009996 4954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:50.003489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:34525 (local address 127.0.0.1:54918)
0811 17:12:50.004790 (+ 1301us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:50.004806 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:50.004906 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:50.005677 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:50.005681 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:50.005701 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:50.005802 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:50.005808 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:50.007397 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:50.007401 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:50.008518 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:50.008525 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:50.009650 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:50.009653 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:50.009757 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:50.009777 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 17:12:50.009844 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 17:12:50.009902 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1238,"mutex_wait_us":3,"thread_start_us":118,"threads_started":1}
I20260811 17:12:50.010422 4965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:50.004362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53362 (local address 127.4.146.194:42763)
0811 17:12:50.004767 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:50.004780 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:50.004894 (+ 114us) server_negotiation.cc:407] Connection header received
0811 17:12:50.005097 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:50.005103 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:50.005307 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:50.005462 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:50.005727 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:50.006842 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:50.008394 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:50.009237 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:50.009342 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:50.009565 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:50.010104 (+ 539us) server_negotiation.cc:299] Negotiation successful
0811 17:12:50.010231 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":170,"threads_started":1}
I20260811 17:12:50.010658 4964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:50.004256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54918 (local address 127.4.146.193:34525)
0811 17:12:50.004959 (+ 703us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:50.004965 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:50.004993 (+ 28us) server_negotiation.cc:407] Connection header received
0811 17:12:50.005089 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:50.005095 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:50.005291 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:50.005497 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:50.005946 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:50.007261 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:50.008648 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:50.009223 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:50.009359 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:50.009570 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:50.010313 (+ 743us) server_negotiation.cc:299] Negotiation successful
0811 17:12:50.010445 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":592,"thread_start_us":121,"threads_started":1}
I20260811 17:12:50.011723 4955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:50.003111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:42763 (local address 127.0.0.1:53362)
0811 17:12:50.004790 (+ 1679us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:50.004806 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:50.004962 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:50.005448 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:50.005451 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:50.005469 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:50.005600 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:50.005607 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:50.006979 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:50.006983 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:50.008249 (+ 1266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:50.008261 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:50.009647 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:50.009652 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:50.009805 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:50.009832 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 17:12:50.009913 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 17:12:50.009993 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1597,"mutex_wait_us":32,"thread_start_us":128,"threads_started":1}
I20260811 17:12:50.013887 4282 tablet_service.cc:1467] Processing CreateTablet for tablet 66492aac049e436f856a689779c66787 (DEFAULT_TABLE table=test-table [id=52b74a8cf98e45508c8c9e16a10a76f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:12:50.014139 4809 tablet_service.cc:1467] Processing CreateTablet for tablet 66492aac049e436f856a689779c66787 (DEFAULT_TABLE table=test-table [id=52b74a8cf98e45508c8c9e16a10a76f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:12:50.015055 4282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66492aac049e436f856a689779c66787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:50.015326 4809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66492aac049e436f856a689779c66787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:50.015244 4524 tablet_service.cc:1467] Processing CreateTablet for tablet 66492aac049e436f856a689779c66787 (DEFAULT_TABLE table=test-table [id=52b74a8cf98e45508c8c9e16a10a76f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:12:50.016371 4524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66492aac049e436f856a689779c66787. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:50.022536 4969 tablet_bootstrap.cc:492] T 66492aac049e436f856a689779c66787 P 37385fcd82c64830b76f23c2ade49658: Bootstrap starting.
I20260811 17:12:50.024259 4970 tablet_bootstrap.cc:492] T 66492aac049e436f856a689779c66787 P 07f6469aba2f4ccfb4e681640cb70230: Bootstrap starting.
I20260811 17:12:50.025107 4971 tablet_bootstrap.cc:492] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917: Bootstrap starting.
I20260811 17:12:50.025202 4969 tablet_bootstrap.cc:654] T 66492aac049e436f856a689779c66787 P 37385fcd82c64830b76f23c2ade49658: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:50.026001 4969 log.cc:824] T 66492aac049e436f856a689779c66787 P 37385fcd82c64830b76f23c2ade49658: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:50.026854 4970 tablet_bootstrap.cc:654] T 66492aac049e436f856a689779c66787 P 07f6469aba2f4ccfb4e681640cb70230: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:50.027626 4971 tablet_bootstrap.cc:654] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:50.027843 4970 log.cc:824] T 66492aac049e436f856a689779c66787 P 07f6469aba2f4ccfb4e681640cb70230: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:50.028796 4971 log.cc:824] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:50.028841 4969 tablet_bootstrap.cc:492] T 66492aac049e436f856a689779c66787 P 37385fcd82c64830b76f23c2ade49658: No bootstrap required, opened a new log
I20260811 17:12:50.029132 4969 ts_tablet_manager.cc:1397] T 66492aac049e436f856a689779c66787 P 37385fcd82c64830b76f23c2ade49658: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 17:12:50.030346 4970 tablet_bootstrap.cc:492] T 66492aac049e436f856a689779c66787 P 07f6469aba2f4ccfb4e681640cb70230: No bootstrap required, opened a new log
I20260811 17:12:50.030548 4970 ts_tablet_manager.cc:1397] T 66492aac049e436f856a689779c66787 P 07f6469aba2f4ccfb4e681640cb70230: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 17:12:50.030804 4971 tablet_bootstrap.cc:492] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917: No bootstrap required, opened a new log
I20260811 17:12:50.031160 4971 ts_tablet_manager.cc:1397] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 17:12:50.034237 4969 raft_consensus.cc:348] T 66492aac049e436f856a689779c66787 P 37385fcd82c64830b76f23c2ade49658 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514a9292382c4ac9b3cf6cddb0eda917" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42763 } } peers { permanent_uuid: "07f6469aba2f4ccfb4e681640cb70230" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 37987 } } peers { permanent_uuid: "37385fcd82c64830b76f23c2ade49658" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34525 } }
I20260811 17:12:50.034600 4969 raft_consensus.cc:374] T 66492aac049e436f856a689779c66787 P 37385fcd82c64830b76f23c2ade49658 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:50.034683 4969 raft_consensus.cc:729] T 66492aac049e436f856a689779c66787 P 37385fcd82c64830b76f23c2ade49658 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37385fcd82c64830b76f23c2ade49658, State: Initialized, Role: FOLLOWER
I20260811 17:12:50.035228 4969 consensus_queue.cc:260] T 66492aac049e436f856a689779c66787 P 37385fcd82c64830b76f23c2ade49658 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514a9292382c4ac9b3cf6cddb0eda917" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42763 } } peers { permanent_uuid: "07f6469aba2f4ccfb4e681640cb70230" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 37987 } } peers { permanent_uuid: "37385fcd82c64830b76f23c2ade49658" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34525 } }
I20260811 17:12:50.035121 4970 raft_consensus.cc:348] T 66492aac049e436f856a689779c66787 P 07f6469aba2f4ccfb4e681640cb70230 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514a9292382c4ac9b3cf6cddb0eda917" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42763 } } peers { permanent_uuid: "07f6469aba2f4ccfb4e681640cb70230" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 37987 } } peers { permanent_uuid: "37385fcd82c64830b76f23c2ade49658" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34525 } }
I20260811 17:12:50.035398 4970 raft_consensus.cc:374] T 66492aac049e436f856a689779c66787 P 07f6469aba2f4ccfb4e681640cb70230 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:50.035220 4971 raft_consensus.cc:348] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514a9292382c4ac9b3cf6cddb0eda917" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42763 } } peers { permanent_uuid: "07f6469aba2f4ccfb4e681640cb70230" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 37987 } } peers { permanent_uuid: "37385fcd82c64830b76f23c2ade49658" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34525 } }
I20260811 17:12:50.035465 4970 raft_consensus.cc:729] T 66492aac049e436f856a689779c66787 P 07f6469aba2f4ccfb4e681640cb70230 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f6469aba2f4ccfb4e681640cb70230, State: Initialized, Role: FOLLOWER
I20260811 17:12:50.035499 4971 raft_consensus.cc:374] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:50.035569 4971 raft_consensus.cc:729] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514a9292382c4ac9b3cf6cddb0eda917, State: Initialized, Role: FOLLOWER
I20260811 17:12:50.035951 4970 consensus_queue.cc:260] T 66492aac049e436f856a689779c66787 P 07f6469aba2f4ccfb4e681640cb70230 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514a9292382c4ac9b3cf6cddb0eda917" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42763 } } peers { permanent_uuid: "07f6469aba2f4ccfb4e681640cb70230" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 37987 } } peers { permanent_uuid: "37385fcd82c64830b76f23c2ade49658" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34525 } }
I20260811 17:12:50.036114 4397 heartbeater.cc:503] Master 127.4.146.254:39539 was elected leader, sending a full tablet report...
I20260811 17:12:50.036123 4971 consensus_queue.cc:260] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514a9292382c4ac9b3cf6cddb0eda917" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42763 } } peers { permanent_uuid: "07f6469aba2f4ccfb4e681640cb70230" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 37987 } } peers { permanent_uuid: "37385fcd82c64830b76f23c2ade49658" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34525 } }
I20260811 17:12:50.036456 4969 ts_tablet_manager.cc:1428] T 66492aac049e436f856a689779c66787 P 37385fcd82c64830b76f23c2ade49658: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260811 17:12:50.036931 4970 ts_tablet_manager.cc:1428] T 66492aac049e436f856a689779c66787 P 07f6469aba2f4ccfb4e681640cb70230: Time spent starting tablet: real 0.006s user 0.004s sys 0.003s
I20260811 17:12:50.037148 4971 ts_tablet_manager.cc:1428] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 17:12:50.037251 4934 heartbeater.cc:503] Master 127.4.146.254:39539 was elected leader, sending a full tablet report...
I20260811 17:12:50.037495 4670 heartbeater.cc:503] Master 127.4.146.254:39539 was elected leader, sending a full tablet report...
I20260811 17:12:50.146822 4992 raft_consensus.cc:482] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:12:50.147151 4992 raft_consensus.cc:504] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514a9292382c4ac9b3cf6cddb0eda917" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42763 } } peers { permanent_uuid: "07f6469aba2f4ccfb4e681640cb70230" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 37987 } } peers { permanent_uuid: "37385fcd82c64830b76f23c2ade49658" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34525 } }
I20260811 17:12:50.148577 4992 leader_election.cc:288] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07f6469aba2f4ccfb4e681640cb70230 (127.4.146.195:37987), 37385fcd82c64830b76f23c2ade49658 (127.4.146.193:34525)
I20260811 17:12:50.153353 4673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:50.148972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:34525 (local address 127.4.146.194:36251)
0811 17:12:50.149094 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:50.149111 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:50.149237 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:50.149608 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:50.149611 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:50.149639 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:50.149772 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:50.149784 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:50.150776 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:50.150779 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:50.152051 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:50.152061 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:50.152915 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:50.152918 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:50.153006 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:50.153028 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 17:12:50.153118 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 17:12:50.153192 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260811 17:12:50.153383 4964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:50.149144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:36251 (local address 127.4.146.193:34525)
0811 17:12:50.149315 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:50.149322 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:50.149339 (+ 17us) server_negotiation.cc:407] Connection header received
0811 17:12:50.149401 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:50.149405 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:50.149468 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:50.149557 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:50.149910 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:50.150652 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:50.152221 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:50.152793 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:50.152912 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:50.152973 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:50.153156 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 17:12:50.153241 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 17:12:50.153560 4960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:50.149155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:35449 (local address 127.4.146.195:37987)
0811 17:12:50.149280 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:50.149284 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:50.149873 (+ 589us) server_negotiation.cc:407] Connection header received
0811 17:12:50.149963 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:50.149966 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:50.150015 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:50.150100 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:50.150416 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:50.151004 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:50.152386 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:50.152995 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:50.153117 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:50.153164 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:50.153337 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 17:12:50.153410 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 17:12:50.154132 4323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66492aac049e436f856a689779c66787" candidate_uuid: "514a9292382c4ac9b3cf6cddb0eda917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37385fcd82c64830b76f23c2ade49658" is_pre_election: true
I20260811 17:12:50.154270 4993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:50.148972 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:37987 (local address 127.4.146.194:35449)
0811 17:12:50.149735 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:50.149750 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:50.149871 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:50.150156 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:50.150158 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:50.150180 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:50.150291 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:50.150296 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:50.151128 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:50.151132 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:50.152283 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:50.152291 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:50.153129 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:50.153132 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:50.153218 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:50.153238 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 17:12:50.153308 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 17:12:50.153357 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":692,"mutex_wait_us":345,"thread_start_us":147,"threads_started":1}
I20260811 17:12:50.154531 4323 raft_consensus.cc:2454] T 66492aac049e436f856a689779c66787 P 37385fcd82c64830b76f23c2ade49658 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514a9292382c4ac9b3cf6cddb0eda917 in term 0.
I20260811 17:12:50.155053 4846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66492aac049e436f856a689779c66787" candidate_uuid: "514a9292382c4ac9b3cf6cddb0eda917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f6469aba2f4ccfb4e681640cb70230" is_pre_election: true
I20260811 17:12:50.155088 4442 leader_election.cc:302] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37385fcd82c64830b76f23c2ade49658, 514a9292382c4ac9b3cf6cddb0eda917; no voters:
I20260811 17:12:50.155345 4846 raft_consensus.cc:2454] T 66492aac049e436f856a689779c66787 P 07f6469aba2f4ccfb4e681640cb70230 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514a9292382c4ac9b3cf6cddb0eda917 in term 0.
I20260811 17:12:50.155349 4992 raft_consensus.cc:2781] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:12:50.155431 4992 raft_consensus.cc:482] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:12:50.155469 4992 raft_consensus.cc:3037] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:50.156677 4992 raft_consensus.cc:504] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514a9292382c4ac9b3cf6cddb0eda917" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42763 } } peers { permanent_uuid: "07f6469aba2f4ccfb4e681640cb70230" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 37987 } } peers { permanent_uuid: "37385fcd82c64830b76f23c2ade49658" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34525 } }
I20260811 17:12:50.157068 4992 leader_election.cc:288] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917 [CANDIDATE]: Term 1 election: Requested vote from peers 07f6469aba2f4ccfb4e681640cb70230 (127.4.146.195:37987), 37385fcd82c64830b76f23c2ade49658 (127.4.146.193:34525)
I20260811 17:12:50.157488 4846 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66492aac049e436f856a689779c66787" candidate_uuid: "514a9292382c4ac9b3cf6cddb0eda917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07f6469aba2f4ccfb4e681640cb70230"
I20260811 17:12:50.157616 4323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66492aac049e436f856a689779c66787" candidate_uuid: "514a9292382c4ac9b3cf6cddb0eda917" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37385fcd82c64830b76f23c2ade49658"
I20260811 17:12:50.157629 4846 raft_consensus.cc:3037] T 66492aac049e436f856a689779c66787 P 07f6469aba2f4ccfb4e681640cb70230 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:50.157774 4323 raft_consensus.cc:3037] T 66492aac049e436f856a689779c66787 P 37385fcd82c64830b76f23c2ade49658 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:50.158769 4846 raft_consensus.cc:2454] T 66492aac049e436f856a689779c66787 P 07f6469aba2f4ccfb4e681640cb70230 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514a9292382c4ac9b3cf6cddb0eda917 in term 1.
I20260811 17:12:50.158915 4323 raft_consensus.cc:2454] T 66492aac049e436f856a689779c66787 P 37385fcd82c64830b76f23c2ade49658 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514a9292382c4ac9b3cf6cddb0eda917 in term 1.
I20260811 17:12:50.159240 4444 leader_election.cc:302] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07f6469aba2f4ccfb4e681640cb70230, 514a9292382c4ac9b3cf6cddb0eda917; no voters:
I20260811 17:12:50.159469 4992 raft_consensus.cc:2781] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:12:50.159737 4992 raft_consensus.cc:686] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917 [term 1 LEADER]: Becoming Leader. State: Replica: 514a9292382c4ac9b3cf6cddb0eda917, State: Running, Role: LEADER
I20260811 17:12:50.160086 4992 consensus_queue.cc:237] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514a9292382c4ac9b3cf6cddb0eda917" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42763 } } peers { permanent_uuid: "07f6469aba2f4ccfb4e681640cb70230" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 37987 } } peers { permanent_uuid: "37385fcd82c64830b76f23c2ade49658" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34525 } }
I20260811 17:12:50.163349 4056 catalog_manager.cc:5495] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917 reported cstate change: term changed from 0 to 1, leader changed from <none> to 514a9292382c4ac9b3cf6cddb0eda917 (127.4.146.194). New cstate: current_term: 1 leader_uuid: "514a9292382c4ac9b3cf6cddb0eda917" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "514a9292382c4ac9b3cf6cddb0eda917" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 42763 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07f6469aba2f4ccfb4e681640cb70230" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 37987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37385fcd82c64830b76f23c2ade49658" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34525 } health_report { overall_health: UNKNOWN } } }
I20260811 17:12:50.205240 4965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:50.201487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53368 (local address 127.4.146.194:42763)
0811 17:12:50.201668 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:50.201671 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:50.201684 (+ 13us) server_negotiation.cc:407] Connection header received
0811 17:12:50.201767 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:50.201769 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:50.201829 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:50.202033 (+ 204us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:12:50.202292 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:50.202800 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:50.203681 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:50.203898 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:50.204003 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:50.204369 (+ 366us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:12:50.204836 (+ 467us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:12:50.204976 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:50.205013 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 17:12:50.205071 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260811 17:12:50.210703 4935 tablet.cc:2369] T 66492aac049e436f856a689779c66787 P 07f6469aba2f4ccfb4e681640cb70230: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 17:12:50.211788 4846 raft_consensus.cc:1261] T 66492aac049e436f856a689779c66787 P 07f6469aba2f4ccfb4e681640cb70230 [term 1 FOLLOWER]: Refusing update from remote peer 514a9292382c4ac9b3cf6cddb0eda917: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:12:50.211814 4323 raft_consensus.cc:1261] T 66492aac049e436f856a689779c66787 P 37385fcd82c64830b76f23c2ade49658 [term 1 FOLLOWER]: Refusing update from remote peer 514a9292382c4ac9b3cf6cddb0eda917: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:12:50.212642 4997 consensus_queue.cc:1035] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37385fcd82c64830b76f23c2ade49658" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 34525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:12:50.212857 4992 consensus_queue.cc:1035] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f6469aba2f4ccfb4e681640cb70230" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 37987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:12:50.223136 5008 mvcc.cc:205] Tried to move back new op lower bound from 7317374444378857472 to 7317374444178460672. Current Snapshot: MvccSnapshot[applied={T|T < 7317374444378857472}]
I20260811 17:12:50.233318 4051 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36988:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:12:50.233539 4051 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36988:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:12:50.236536 4051 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 028992367db2457d9a6fb0a38c1e7df6: Sending DeleteTablet for 3 replicas of tablet 66492aac049e436f856a689779c66787
I20260811 17:12:50.237483 4524 tablet_service.cc:1514] Processing DeleteTablet for tablet 66492aac049e436f856a689779c66787 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:12:50 UTC) from {username='slave'} at 127.0.0.1:53362
I20260811 17:12:50.237519 4809 tablet_service.cc:1514] Processing DeleteTablet for tablet 66492aac049e436f856a689779c66787 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:12:50 UTC) from {username='slave'} at 127.0.0.1:38352
I20260811 17:12:50.237637 4282 tablet_service.cc:1514] Processing DeleteTablet for tablet 66492aac049e436f856a689779c66787 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:12:50 UTC) from {username='slave'} at 127.0.0.1:54918
I20260811 17:12:50.238121 5026 tablet_replica.cc:330] T 66492aac049e436f856a689779c66787 P 37385fcd82c64830b76f23c2ade49658: stopping tablet replica
I20260811 17:12:50.238413 5023 tablet_replica.cc:330] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917: stopping tablet replica
I20260811 17:12:50.238560 5026 raft_consensus.cc:2229] T 66492aac049e436f856a689779c66787 P 37385fcd82c64830b76f23c2ade49658 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:12:50.238708 5023 raft_consensus.cc:2229] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917 [term 1 LEADER]: Raft consensus shutting down.
I20260811 17:12:50.238965 5026 raft_consensus.cc:2258] T 66492aac049e436f856a689779c66787 P 37385fcd82c64830b76f23c2ade49658 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:12:50.239166 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 4166
I20260811 17:12:50.239267 5023 raft_consensus.cc:2258] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:12:50.240016 5025 tablet_replica.cc:330] T 66492aac049e436f856a689779c66787 P 07f6469aba2f4ccfb4e681640cb70230: stopping tablet replica
I20260811 17:12:50.240551 5025 raft_consensus.cc:2229] T 66492aac049e436f856a689779c66787 P 07f6469aba2f4ccfb4e681640cb70230 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:12:50.240996 5025 raft_consensus.cc:2258] T 66492aac049e436f856a689779c66787 P 07f6469aba2f4ccfb4e681640cb70230 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:12:50.244475 5025 ts_tablet_manager.cc:1905] T 66492aac049e436f856a689779c66787 P 07f6469aba2f4ccfb4e681640cb70230: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:12:50.244592 5023 ts_tablet_manager.cc:1905] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:12:50.247478 5023 ts_tablet_manager.cc:1918] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:12:50.247478 5025 ts_tablet_manager.cc:1918] T 66492aac049e436f856a689779c66787 P 07f6469aba2f4ccfb4e681640cb70230: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:12:50.247591 5023 log.cc:1196] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-1/wal/wals/66492aac049e436f856a689779c66787
I20260811 17:12:50.247597 5025 log.cc:1196] T 66492aac049e436f856a689779c66787 P 07f6469aba2f4ccfb4e681640cb70230: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/66492aac049e436f856a689779c66787
I20260811 17:12:50.247942 5025 ts_tablet_manager.cc:1939] T 66492aac049e436f856a689779c66787 P 07f6469aba2f4ccfb4e681640cb70230: Deleting consensus metadata
I20260811 17:12:50.247942 5023 ts_tablet_manager.cc:1939] T 66492aac049e436f856a689779c66787 P 514a9292382c4ac9b3cf6cddb0eda917: Deleting consensus metadata
I20260811 17:12:50.249467 4029 catalog_manager.cc:4841] TS 07f6469aba2f4ccfb4e681640cb70230 (127.4.146.195:37987): tablet 66492aac049e436f856a689779c66787 (table test-table [id=52b74a8cf98e45508c8c9e16a10a76f9]) successfully deleted
I20260811 17:12:50.249826 4031 catalog_manager.cc:4841] TS 514a9292382c4ac9b3cf6cddb0eda917 (127.4.146.194:42763): tablet 66492aac049e436f856a689779c66787 (table test-table [id=52b74a8cf98e45508c8c9e16a10a76f9]) successfully deleted
W20260811 17:12:50.256865 4028 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.146.193:34525 (error 108)
I20260811 17:12:50.258060 4955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:50.257780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:34525 (local address 127.0.0.1:54920)
0811 17:12:50.257915 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:50.257982 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.193:34525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 17:12:50.258074 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 4404
W20260811 17:12:50.269882 4028 catalog_manager.cc:4584] TS 37385fcd82c64830b76f23c2ade49658 (127.4.146.193:34525): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 66492aac049e436f856a689779c66787: Network error: Client connection negotiation failed: client connection to 127.4.146.193:34525: connect: Connection refused (error 111)
I20260811 17:12:50.278272 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 4676
I20260811 17:12:50.313154 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 4005
2026-08-11T17:12:50Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1285 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:12:50 dist-test-slave-7vjv krb5kdc[5035](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:12:50 dist-test-slave-7vjv krb5kdc[5035](info): set up 2 sockets
Aug 11 17:12:50 dist-test-slave-7vjv krb5kdc[5035](info): commencing operation
krb5kdc: starting...
W20260811 17:12:51.663743 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.313s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:12:51 dist-test-slave-7vjv krb5kdc[5035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468371, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:12:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:12:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:12:51.818425 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:41179
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:35669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:41179
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:12:51.952041 5061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:51.952392 5061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:51.952450 5061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:51.957211 5061 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:12:51.957293 5061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:51.957314 5061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:51.957330 5061 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:12:51.957346 5061 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:12:51.963234 5061 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:35669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:41179
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:41179
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5061
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:51.964864 5061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:51.966215 5061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:51.975456 5076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:51.975456 5078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:51.975477 5080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:51.975982 5061 server_base.cc:1034] running on GCE node
I20260811 17:12:51.976804 5061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:51.978060 5061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:51.979283 5061 hybrid_clock.cc:648] HybridClock initialized: now 1786468371979246 us; error 49 us; skew 500 ppm
Aug 11 17:12:51 dist-test-slave-7vjv krb5kdc[5035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468371, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:12:51.986390 5061 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:12:51.987732 5061 webserver.cc:460] Webserver started at http://127.4.146.254:36601/ using document root <none> and password file <none>
I20260811 17:12:51.988528 5061 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:51.988651 5061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:51.988976 5061 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:12:51.991547 5061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "e6fb9c8879bb4b80adbd7eaa067e99dc"
format_stamp: "Formatted at 2026-08-11 17:12:51 on dist-test-slave-7vjv"
server_key: "95ecf62516437ff82a2f1271369911a5"
server_key_iv: "f3cccc46e20b241d923018e4de06e2ba"
server_key_version: "encryptionkey@0"
I20260811 17:12:51.992355 5061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "e6fb9c8879bb4b80adbd7eaa067e99dc"
format_stamp: "Formatted at 2026-08-11 17:12:51 on dist-test-slave-7vjv"
server_key: "95ecf62516437ff82a2f1271369911a5"
server_key_iv: "f3cccc46e20b241d923018e4de06e2ba"
server_key_version: "encryptionkey@0"
I20260811 17:12:51.997009 5061 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 17:12:52.000483 5096 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:52.001964 5061 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 17:12:52.002159 5061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "e6fb9c8879bb4b80adbd7eaa067e99dc"
format_stamp: "Formatted at 2026-08-11 17:12:51 on dist-test-slave-7vjv"
server_key: "95ecf62516437ff82a2f1271369911a5"
server_key_iv: "f3cccc46e20b241d923018e4de06e2ba"
server_key_version: "encryptionkey@0"
I20260811 17:12:52.002312 5061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:52.019886 5061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:52.024672 5061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:52.024924 5061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:52.033041 5061 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:41179
I20260811 17:12:52.033342 5183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:41179 every 8 connection(s)
I20260811 17:12:52.034210 5061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:12:52.037364 5184 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:52.040135 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 5061
I20260811 17:12:52.040395 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:12:52.040745 4683 external_mini_cluster.cc:1428] Setting key bfc6dc0f3c6955d20005385b1cb33b8f
I20260811 17:12:52.045097 5184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6fb9c8879bb4b80adbd7eaa067e99dc: Bootstrap starting.
I20260811 17:12:52.048038 5184 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e6fb9c8879bb4b80adbd7eaa067e99dc: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:52.049264 5184 log.cc:824] T 00000000000000000000000000000000 P e6fb9c8879bb4b80adbd7eaa067e99dc: Log is configured to *not* fsync() on all Append() calls
Aug 11 17:12:52 dist-test-slave-7vjv krb5kdc[5035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468371, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:12:52.051890 5184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6fb9c8879bb4b80adbd7eaa067e99dc: No bootstrap required, opened a new log
I20260811 17:12:52.057041 5184 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6fb9c8879bb4b80adbd7eaa067e99dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6fb9c8879bb4b80adbd7eaa067e99dc" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41179 } }
I20260811 17:12:52.057365 5184 raft_consensus.cc:374] T 00000000000000000000000000000000 P e6fb9c8879bb4b80adbd7eaa067e99dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:52.057430 5184 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6fb9c8879bb4b80adbd7eaa067e99dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6fb9c8879bb4b80adbd7eaa067e99dc, State: Initialized, Role: FOLLOWER
I20260811 17:12:52.057969 5187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:52.042331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54340 (local address 127.4.146.254:41179)
0811 17:12:52.042843 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:52.042865 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:52.042913 (+ 48us) server_negotiation.cc:407] Connection header received
0811 17:12:52.043782 (+ 869us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:52.043808 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:52.044296 (+ 488us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:52.044706 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:52.045565 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.047106 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.048355 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.048948 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.049173 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:52.052265 (+ 3092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:52.052275 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:52.052294 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:12:52.052335 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:52.054459 (+ 2124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:52.054980 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:52.054986 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:52.054992 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:52.055152 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:52.055422 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:52.055425 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:52.055427 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:52.056018 (+ 591us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:52.056270 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:52.056595 (+ 325us) server_negotiation.cc:299] Negotiation successful
0811 17:12:52.056924 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":142,"threads_started":1}
I20260811 17:12:52.057930 5184 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6fb9c8879bb4b80adbd7eaa067e99dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6fb9c8879bb4b80adbd7eaa067e99dc" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41179 } }
I20260811 17:12:52.058100 5184 raft_consensus.cc:388] T 00000000000000000000000000000000 P e6fb9c8879bb4b80adbd7eaa067e99dc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:12:52.058169 5184 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6fb9c8879bb4b80adbd7eaa067e99dc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:12:52.058279 5184 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6fb9c8879bb4b80adbd7eaa067e99dc [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:52.059562 5184 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6fb9c8879bb4b80adbd7eaa067e99dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6fb9c8879bb4b80adbd7eaa067e99dc" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41179 } }
I20260811 17:12:52.059970 5184 leader_election.cc:302] T 00000000000000000000000000000000 P e6fb9c8879bb4b80adbd7eaa067e99dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6fb9c8879bb4b80adbd7eaa067e99dc; no voters:
I20260811 17:12:52.060357 5184 leader_election.cc:288] T 00000000000000000000000000000000 P e6fb9c8879bb4b80adbd7eaa067e99dc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:12:52.060485 5191 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e6fb9c8879bb4b80adbd7eaa067e99dc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:12:52.060756 5191 raft_consensus.cc:686] T 00000000000000000000000000000000 P e6fb9c8879bb4b80adbd7eaa067e99dc [term 1 LEADER]: Becoming Leader. State: Replica: e6fb9c8879bb4b80adbd7eaa067e99dc, State: Running, Role: LEADER
I20260811 17:12:52.061101 5191 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6fb9c8879bb4b80adbd7eaa067e99dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6fb9c8879bb4b80adbd7eaa067e99dc" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41179 } }
I20260811 17:12:52.061703 5184 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6fb9c8879bb4b80adbd7eaa067e99dc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:12:52.062695 5191 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6fb9c8879bb4b80adbd7eaa067e99dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6fb9c8879bb4b80adbd7eaa067e99dc. Latest consensus state: current_term: 1 leader_uuid: "e6fb9c8879bb4b80adbd7eaa067e99dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6fb9c8879bb4b80adbd7eaa067e99dc" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41179 } } }
I20260811 17:12:52.062855 5191 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6fb9c8879bb4b80adbd7eaa067e99dc [sys.catalog]: This master's current role is: LEADER
I20260811 17:12:52.063129 5195 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6fb9c8879bb4b80adbd7eaa067e99dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e6fb9c8879bb4b80adbd7eaa067e99dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6fb9c8879bb4b80adbd7eaa067e99dc" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41179 } } }
I20260811 17:12:52.063221 5195 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6fb9c8879bb4b80adbd7eaa067e99dc [sys.catalog]: This master's current role is: LEADER
I20260811 17:12:52.063372 5206 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:12:52.067178 5206 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:12:52.073463 5206 catalog_manager.cc:1347] Generated new cluster ID: 5826f5d36b1e4f2bbf9781694973dfed
I20260811 17:12:52.073555 5206 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:12:52.081823 5206 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:12:52.082942 5206 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:12:52.093739 5206 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e6fb9c8879bb4b80adbd7eaa067e99dc: Generated new TSK 0
I20260811 17:12:52.094643 5206 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
I20260811 17:12:52.140224 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:41179
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:35669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:12:52.272516 5232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:52.272882 5232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:52.272965 5232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:52.277359 5232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:52.277472 5232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:52.277577 5232 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:12:52.283576 5232 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:35669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:41179
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5232
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:52.284942 5232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:52.286056 5232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:52.296980 5239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:52.296972 5238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:52.296972 5243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:52.297060 5232 server_base.cc:1034] running on GCE node
I20260811 17:12:52.297966 5232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:52.298831 5232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:52.300065 5232 hybrid_clock.cc:648] HybridClock initialized: now 1786468372300039 us; error 39 us; skew 500 ppm
Aug 11 17:12:52 dist-test-slave-7vjv krb5kdc[5035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468372, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:12:52.303527 5232 init.cc:377] Logged in from keytab as kudu/127.4.146.193@KRBTEST.COM (short username kudu)
I20260811 17:12:52.304642 5232 webserver.cc:460] Webserver started at http://127.4.146.193:39499/ using document root <none> and password file <none>
I20260811 17:12:52.305238 5232 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:52.305310 5232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:52.305500 5232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:12:52.307837 5232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "fbf8f6c5cb26487eb5e8735d479b92b1"
format_stamp: "Formatted at 2026-08-11 17:12:52 on dist-test-slave-7vjv"
server_key: "cc322843af629caded98130b8d4eb8f1"
server_key_iv: "e036b5cd222ae0198c1d15a8bad2a772"
server_key_version: "encryptionkey@0"
I20260811 17:12:52.308491 5232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "fbf8f6c5cb26487eb5e8735d479b92b1"
format_stamp: "Formatted at 2026-08-11 17:12:52 on dist-test-slave-7vjv"
server_key: "cc322843af629caded98130b8d4eb8f1"
server_key_iv: "e036b5cd222ae0198c1d15a8bad2a772"
server_key_version: "encryptionkey@0"
I20260811 17:12:52.312726 5232 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 17:12:52.315646 5260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:52.317206 5232 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:12:52.317369 5232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "fbf8f6c5cb26487eb5e8735d479b92b1"
format_stamp: "Formatted at 2026-08-11 17:12:52 on dist-test-slave-7vjv"
server_key: "cc322843af629caded98130b8d4eb8f1"
server_key_iv: "e036b5cd222ae0198c1d15a8bad2a772"
server_key_version: "encryptionkey@0"
I20260811 17:12:52.317507 5232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:52.338762 5232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:52.343008 5232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:52.343261 5232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:52.344138 5232 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:12:52.345211 5232 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:12:52.345271 5232 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:52.345314 5232 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:12:52.345386 5232 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:52.355219 5232 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:38487
I20260811 17:12:52.355269 5455 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:38487 every 8 connection(s)
I20260811 17:12:52.356369 5232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:12:52.360172 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 5232
I20260811 17:12:52.360342 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
I20260811 17:12:52.360651 4683 external_mini_cluster.cc:1428] Setting key e61802698548b687c7b23921a76492db
Aug 11 17:12:52 dist-test-slave-7vjv krb5kdc[5035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468372, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.146.194@KRBTEST.COM; defaulting to no policy
I20260811 17:12:52.373458 5187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:52.358680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:50539 (local address 127.4.146.254:41179)
0811 17:12:52.358837 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:52.358841 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:52.359945 (+ 1104us) server_negotiation.cc:407] Connection header received
0811 17:12:52.362050 (+ 2105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:52.362054 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:52.362112 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:52.362252 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:52.363809 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.364440 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.365796 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.366064 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.366190 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:52.369447 (+ 3257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:52.369450 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:52.369452 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:12:52.369480 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:52.371030 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:52.371613 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:52.371624 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:52.371626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:52.371726 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:52.372131 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:52.372135 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:52.372136 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:52.372333 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:52.372448 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:52.373139 (+ 691us) server_negotiation.cc:299] Negotiation successful
0811 17:12:52.373285 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 17:12:52.374370 5463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:52.359058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:41179 (local address 127.4.146.193:50539)
0811 17:12:52.359658 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:52.359723 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:52.361795 (+ 2072us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:52.362479 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:52.362487 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:52.362956 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:12:52.363640 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:52.363659 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.364605 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.364608 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:52.365652 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:52.365665 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.366245 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.366249 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:52.366519 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:52.367259 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:12:52.367287 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:12:52.369243 (+ 1956us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:12:52.371173 (+ 1930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:52.371180 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:52.371198 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:52.371489 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:52.371830 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:52.371833 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:52.371835 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:52.371996 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:52.372448 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:12:52.372457 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:12:52.372803 (+ 346us) client_negotiation.cc:769] Sending connection context
0811 17:12:52.373087 (+ 284us) client_negotiation.cc:240] Negotiation successful
0811 17:12:52.373451 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":147,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.194@KRBTEST.COM" created.
I20260811 17:12:52.375844 5456 heartbeater.cc:347] Connected to a master server at 127.4.146.254:41179
I20260811 17:12:52.376207 5456 heartbeater.cc:464] Registering TS with master...
I20260811 17:12:52.376776 5456 heartbeater.cc:511] Master 127.4.146.254:41179 requested a full tablet report, sending...
I20260811 17:12:52.378774 5121 ts_manager.cc:194] Registered new tserver with Master: fbf8f6c5cb26487eb5e8735d479b92b1 (127.4.146.193:38487)
I20260811 17:12:52.379990 5121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.193@KRBTEST.COM'} at 127.4.146.193:50539
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
I20260811 17:12:52.397014 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:41179
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:35669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:12:52.518729 5472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:52.519105 5472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:52.519207 5472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:52.523845 5472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:52.523958 5472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:52.524075 5472 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:12:52.530071 5472 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:35669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:41179
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:52.531204 5472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:52.532262 5472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:52.542737 5479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:52.542737 5480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:52.542769 5483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:52.543197 5472 server_base.cc:1034] running on GCE node
I20260811 17:12:52.543615 5472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:52.544401 5472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:52.545609 5472 hybrid_clock.cc:648] HybridClock initialized: now 1786468372545583 us; error 39 us; skew 500 ppm
Aug 11 17:12:52 dist-test-slave-7vjv krb5kdc[5035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468372, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:12:52.548821 5472 init.cc:377] Logged in from keytab as kudu/127.4.146.194@KRBTEST.COM (short username kudu)
I20260811 17:12:52.549961 5472 webserver.cc:460] Webserver started at http://127.4.146.194:44691/ using document root <none> and password file <none>
I20260811 17:12:52.550685 5472 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:52.550792 5472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:52.551056 5472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:12:52.553437 5472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "27f41b76b3454a18892478158608d16e"
format_stamp: "Formatted at 2026-08-11 17:12:52 on dist-test-slave-7vjv"
server_key: "eab7368c5386b16106257c2cb3930427"
server_key_iv: "e9088cfe570037602010e129e6238025"
server_key_version: "encryptionkey@0"
I20260811 17:12:52.554097 5472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "27f41b76b3454a18892478158608d16e"
format_stamp: "Formatted at 2026-08-11 17:12:52 on dist-test-slave-7vjv"
server_key: "eab7368c5386b16106257c2cb3930427"
server_key_iv: "e9088cfe570037602010e129e6238025"
server_key_version: "encryptionkey@0"
I20260811 17:12:52.558430 5472 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 17:12:52.561216 5495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:52.562707 5472 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:12:52.562870 5472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "27f41b76b3454a18892478158608d16e"
format_stamp: "Formatted at 2026-08-11 17:12:52 on dist-test-slave-7vjv"
server_key: "eab7368c5386b16106257c2cb3930427"
server_key_iv: "e9088cfe570037602010e129e6238025"
server_key_version: "encryptionkey@0"
I20260811 17:12:52.562999 5472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:52.580562 5472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:52.583969 5472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:52.584266 5472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:52.584941 5472 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:12:52.585896 5472 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:12:52.585947 5472 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:52.586016 5472 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:12:52.586064 5472 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:52.596242 5472 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:37437
I20260811 17:12:52.596328 5694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:37437 every 8 connection(s)
I20260811 17:12:52.597311 5472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:12:52.605865 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 5472
I20260811 17:12:52.606027 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:12:52.606348 4683 external_mini_cluster.cc:1428] Setting key c09d1ca679ac9b4b2c0f560699b92e0d
Aug 11 17:12:52 dist-test-slave-7vjv krb5kdc[5035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468372, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:12:52.614231 5187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:52.599457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:33075 (local address 127.4.146.254:41179)
0811 17:12:52.599628 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:52.599632 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:52.600578 (+ 946us) server_negotiation.cc:407] Connection header received
0811 17:12:52.601905 (+ 1327us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:52.601908 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:52.601960 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:52.602041 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:52.603429 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.603963 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.605307 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.605596 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.605729 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:52.609421 (+ 3692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:52.609428 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:52.609434 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:12:52.609474 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:52.611277 (+ 1803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:52.612208 (+ 931us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:52.612212 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:52.612213 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:52.612313 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:52.612817 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:52.612820 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:52.612821 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:52.613041 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:52.613123 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:52.613924 (+ 801us) server_negotiation.cc:299] Negotiation successful
0811 17:12:52.614056 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 17:12:52.615741 5697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:52.599806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:41179 (local address 127.4.146.194:33075)
0811 17:12:52.600406 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:52.600453 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:52.601693 (+ 1240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:52.602258 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:52.602266 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:52.602692 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:12:52.603270 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:52.603285 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.604185 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.604188 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:52.605174 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:52.605185 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.605811 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.605815 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:52.605980 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:52.606878 (+ 898us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:12:52.606902 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:12:52.609213 (+ 2311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:12:52.611437 (+ 2224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:52.611450 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:52.611474 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:52.611951 (+ 477us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:52.612437 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:52.612443 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:52.612448 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:52.612699 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:52.613164 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:12:52.613175 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:12:52.613605 (+ 430us) client_negotiation.cc:769] Sending connection context
0811 17:12:52.613853 (+ 248us) client_negotiation.cc:240] Negotiation successful
0811 17:12:52.614350 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":122,"threads_started":1}
I20260811 17:12:52.617589 5695 heartbeater.cc:347] Connected to a master server at 127.4.146.254:41179
I20260811 17:12:52.617905 5695 heartbeater.cc:464] Registering TS with master...
I20260811 17:12:52.618541 5695 heartbeater.cc:511] Master 127.4.146.254:41179 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.4.146.195@KRBTEST.COM; defaulting to no policy
I20260811 17:12:52.619980 5121 ts_manager.cc:194] Registered new tserver with Master: 27f41b76b3454a18892478158608d16e (127.4.146.194:37437)
I20260811 17:12:52.620785 5121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.194@KRBTEST.COM'} at 127.4.146.194:33075
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
I20260811 17:12:52.644800 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:41179
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:35669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:12:52.768525 5703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:52.768831 5703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:52.768878 5703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:52.773231 5703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:52.773301 5703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:52.773367 5703 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:12:52.779021 5703 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:35669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:41179
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5703
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:52.780298 5703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:52.781383 5703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:52.791929 5710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:52.791929 5713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:52.791937 5711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:52.792404 5703 server_base.cc:1034] running on GCE node
I20260811 17:12:52.792865 5703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:52.793608 5703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:52.794878 5703 hybrid_clock.cc:648] HybridClock initialized: now 1786468372794837 us; error 54 us; skew 500 ppm
Aug 11 17:12:52 dist-test-slave-7vjv krb5kdc[5035](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468372, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:12:52.798107 5703 init.cc:377] Logged in from keytab as kudu/127.4.146.195@KRBTEST.COM (short username kudu)
I20260811 17:12:52.799130 5703 webserver.cc:460] Webserver started at http://127.4.146.195:39919/ using document root <none> and password file <none>
I20260811 17:12:52.799846 5703 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:52.799965 5703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:52.800307 5703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:12:52.802564 5703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "330687ef33a34d5b9883fb4f5e0ed373"
format_stamp: "Formatted at 2026-08-11 17:12:52 on dist-test-slave-7vjv"
server_key: "a39a816d3c6818f56b739f828790a0f9"
server_key_iv: "37236c5bc09722cbbd0faef2e9edc870"
server_key_version: "encryptionkey@0"
I20260811 17:12:52.803203 5703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "330687ef33a34d5b9883fb4f5e0ed373"
format_stamp: "Formatted at 2026-08-11 17:12:52 on dist-test-slave-7vjv"
server_key: "a39a816d3c6818f56b739f828790a0f9"
server_key_iv: "37236c5bc09722cbbd0faef2e9edc870"
server_key_version: "encryptionkey@0"
I20260811 17:12:52.807755 5703 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 17:12:52.810984 5726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:52.812569 5703 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260811 17:12:52.812726 5703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "330687ef33a34d5b9883fb4f5e0ed373"
format_stamp: "Formatted at 2026-08-11 17:12:52 on dist-test-slave-7vjv"
server_key: "a39a816d3c6818f56b739f828790a0f9"
server_key_iv: "37236c5bc09722cbbd0faef2e9edc870"
server_key_version: "encryptionkey@0"
I20260811 17:12:52.812853 5703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:52.839814 5703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:52.843690 5703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:52.843928 5703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:52.844682 5703 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:12:52.845595 5703 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:12:52.845679 5703 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:52.845754 5703 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:12:52.845798 5703 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:52.856240 5703 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:44371
I20260811 17:12:52.856326 5918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:44371 every 8 connection(s)
I20260811 17:12:52.857326 5703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:12:52.864142 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 5703
I20260811 17:12:52.864319 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:12:52.864678 4683 external_mini_cluster.cc:1428] Setting key 89b0ab47164232df4159b5a8adba8ad3
Aug 11 17:12:52 dist-test-slave-7vjv krb5kdc[5035](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468372, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:12:52.875150 5187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:52.859533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:47297 (local address 127.4.146.254:41179)
0811 17:12:52.859773 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:52.859780 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:52.860782 (+ 1002us) server_negotiation.cc:407] Connection header received
0811 17:12:52.862386 (+ 1604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:52.862389 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:52.862448 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:52.862533 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:52.864612 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.865217 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.867160 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.867450 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.867570 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:52.870419 (+ 2849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:52.870423 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:52.870425 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:12:52.870468 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:52.872401 (+ 1933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:52.873104 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:52.873108 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:52.873109 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:52.873249 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:52.873648 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:52.873652 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:52.873653 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:52.873969 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:52.874142 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:52.874737 (+ 595us) server_negotiation.cc:299] Negotiation successful
0811 17:12:52.874940 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260811 17:12:52.876019 5924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:52.860006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:41179 (local address 127.4.146.195:47297)
0811 17:12:52.860594 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:52.860646 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:52.862084 (+ 1438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:52.862941 (+ 857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:52.862996 (+ 55us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:52.863604 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:12:52.864386 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:52.864414 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.865373 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.865376 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:52.866676 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:52.866689 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.867624 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.867629 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:52.867832 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:52.868514 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:12:52.868532 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:12:52.870203 (+ 1671us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:12:52.872554 (+ 2351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:52.872560 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:52.872576 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:52.872920 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:52.873352 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:52.873354 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:52.873356 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:52.873528 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:52.874131 (+ 603us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:12:52.874144 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:12:52.874446 (+ 302us) client_negotiation.cc:769] Sending connection context
0811 17:12:52.874624 (+ 178us) client_negotiation.cc:240] Negotiation successful
0811 17:12:52.874947 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":143,"threads_started":1}
I20260811 17:12:52.877732 5919 heartbeater.cc:347] Connected to a master server at 127.4.146.254:41179
I20260811 17:12:52.878039 5919 heartbeater.cc:464] Registering TS with master...
I20260811 17:12:52.878819 5919 heartbeater.cc:511] Master 127.4.146.254:41179 requested a full tablet report, sending...
I20260811 17:12:52.880280 5121 ts_manager.cc:194] Registered new tserver with Master: 330687ef33a34d5b9883fb4f5e0ed373 (127.4.146.195:44371)
I20260811 17:12:52.880913 5121 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.195@KRBTEST.COM'} at 127.4.146.195:47297
I20260811 17:12:52.892549 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 17:12:52.905230 5187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:52.895054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54348 (local address 127.4.146.254:41179)
0811 17:12:52.895238 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:52.895242 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:52.895405 (+ 163us) server_negotiation.cc:407] Connection header received
0811 17:12:52.895532 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:52.895535 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:52.895581 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:52.895660 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:52.896528 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.897078 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.898056 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.898322 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.898437 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:52.900730 (+ 2293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:52.900734 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:52.900736 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:12:52.900768 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:52.902627 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:52.903392 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:52.903396 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:52.903398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:52.903536 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:52.903960 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:52.903964 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:52.903965 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:52.904371 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:52.904509 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:52.904864 (+ 355us) server_negotiation.cc:299] Negotiation successful
0811 17:12:52.905013 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 17:12:52.909184 5121 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54348:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 17:12:52.912648 5121 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:12:52.930142 5943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:52.922990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:44371 (local address 127.0.0.1:54704)
0811 17:12:52.923810 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:52.923880 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:52.924033 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:52.924952 (+ 919us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:52.924960 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:52.924980 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:52.925110 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:52.925115 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.926481 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.926484 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:52.928239 (+ 1755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:52.928253 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.929455 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.929459 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:52.929594 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:52.929647 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 17:12:52.929788 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 17:12:52.929947 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":628,"mutex_wait_us":138,"thread_start_us":127,"threads_started":1}
I20260811 17:12:52.930136 5944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:52.923153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54704 (local address 127.4.146.195:44371)
0811 17:12:52.923595 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:52.923610 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:52.924229 (+ 619us) server_negotiation.cc:407] Connection header received
0811 17:12:52.924322 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:52.924327 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:52.924575 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:52.924736 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:52.925227 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.926364 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.928382 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.929302 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.929421 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:52.929595 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:52.929840 (+ 245us) server_negotiation.cc:299] Negotiation successful
0811 17:12:52.929956 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":114,"threads_started":1}
I20260811 17:12:52.930774 5945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:52.923656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:37437 (local address 127.0.0.1:41652)
0811 17:12:52.924506 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:52.924520 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:52.924612 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:52.925259 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:52.925262 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:52.925285 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:52.925360 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:52.925365 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.926438 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.926442 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:52.928881 (+ 2439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:52.928890 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.930105 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.930108 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:52.930219 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:52.930241 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 17:12:52.930563 (+ 322us) client_negotiation.cc:240] Negotiation successful
0811 17:12:52.930644 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":787,"mutex_wait_us":1262,"thread_start_us":112,"threads_started":1}
I20260811 17:12:52.930871 5948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:52.924042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50692 (local address 127.4.146.193:38487)
0811 17:12:52.924962 (+ 920us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:52.924968 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:52.924989 (+ 21us) server_negotiation.cc:407] Connection header received
0811 17:12:52.925059 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:52.925064 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:52.925227 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:52.925354 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:52.925768 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.926815 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.928450 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.929302 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.929421 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:52.929593 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:52.930044 (+ 451us) server_negotiation.cc:299] Negotiation successful
0811 17:12:52.930183 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":820,"thread_start_us":115,"threads_started":1}
I20260811 17:12:52.931313 5950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:52.924254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41652 (local address 127.4.146.194:37437)
0811 17:12:52.924741 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:52.924755 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:52.924779 (+ 24us) server_negotiation.cc:407] Connection header received
0811 17:12:52.924862 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:52.924868 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:52.925074 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:52.925233 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:52.925456 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.926286 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.929019 (+ 2733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.929776 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.929877 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:52.930035 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:52.930609 (+ 574us) server_negotiation.cc:299] Negotiation successful
0811 17:12:52.930719 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":168,"threads_started":1}
I20260811 17:12:52.932253 5947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:52.923834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:38487 (local address 127.0.0.1:50692)
0811 17:12:52.924793 (+ 959us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:52.924806 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:52.924884 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:52.925515 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:52.925518 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:52.925536 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:52.925623 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:52.925631 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.926933 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.926936 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:52.928283 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:52.928294 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.929667 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.929670 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:52.929744 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:52.929793 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 17:12:52.929867 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 17:12:52.929948 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":898,"mutex_wait_us":162,"thread_start_us":103,"threads_started":1}
I20260811 17:12:52.933561 5811 tablet_service.cc:1467] Processing CreateTablet for tablet 855c541435f04179938a020534cfbced (DEFAULT_TABLE table=test-table [id=63e4c53e476b439ca61ace8f4ded947e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:12:52.933732 5582 tablet_service.cc:1467] Processing CreateTablet for tablet 855c541435f04179938a020534cfbced (DEFAULT_TABLE table=test-table [id=63e4c53e476b439ca61ace8f4ded947e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:12:52.934739 5811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 855c541435f04179938a020534cfbced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:52.934729 5582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 855c541435f04179938a020534cfbced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:52.941664 5956 tablet_bootstrap.cc:492] T 855c541435f04179938a020534cfbced P 27f41b76b3454a18892478158608d16e: Bootstrap starting.
I20260811 17:12:52.942165 5955 tablet_bootstrap.cc:492] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373: Bootstrap starting.
I20260811 17:12:52.942620 5348 tablet_service.cc:1467] Processing CreateTablet for tablet 855c541435f04179938a020534cfbced (DEFAULT_TABLE table=test-table [id=63e4c53e476b439ca61ace8f4ded947e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:12:52.943698 5348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 855c541435f04179938a020534cfbced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:52.944597 5955 tablet_bootstrap.cc:654] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:52.946069 5955 log.cc:824] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:52.946580 5956 tablet_bootstrap.cc:654] T 855c541435f04179938a020534cfbced P 27f41b76b3454a18892478158608d16e: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:52.947804 5956 log.cc:824] T 855c541435f04179938a020534cfbced P 27f41b76b3454a18892478158608d16e: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:52.948612 5955 tablet_bootstrap.cc:492] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373: No bootstrap required, opened a new log
I20260811 17:12:52.948836 5955 ts_tablet_manager.cc:1397] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260811 17:12:52.949817 5956 tablet_bootstrap.cc:492] T 855c541435f04179938a020534cfbced P 27f41b76b3454a18892478158608d16e: No bootstrap required, opened a new log
I20260811 17:12:52.950032 5956 ts_tablet_manager.cc:1397] T 855c541435f04179938a020534cfbced P 27f41b76b3454a18892478158608d16e: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260811 17:12:52.951416 5963 tablet_bootstrap.cc:492] T 855c541435f04179938a020534cfbced P fbf8f6c5cb26487eb5e8735d479b92b1: Bootstrap starting.
I20260811 17:12:52.953013 5955 raft_consensus.cc:348] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330687ef33a34d5b9883fb4f5e0ed373" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 44371 } } peers { permanent_uuid: "fbf8f6c5cb26487eb5e8735d479b92b1" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38487 } } peers { permanent_uuid: "27f41b76b3454a18892478158608d16e" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 37437 } }
I20260811 17:12:52.953440 5955 raft_consensus.cc:374] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:52.953508 5955 raft_consensus.cc:729] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 330687ef33a34d5b9883fb4f5e0ed373, State: Initialized, Role: FOLLOWER
I20260811 17:12:52.954077 5955 consensus_queue.cc:260] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330687ef33a34d5b9883fb4f5e0ed373" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 44371 } } peers { permanent_uuid: "fbf8f6c5cb26487eb5e8735d479b92b1" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38487 } } peers { permanent_uuid: "27f41b76b3454a18892478158608d16e" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 37437 } }
I20260811 17:12:52.954366 5963 tablet_bootstrap.cc:654] T 855c541435f04179938a020534cfbced P fbf8f6c5cb26487eb5e8735d479b92b1: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:52.954298 5956 raft_consensus.cc:348] T 855c541435f04179938a020534cfbced P 27f41b76b3454a18892478158608d16e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330687ef33a34d5b9883fb4f5e0ed373" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 44371 } } peers { permanent_uuid: "fbf8f6c5cb26487eb5e8735d479b92b1" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38487 } } peers { permanent_uuid: "27f41b76b3454a18892478158608d16e" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 37437 } }
I20260811 17:12:52.954640 5956 raft_consensus.cc:374] T 855c541435f04179938a020534cfbced P 27f41b76b3454a18892478158608d16e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:52.954726 5956 raft_consensus.cc:729] T 855c541435f04179938a020534cfbced P 27f41b76b3454a18892478158608d16e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27f41b76b3454a18892478158608d16e, State: Initialized, Role: FOLLOWER
I20260811 17:12:52.955084 5919 heartbeater.cc:503] Master 127.4.146.254:41179 was elected leader, sending a full tablet report...
I20260811 17:12:52.955222 5956 consensus_queue.cc:260] T 855c541435f04179938a020534cfbced P 27f41b76b3454a18892478158608d16e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330687ef33a34d5b9883fb4f5e0ed373" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 44371 } } peers { permanent_uuid: "fbf8f6c5cb26487eb5e8735d479b92b1" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38487 } } peers { permanent_uuid: "27f41b76b3454a18892478158608d16e" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 37437 } }
I20260811 17:12:52.955320 5955 ts_tablet_manager.cc:1428] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 17:12:52.956296 5956 ts_tablet_manager.cc:1428] T 855c541435f04179938a020534cfbced P 27f41b76b3454a18892478158608d16e: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 17:12:52.956739 5695 heartbeater.cc:503] Master 127.4.146.254:41179 was elected leader, sending a full tablet report...
I20260811 17:12:52.956768 5963 log.cc:824] T 855c541435f04179938a020534cfbced P fbf8f6c5cb26487eb5e8735d479b92b1: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:52.959522 5963 tablet_bootstrap.cc:492] T 855c541435f04179938a020534cfbced P fbf8f6c5cb26487eb5e8735d479b92b1: No bootstrap required, opened a new log
I20260811 17:12:52.959858 5963 ts_tablet_manager.cc:1397] T 855c541435f04179938a020534cfbced P fbf8f6c5cb26487eb5e8735d479b92b1: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260811 17:12:52.965588 5963 raft_consensus.cc:348] T 855c541435f04179938a020534cfbced P fbf8f6c5cb26487eb5e8735d479b92b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330687ef33a34d5b9883fb4f5e0ed373" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 44371 } } peers { permanent_uuid: "fbf8f6c5cb26487eb5e8735d479b92b1" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38487 } } peers { permanent_uuid: "27f41b76b3454a18892478158608d16e" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 37437 } }
I20260811 17:12:52.965914 5963 raft_consensus.cc:374] T 855c541435f04179938a020534cfbced P fbf8f6c5cb26487eb5e8735d479b92b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:52.966003 5963 raft_consensus.cc:729] T 855c541435f04179938a020534cfbced P fbf8f6c5cb26487eb5e8735d479b92b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbf8f6c5cb26487eb5e8735d479b92b1, State: Initialized, Role: FOLLOWER
I20260811 17:12:52.966671 5963 consensus_queue.cc:260] T 855c541435f04179938a020534cfbced P fbf8f6c5cb26487eb5e8735d479b92b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330687ef33a34d5b9883fb4f5e0ed373" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 44371 } } peers { permanent_uuid: "fbf8f6c5cb26487eb5e8735d479b92b1" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38487 } } peers { permanent_uuid: "27f41b76b3454a18892478158608d16e" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 37437 } }
I20260811 17:12:52.967666 5456 heartbeater.cc:503] Master 127.4.146.254:41179 was elected leader, sending a full tablet report...
I20260811 17:12:52.967880 5963 ts_tablet_manager.cc:1428] T 855c541435f04179938a020534cfbced P fbf8f6c5cb26487eb5e8735d479b92b1: Time spent starting tablet: real 0.008s user 0.003s sys 0.005s
I20260811 17:12:52.979367 5965 raft_consensus.cc:482] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:12:52.979681 5965 raft_consensus.cc:504] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330687ef33a34d5b9883fb4f5e0ed373" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 44371 } } peers { permanent_uuid: "fbf8f6c5cb26487eb5e8735d479b92b1" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38487 } } peers { permanent_uuid: "27f41b76b3454a18892478158608d16e" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 37437 } }
I20260811 17:12:52.981187 5965 leader_election.cc:288] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fbf8f6c5cb26487eb5e8735d479b92b1 (127.4.146.193:38487), 27f41b76b3454a18892478158608d16e (127.4.146.194:37437)
I20260811 17:12:52.986225 5924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:52.981406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:38487 (local address 127.4.146.195:41779)
0811 17:12:52.981591 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:52.981612 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:52.981730 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:52.982179 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:52.982182 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:52.982208 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:52.982382 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:52.982389 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.983549 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.983553 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:52.984712 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:52.984722 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.985721 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.985725 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:52.985874 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:52.985904 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 17:12:52.985975 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 17:12:52.986051 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 17:12:52.986825 5948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:52.981600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:41779 (local address 127.4.146.193:38487)
0811 17:12:52.981784 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:52.981791 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:52.981810 (+ 19us) server_negotiation.cc:407] Connection header received
0811 17:12:52.981877 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:52.981882 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:52.981936 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:52.982074 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:52.982509 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.983411 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.984849 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.985566 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.985710 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:52.986131 (+ 421us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:52.986175 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 17:12:52.986680 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 17:12:52.987299 5971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:52.981569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:37437 (local address 127.4.146.195:41921)
0811 17:12:52.982521 (+ 952us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:52.982539 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:52.982795 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:52.983154 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:52.983157 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:52.983177 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:52.983320 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:52.983327 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.984396 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.984399 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:52.985700 (+ 1301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:52.985712 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.986758 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.986764 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:52.986876 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:52.986907 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 17:12:52.987045 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 17:12:52.987125 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":873,"mutex_wait_us":1,"thread_start_us":180,"threads_started":1}
I20260811 17:12:52.987308 5950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:52.981822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:41921 (local address 127.4.146.194:37437)
0811 17:12:52.981966 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:52.981972 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:52.982743 (+ 771us) server_negotiation.cc:407] Connection header received
0811 17:12:52.982987 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:52.982990 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:52.983039 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:52.983114 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:52.983447 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.984260 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.985890 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:52.986539 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:52.986709 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:52.986760 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:52.987087 (+ 327us) server_negotiation.cc:299] Negotiation successful
0811 17:12:52.987188 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 17:12:52.987546 5382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "855c541435f04179938a020534cfbced" candidate_uuid: "330687ef33a34d5b9883fb4f5e0ed373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbf8f6c5cb26487eb5e8735d479b92b1" is_pre_election: true
I20260811 17:12:52.987941 5382 raft_consensus.cc:2454] T 855c541435f04179938a020534cfbced P fbf8f6c5cb26487eb5e8735d479b92b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 330687ef33a34d5b9883fb4f5e0ed373 in term 0.
I20260811 17:12:52.988137 5619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "855c541435f04179938a020534cfbced" candidate_uuid: "330687ef33a34d5b9883fb4f5e0ed373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27f41b76b3454a18892478158608d16e" is_pre_election: true
I20260811 17:12:52.988507 5619 raft_consensus.cc:2454] T 855c541435f04179938a020534cfbced P 27f41b76b3454a18892478158608d16e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 330687ef33a34d5b9883fb4f5e0ed373 in term 0.
I20260811 17:12:52.988786 5728 leader_election.cc:302] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330687ef33a34d5b9883fb4f5e0ed373, fbf8f6c5cb26487eb5e8735d479b92b1; no voters:
I20260811 17:12:52.989148 5965 raft_consensus.cc:2781] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:12:52.989360 5965 raft_consensus.cc:482] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:12:52.989447 5965 raft_consensus.cc:3037] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:52.990716 5965 raft_consensus.cc:504] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330687ef33a34d5b9883fb4f5e0ed373" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 44371 } } peers { permanent_uuid: "fbf8f6c5cb26487eb5e8735d479b92b1" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38487 } } peers { permanent_uuid: "27f41b76b3454a18892478158608d16e" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 37437 } }
I20260811 17:12:52.991185 5965 leader_election.cc:288] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373 [CANDIDATE]: Term 1 election: Requested vote from peers fbf8f6c5cb26487eb5e8735d479b92b1 (127.4.146.193:38487), 27f41b76b3454a18892478158608d16e (127.4.146.194:37437)
I20260811 17:12:52.991641 5382 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "855c541435f04179938a020534cfbced" candidate_uuid: "330687ef33a34d5b9883fb4f5e0ed373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fbf8f6c5cb26487eb5e8735d479b92b1"
I20260811 17:12:52.991683 5619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "855c541435f04179938a020534cfbced" candidate_uuid: "330687ef33a34d5b9883fb4f5e0ed373" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27f41b76b3454a18892478158608d16e"
I20260811 17:12:52.991808 5382 raft_consensus.cc:3037] T 855c541435f04179938a020534cfbced P fbf8f6c5cb26487eb5e8735d479b92b1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:52.991822 5619 raft_consensus.cc:3037] T 855c541435f04179938a020534cfbced P 27f41b76b3454a18892478158608d16e [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:52.993105 5619 raft_consensus.cc:2454] T 855c541435f04179938a020534cfbced P 27f41b76b3454a18892478158608d16e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330687ef33a34d5b9883fb4f5e0ed373 in term 1.
I20260811 17:12:52.993147 5382 raft_consensus.cc:2454] T 855c541435f04179938a020534cfbced P fbf8f6c5cb26487eb5e8735d479b92b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330687ef33a34d5b9883fb4f5e0ed373 in term 1.
I20260811 17:12:52.993525 5728 leader_election.cc:302] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330687ef33a34d5b9883fb4f5e0ed373, fbf8f6c5cb26487eb5e8735d479b92b1; no voters:
I20260811 17:12:52.993745 5965 raft_consensus.cc:2781] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:12:52.994026 5965 raft_consensus.cc:686] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373 [term 1 LEADER]: Becoming Leader. State: Replica: 330687ef33a34d5b9883fb4f5e0ed373, State: Running, Role: LEADER
I20260811 17:12:52.994467 5965 consensus_queue.cc:237] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330687ef33a34d5b9883fb4f5e0ed373" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 44371 } } peers { permanent_uuid: "fbf8f6c5cb26487eb5e8735d479b92b1" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38487 } } peers { permanent_uuid: "27f41b76b3454a18892478158608d16e" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 37437 } }
I20260811 17:12:52.997923 5122 catalog_manager.cc:5495] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373 reported cstate change: term changed from 0 to 1, leader changed from <none> to 330687ef33a34d5b9883fb4f5e0ed373 (127.4.146.195). New cstate: current_term: 1 leader_uuid: "330687ef33a34d5b9883fb4f5e0ed373" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330687ef33a34d5b9883fb4f5e0ed373" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 44371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fbf8f6c5cb26487eb5e8735d479b92b1" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27f41b76b3454a18892478158608d16e" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 37437 } health_report { overall_health: UNKNOWN } } }
I20260811 17:12:53.013628 5944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:53.009389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54714 (local address 127.4.146.195:44371)
0811 17:12:53.009549 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:53.009553 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:53.009569 (+ 16us) server_negotiation.cc:407] Connection header received
0811 17:12:53.009688 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:53.009690 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:53.009747 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:53.009851 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:12:53.010140 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:53.010700 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:53.011699 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:53.011974 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:53.012076 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:53.012592 (+ 516us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:12:53.013114 (+ 522us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:12:53.013270 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:53.013438 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 17:12:53.013486 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 17:12:53.020897 5619 raft_consensus.cc:1261] T 855c541435f04179938a020534cfbced P 27f41b76b3454a18892478158608d16e [term 1 FOLLOWER]: Refusing update from remote peer 330687ef33a34d5b9883fb4f5e0ed373: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:12:53.020898 5382 raft_consensus.cc:1261] T 855c541435f04179938a020534cfbced P fbf8f6c5cb26487eb5e8735d479b92b1 [term 1 FOLLOWER]: Refusing update from remote peer 330687ef33a34d5b9883fb4f5e0ed373: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:12:53.021828 5972 consensus_queue.cc:1035] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27f41b76b3454a18892478158608d16e" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 37437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:12:53.022060 5965 consensus_queue.cc:1035] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fbf8f6c5cb26487eb5e8735d479b92b1" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 38487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:12:53.032936 5976 mvcc.cc:205] Tried to move back new op lower bound from 7317374455884873728 to 7317374455788310528. Current Snapshot: MvccSnapshot[applied={T|T < 7317374455884873728}]
I20260811 17:12:53.044438 5122 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:12:53.044672 5122 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54348:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:12:53.047652 5122 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e6fb9c8879bb4b80adbd7eaa067e99dc: Sending DeleteTablet for 3 replicas of tablet 855c541435f04179938a020534cfbced
I20260811 17:12:53.048730 5582 tablet_service.cc:1514] Processing DeleteTablet for tablet 855c541435f04179938a020534cfbced with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:12:53 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:41652
I20260811 17:12:53.048722 5811 tablet_service.cc:1514] Processing DeleteTablet for tablet 855c541435f04179938a020534cfbced with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:12:53 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:54704
I20260811 17:12:53.048731 5348 tablet_service.cc:1514] Processing DeleteTablet for tablet 855c541435f04179938a020534cfbced with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:12:53 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:50692
I20260811 17:12:53.049336 6001 tablet_replica.cc:330] T 855c541435f04179938a020534cfbced P 27f41b76b3454a18892478158608d16e: stopping tablet replica
I20260811 17:12:53.049738 6001 raft_consensus.cc:2229] T 855c541435f04179938a020534cfbced P 27f41b76b3454a18892478158608d16e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:12:53.050139 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 5232
I20260811 17:12:53.050125 6001 raft_consensus.cc:2258] T 855c541435f04179938a020534cfbced P 27f41b76b3454a18892478158608d16e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:12:53.071455 6001 ts_tablet_manager.cc:1905] T 855c541435f04179938a020534cfbced P 27f41b76b3454a18892478158608d16e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:12:53.075354 6001 ts_tablet_manager.cc:1918] T 855c541435f04179938a020534cfbced P 27f41b76b3454a18892478158608d16e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:12:53.075524 6001 log.cc:1196] T 855c541435f04179938a020534cfbced P 27f41b76b3454a18892478158608d16e: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-1/wal/wals/855c541435f04179938a020534cfbced
I20260811 17:12:53.075954 6001 ts_tablet_manager.cc:1939] T 855c541435f04179938a020534cfbced P 27f41b76b3454a18892478158608d16e: Deleting consensus metadata
I20260811 17:12:53.076681 5998 tablet_replica.cc:330] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373: stopping tablet replica
I20260811 17:12:53.077157 5998 raft_consensus.cc:2229] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373 [term 1 LEADER]: Raft consensus shutting down.
I20260811 17:12:53.077723 5998 raft_consensus.cc:2258] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:12:53.078454 5100 catalog_manager.cc:4841] TS 27f41b76b3454a18892478158608d16e (127.4.146.194:37437): tablet 855c541435f04179938a020534cfbced (table test-table [id=63e4c53e476b439ca61ace8f4ded947e]) successfully deleted
I20260811 17:12:53.079557 5998 ts_tablet_manager.cc:1905] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:12:53.082978 5998 ts_tablet_manager.cc:1918] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:12:53.083135 5998 log.cc:1196] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/855c541435f04179938a020534cfbced
I20260811 17:12:53.083567 5998 ts_tablet_manager.cc:1939] T 855c541435f04179938a020534cfbced P 330687ef33a34d5b9883fb4f5e0ed373: Deleting consensus metadata
W20260811 17:12:53.084851 5097 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.146.193:38487 (error 108)
I20260811 17:12:53.085139 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 5472
I20260811 17:12:53.085453 5097 catalog_manager.cc:4841] TS 330687ef33a34d5b9883fb4f5e0ed373 (127.4.146.195:44371): tablet 855c541435f04179938a020534cfbced (table test-table [id=63e4c53e476b439ca61ace8f4ded947e]) successfully deleted
I20260811 17:12:53.119256 5943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:53.118769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:38487 (local address 127.0.0.1:50702)
0811 17:12:53.119027 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:53.119131 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.193:38487: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":155}
W20260811 17:12:53.120399 5097 catalog_manager.cc:4584] TS fbf8f6c5cb26487eb5e8735d479b92b1 (127.4.146.193:38487): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 855c541435f04179938a020534cfbced: Network error: Client connection negotiation failed: client connection to 127.4.146.193:38487: connect: Connection refused (error 111)
I20260811 17:12:53.126729 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 5703
I20260811 17:12:53.139179 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 5061
2026-08-11T17:12:53Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2824 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T17:12:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:12:53Z Disabled control of system clock
I20260811 17:12:53.185557 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:39129
--webserver_interface=127.4.146.254
--webserver_port=0
--builtin_ntp_servers=127.4.146.212:41781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:39129
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 17:12:53.311203 6009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:53.311504 6009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:53.311543 6009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:53.315822 6009 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:12:53.315919 6009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:53.315935 6009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:53.315953 6009 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:12:53.315969 6009 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:12:53.322238 6009 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:41781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:39129
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:39129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6009
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:53.323486 6009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:53.324929 6009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:53.333956 6023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:53.334004 6017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:53.333956 6019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:53.334352 6009 server_base.cc:1034] running on GCE node
I20260811 17:12:53.335114 6009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:53.336525 6009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:53.337704 6009 hybrid_clock.cc:648] HybridClock initialized: now 1786468373337689 us; error 31 us; skew 500 ppm
I20260811 17:12:53.339834 6009 webserver.cc:460] Webserver started at http://127.4.146.254:46099/ using document root <none> and password file <none>
I20260811 17:12:53.340523 6009 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:53.340595 6009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:53.340831 6009 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:12:53.343111 6009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "7aba6c746f48439cb998741aa53fd7d9"
format_stamp: "Formatted at 2026-08-11 17:12:53 on dist-test-slave-7vjv"
server_key: "b4c5ae47b635db76c15d0c09e9a97681"
server_key_iv: "b03bfeccebee61b2d5c5259a75aec5a9"
server_key_version: "encryptionkey@0"
I20260811 17:12:53.343740 6009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "7aba6c746f48439cb998741aa53fd7d9"
format_stamp: "Formatted at 2026-08-11 17:12:53 on dist-test-slave-7vjv"
server_key: "b4c5ae47b635db76c15d0c09e9a97681"
server_key_iv: "b03bfeccebee61b2d5c5259a75aec5a9"
server_key_version: "encryptionkey@0"
I20260811 17:12:53.347759 6009 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260811 17:12:53.350718 6032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:53.352303 6009 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:12:53.352474 6009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "7aba6c746f48439cb998741aa53fd7d9"
format_stamp: "Formatted at 2026-08-11 17:12:53 on dist-test-slave-7vjv"
server_key: "b4c5ae47b635db76c15d0c09e9a97681"
server_key_iv: "b03bfeccebee61b2d5c5259a75aec5a9"
server_key_version: "encryptionkey@0"
I20260811 17:12:53.352609 6009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:53.369751 6009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:53.370558 6009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:53.370777 6009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:53.378377 6009 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:39129
I20260811 17:12:53.378398 6124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:39129 every 8 connection(s)
I20260811 17:12:53.379437 6009 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:12:53.383034 6128 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:53.383754 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 6009
I20260811 17:12:53.383910 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:12:53.384291 4683 external_mini_cluster.cc:1428] Setting key 9eef846d9c1ff15ceb772623c3835cab
I20260811 17:12:53.389750 6128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7aba6c746f48439cb998741aa53fd7d9: Bootstrap starting.
I20260811 17:12:53.392603 6128 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7aba6c746f48439cb998741aa53fd7d9: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:53.393643 6128 log.cc:824] T 00000000000000000000000000000000 P 7aba6c746f48439cb998741aa53fd7d9: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:53.395008 6133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:53.385985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34612 (local address 127.4.146.254:39129)
0811 17:12:53.386678 (+ 693us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:53.386695 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:53.386734 (+ 39us) server_negotiation.cc:407] Connection header received
0811 17:12:53.387391 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:53.387409 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:53.387823 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:53.388223 (+ 400us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:53.388698 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:53.389673 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:53.390653 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:53.391165 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:53.391319 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:53.392608 (+ 1289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:53.392615 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:53.392632 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:12:53.393106 (+ 474us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:53.393169 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:12:53.393191 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:53.393308 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:53.393747 (+ 439us) server_negotiation.cc:299] Negotiation successful
0811 17:12:53.394039 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":149,"threads_started":1}
I20260811 17:12:53.396229 6128 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7aba6c746f48439cb998741aa53fd7d9: No bootstrap required, opened a new log
I20260811 17:12:53.400316 6128 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7aba6c746f48439cb998741aa53fd7d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aba6c746f48439cb998741aa53fd7d9" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 39129 } }
I20260811 17:12:53.400610 6128 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7aba6c746f48439cb998741aa53fd7d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:53.400682 6128 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7aba6c746f48439cb998741aa53fd7d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7aba6c746f48439cb998741aa53fd7d9, State: Initialized, Role: FOLLOWER
I20260811 17:12:53.401126 6128 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7aba6c746f48439cb998741aa53fd7d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aba6c746f48439cb998741aa53fd7d9" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 39129 } }
I20260811 17:12:53.401286 6128 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7aba6c746f48439cb998741aa53fd7d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:12:53.401379 6128 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7aba6c746f48439cb998741aa53fd7d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:12:53.401523 6128 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7aba6c746f48439cb998741aa53fd7d9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:53.402537 6128 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7aba6c746f48439cb998741aa53fd7d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aba6c746f48439cb998741aa53fd7d9" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 39129 } }
I20260811 17:12:53.402909 6128 leader_election.cc:302] T 00000000000000000000000000000000 P 7aba6c746f48439cb998741aa53fd7d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7aba6c746f48439cb998741aa53fd7d9; no voters:
I20260811 17:12:53.403280 6128 leader_election.cc:288] T 00000000000000000000000000000000 P 7aba6c746f48439cb998741aa53fd7d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:12:53.403360 6136 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7aba6c746f48439cb998741aa53fd7d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:12:53.403657 6136 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7aba6c746f48439cb998741aa53fd7d9 [term 1 LEADER]: Becoming Leader. State: Replica: 7aba6c746f48439cb998741aa53fd7d9, State: Running, Role: LEADER
I20260811 17:12:53.403970 6136 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7aba6c746f48439cb998741aa53fd7d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aba6c746f48439cb998741aa53fd7d9" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 39129 } }
I20260811 17:12:53.404711 6128 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7aba6c746f48439cb998741aa53fd7d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:12:53.405740 6137 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7aba6c746f48439cb998741aa53fd7d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7aba6c746f48439cb998741aa53fd7d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aba6c746f48439cb998741aa53fd7d9" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 39129 } } }
I20260811 17:12:53.405892 6137 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7aba6c746f48439cb998741aa53fd7d9 [sys.catalog]: This master's current role is: LEADER
I20260811 17:12:53.406277 6138 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7aba6c746f48439cb998741aa53fd7d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7aba6c746f48439cb998741aa53fd7d9. Latest consensus state: current_term: 1 leader_uuid: "7aba6c746f48439cb998741aa53fd7d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7aba6c746f48439cb998741aa53fd7d9" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 39129 } } }
I20260811 17:12:53.406435 6138 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7aba6c746f48439cb998741aa53fd7d9 [sys.catalog]: This master's current role is: LEADER
I20260811 17:12:53.407074 6153 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:12:53.409957 6153 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:12:53.416332 6153 catalog_manager.cc:1347] Generated new cluster ID: 3c3a01a2c4894e05b8557bbc57b50384
I20260811 17:12:53.416503 6153 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:12:53.435957 6153 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:12:53.437358 6153 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:12:53.454427 6153 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7aba6c746f48439cb998741aa53fd7d9: Generated new TSK 0
I20260811 17:12:53.455289 6153 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:12:53.468322 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:39129
--builtin_ntp_servers=127.4.146.212:41781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 17:12:53.592756 6173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:53.593071 6173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:53.593112 6173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:53.597355 6173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:53.597419 6173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:53.597512 6173 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:12:53.602556 6173 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:41781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:39129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:53.603729 6173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:53.605685 6173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:53.616411 6192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:53.616590 6173 server_base.cc:1034] running on GCE node
W20260811 17:12:53.616415 6185 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:53.616794 6186 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:53.617256 6173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:53.618024 6173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:53.619206 6173 hybrid_clock.cc:648] HybridClock initialized: now 1786468373619167 us; error 55 us; skew 500 ppm
I20260811 17:12:53.621485 6173 webserver.cc:460] Webserver started at http://127.4.146.193:41553/ using document root <none> and password file <none>
I20260811 17:12:53.622174 6173 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:53.622282 6173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:53.622527 6173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:12:53.625072 6173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "af78e3c3d2a04b65a70088dfba1232ba"
format_stamp: "Formatted at 2026-08-11 17:12:53 on dist-test-slave-7vjv"
server_key: "6d2bbaf346ec0019124dadbf1c97c66c"
server_key_iv: "d4222b98dee145884ce13cd5886c9ad8"
server_key_version: "encryptionkey@0"
I20260811 17:12:53.625728 6173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "af78e3c3d2a04b65a70088dfba1232ba"
format_stamp: "Formatted at 2026-08-11 17:12:53 on dist-test-slave-7vjv"
server_key: "6d2bbaf346ec0019124dadbf1c97c66c"
server_key_iv: "d4222b98dee145884ce13cd5886c9ad8"
server_key_version: "encryptionkey@0"
I20260811 17:12:53.629766 6173 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 17:12:53.632433 6201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:53.633855 6173 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260811 17:12:53.634004 6173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "af78e3c3d2a04b65a70088dfba1232ba"
format_stamp: "Formatted at 2026-08-11 17:12:53 on dist-test-slave-7vjv"
server_key: "6d2bbaf346ec0019124dadbf1c97c66c"
server_key_iv: "d4222b98dee145884ce13cd5886c9ad8"
server_key_version: "encryptionkey@0"
I20260811 17:12:53.634140 6173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:53.660712 6173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:53.661617 6173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:53.661867 6173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:53.662606 6173 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:12:53.663759 6173 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:12:53.663815 6173 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:53.663892 6173 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:12:53.663925 6173 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:53.674500 6173 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:45101
I20260811 17:12:53.674567 6415 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:45101 every 8 connection(s)
I20260811 17:12:53.675717 6173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:12:53.677402 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 6173
I20260811 17:12:53.677551 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
I20260811 17:12:53.677943 4683 external_mini_cluster.cc:1428] Setting key 470190d96cc62a333867879536bdec46
I20260811 17:12:53.680691 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:39129
--builtin_ntp_servers=127.4.146.212:41781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 17:12:53.689121 6133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:53.678066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:50985 (local address 127.4.146.254:39129)
0811 17:12:53.678231 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:53.678235 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:53.679638 (+ 1403us) server_negotiation.cc:407] Connection header received
0811 17:12:53.681612 (+ 1974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:53.681619 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:53.681694 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:53.681806 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:53.683231 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:53.683881 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:53.686226 (+ 2345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:53.686596 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:53.686745 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:53.688456 (+ 1711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:53.688459 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:53.688461 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:12:53.688478 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:53.688499 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:12:53.688508 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:53.688578 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:53.688848 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 17:12:53.688926 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 17:12:53.690653 6418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:53.678563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:39129 (local address 127.4.146.193:50985)
0811 17:12:53.679406 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:53.679512 (+ 106us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:53.681319 (+ 1807us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:53.682052 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:53.682061 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:53.682171 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:12:53.682998 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:53.683025 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:53.684056 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:53.684062 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:53.685880 (+ 1818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:53.685902 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:53.686849 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:53.686856 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:53.687161 (+ 305us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:53.688000 (+ 839us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 17:12:53.688002 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:12:53.688080 (+ 78us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 17:12:53.688238 (+ 158us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:12:53.688617 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:12:53.688632 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:12:53.688641 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 17:12:53.688815 (+ 174us) client_negotiation.cc:240] Negotiation successful
0811 17:12:53.689255 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":171,"threads_started":1}
I20260811 17:12:53.692381 6416 heartbeater.cc:347] Connected to a master server at 127.4.146.254:39129
I20260811 17:12:53.692683 6416 heartbeater.cc:464] Registering TS with master...
I20260811 17:12:53.693532 6416 heartbeater.cc:511] Master 127.4.146.254:39129 requested a full tablet report, sending...
I20260811 17:12:53.695529 6061 ts_manager.cc:194] Registered new tserver with Master: af78e3c3d2a04b65a70088dfba1232ba (127.4.146.193:45101)
I20260811 17:12:53.696921 6061 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.146.193:50985
W20260811 17:12:53.807641 6420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:53.807999 6420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:53.808076 6420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:53.812573 6420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:53.812666 6420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:53.812745 6420 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:12:53.817862 6420 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:41781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:39129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6420
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:53.819099 6420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:53.820765 6420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:53.831418 6429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:53.831413 6428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:53.831413 6432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:53.831482 6420 server_base.cc:1034] running on GCE node
I20260811 17:12:53.832212 6420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:53.832950 6420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:53.834133 6420 hybrid_clock.cc:648] HybridClock initialized: now 1786468373834092 us; error 55 us; skew 500 ppm
I20260811 17:12:53.836432 6420 webserver.cc:460] Webserver started at http://127.4.146.194:33659/ using document root <none> and password file <none>
I20260811 17:12:53.837091 6420 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:53.837172 6420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:53.837430 6420 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:12:53.839907 6420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "70aacb4b2a004638b3a841d143629a77"
format_stamp: "Formatted at 2026-08-11 17:12:53 on dist-test-slave-7vjv"
server_key: "ef9712efef42faf7214cb793ec203a87"
server_key_iv: "f62203542132c27aef5de22dd0906b9a"
server_key_version: "encryptionkey@0"
I20260811 17:12:53.840647 6420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "70aacb4b2a004638b3a841d143629a77"
format_stamp: "Formatted at 2026-08-11 17:12:53 on dist-test-slave-7vjv"
server_key: "ef9712efef42faf7214cb793ec203a87"
server_key_iv: "f62203542132c27aef5de22dd0906b9a"
server_key_version: "encryptionkey@0"
I20260811 17:12:53.844970 6420 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 17:12:53.847949 6448 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:53.849505 6420 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:12:53.849697 6420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "70aacb4b2a004638b3a841d143629a77"
format_stamp: "Formatted at 2026-08-11 17:12:53 on dist-test-slave-7vjv"
server_key: "ef9712efef42faf7214cb793ec203a87"
server_key_iv: "f62203542132c27aef5de22dd0906b9a"
server_key_version: "encryptionkey@0"
I20260811 17:12:53.849838 6420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:53.876034 6420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:53.877013 6420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:53.877288 6420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:53.878031 6420 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:12:53.879298 6420 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:12:53.879383 6420 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:53.879479 6420 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:12:53.879529 6420 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:53.890290 6420 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:36075
I20260811 17:12:53.890322 6646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:36075 every 8 connection(s)
I20260811 17:12:53.891479 6420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:12:53.901029 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 6420
I20260811 17:12:53.901222 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:12:53.901633 4683 external_mini_cluster.cc:1428] Setting key c5bd38c5c568d0dd0b669db9c60a10ad
I20260811 17:12:53.902551 6133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:53.893728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:44201 (local address 127.4.146.254:39129)
0811 17:12:53.893911 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:53.893917 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:53.895210 (+ 1293us) server_negotiation.cc:407] Connection header received
0811 17:12:53.896767 (+ 1557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:53.896771 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:53.896824 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:53.896921 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:53.898088 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:53.898626 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:53.900034 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:53.900332 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:53.900418 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:53.901967 (+ 1549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:53.901976 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:53.901978 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:12:53.901994 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:53.902015 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:12:53.902024 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:53.902138 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:53.902332 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 17:12:53.902409 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 17:12:53.903836 6650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:53.894173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:39129 (local address 127.4.146.194:44201)
0811 17:12:53.894991 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:53.895049 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:53.896536 (+ 1487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:53.897186 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:53.897194 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:53.897287 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:12:53.897886 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:53.897903 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:53.898783 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:53.898786 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:53.899899 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:53.899911 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:53.900526 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:53.900530 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:53.900726 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:53.901581 (+ 855us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 17:12:53.901583 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:12:53.901658 (+ 75us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 17:12:53.901765 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:12:53.902167 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:12:53.902176 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:12:53.902181 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 17:12:53.902293 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 17:12:53.902708 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":147,"threads_started":1}
I20260811 17:12:53.903993 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:39129
--builtin_ntp_servers=127.4.146.212:41781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 17:12:53.905284 6648 heartbeater.cc:347] Connected to a master server at 127.4.146.254:39129
I20260811 17:12:53.905622 6648 heartbeater.cc:464] Registering TS with master...
I20260811 17:12:53.906195 6648 heartbeater.cc:511] Master 127.4.146.254:39129 requested a full tablet report, sending...
I20260811 17:12:53.907397 6061 ts_manager.cc:194] Registered new tserver with Master: 70aacb4b2a004638b3a841d143629a77 (127.4.146.194:36075)
I20260811 17:12:53.907989 6061 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.146.194:44201
W20260811 17:12:54.027227 6651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:54.027575 6651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:54.027662 6651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:54.032011 6651 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:54.032171 6651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:54.032269 6651 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:12:54.037576 6651 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:41781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:39129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6651
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:54.038903 6651 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:54.040489 6651 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:54.050982 6657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:54.050982 6658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:54.051008 6663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:54.051404 6651 server_base.cc:1034] running on GCE node
I20260811 17:12:54.051985 6651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:54.052767 6651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:54.054020 6651 hybrid_clock.cc:648] HybridClock initialized: now 1786468374053995 us; error 37 us; skew 500 ppm
I20260811 17:12:54.057008 6651 webserver.cc:460] Webserver started at http://127.4.146.195:36817/ using document root <none> and password file <none>
I20260811 17:12:54.057760 6651 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:54.057870 6651 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:54.058144 6651 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:12:54.060591 6651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "cef709b10cc4462c848206931add518f"
format_stamp: "Formatted at 2026-08-11 17:12:54 on dist-test-slave-7vjv"
server_key: "e01681e72b3ee054cfcc5f34110b15cc"
server_key_iv: "435fd0a542db6b5e3b149dedd9df09c3"
server_key_version: "encryptionkey@0"
I20260811 17:12:54.061235 6651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "cef709b10cc4462c848206931add518f"
format_stamp: "Formatted at 2026-08-11 17:12:54 on dist-test-slave-7vjv"
server_key: "e01681e72b3ee054cfcc5f34110b15cc"
server_key_iv: "435fd0a542db6b5e3b149dedd9df09c3"
server_key_version: "encryptionkey@0"
I20260811 17:12:54.065653 6651 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 17:12:54.068876 6673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:54.070621 6651 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 17:12:54.070812 6651 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "cef709b10cc4462c848206931add518f"
format_stamp: "Formatted at 2026-08-11 17:12:54 on dist-test-slave-7vjv"
server_key: "e01681e72b3ee054cfcc5f34110b15cc"
server_key_iv: "435fd0a542db6b5e3b149dedd9df09c3"
server_key_version: "encryptionkey@0"
I20260811 17:12:54.070971 6651 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:54.086066 6651 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:54.086930 6651 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:54.087193 6651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:54.087900 6651 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:12:54.089085 6651 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:12:54.089169 6651 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:54.089257 6651 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:12:54.089318 6651 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:54.099778 6651 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:40759
I20260811 17:12:54.099804 6878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:40759 every 8 connection(s)
I20260811 17:12:54.100912 6651 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:12:54.104414 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 6651
I20260811 17:12:54.104568 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:12:54.104871 4683 external_mini_cluster.cc:1428] Setting key ca3cabcd0114ca7ee5e6751e3b213fe6
I20260811 17:12:54.111634 6133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:54.102935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:50511 (local address 127.4.146.254:39129)
0811 17:12:54.103087 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:54.103091 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:54.104229 (+ 1138us) server_negotiation.cc:407] Connection header received
0811 17:12:54.106189 (+ 1960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:54.106193 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:54.106275 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:54.106384 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:54.107608 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.108185 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.109436 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.109678 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.109806 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:54.111085 (+ 1279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:54.111089 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:54.111091 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:12:54.111105 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:54.111125 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:12:54.111134 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:54.111222 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:54.111398 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 17:12:54.111474 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 17:12:54.112713 6883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:54.103309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:39129 (local address 127.4.146.195:50511)
0811 17:12:54.104006 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:54.104055 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:54.105938 (+ 1883us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:54.106638 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:54.106649 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:54.106772 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:12:54.107453 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:54.107469 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.108334 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.108338 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:54.109292 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:54.109304 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.109861 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.109865 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:54.110063 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:54.110736 (+ 673us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 17:12:54.110738 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:12:54.110785 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 17:12:54.110863 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:12:54.111223 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:12:54.111237 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:12:54.111245 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 17:12:54.111398 (+ 153us) client_negotiation.cc:240] Negotiation successful
0811 17:12:54.111746 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":116,"threads_started":1}
I20260811 17:12:54.114041 6881 heartbeater.cc:347] Connected to a master server at 127.4.146.254:39129
I20260811 17:12:54.114359 6881 heartbeater.cc:464] Registering TS with master...
I20260811 17:12:54.114964 6881 heartbeater.cc:511] Master 127.4.146.254:39129 requested a full tablet report, sending...
I20260811 17:12:54.116381 6061 ts_manager.cc:194] Registered new tserver with Master: cef709b10cc4462c848206931add518f (127.4.146.195:40759)
I20260811 17:12:54.117079 6061 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.146.195:50511
I20260811 17:12:54.119500 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 17:12:54.126084 6133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:54.121871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34616 (local address 127.4.146.254:39129)
0811 17:12:54.122037 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:54.122041 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:54.122159 (+ 118us) server_negotiation.cc:407] Connection header received
0811 17:12:54.122247 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:54.122250 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:54.122297 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:54.122377 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:54.122706 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.123326 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.124348 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.124617 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.124723 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:54.125618 (+ 895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:54.125621 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:54.125623 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:12:54.125636 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:54.125657 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:12:54.125665 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:54.125778 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:54.125918 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 17:12:54.125957 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 17:12:54.129606 6061 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34616:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 17:12:54.133019 6061 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:12:54.149139 6902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:54.142462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:40759 (local address 127.0.0.1:50244)
0811 17:12:54.143358 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:54.143414 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:54.143555 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:54.144418 (+ 863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:54.144423 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:54.144440 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:54.144549 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:54.144554 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.146033 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.146037 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:54.147335 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:54.147345 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.148507 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.148511 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:54.148622 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:54.148671 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 17:12:54.148799 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 17:12:54.148953 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":716,"mutex_wait_us":35,"thread_start_us":83,"threads_started":1}
I20260811 17:12:54.149354 6906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:54.142599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:45101 (local address 127.0.0.1:50846)
0811 17:12:54.143591 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:54.143606 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:54.143714 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:54.144746 (+ 1032us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:54.144749 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:54.144769 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:54.144874 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:54.144883 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.146235 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.146239 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:54.147407 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:54.147418 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.148994 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.148997 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:54.149082 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:54.149104 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 17:12:54.149155 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 17:12:54.149232 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":920,"mutex_wait_us":69,"thread_start_us":122,"threads_started":1}
I20260811 17:12:54.149165 6904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:54.142685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50244 (local address 127.4.146.195:40759)
0811 17:12:54.143313 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:54.143328 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:54.143720 (+ 392us) server_negotiation.cc:407] Connection header received
0811 17:12:54.143812 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:54.143817 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:54.144029 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:54.144216 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:54.144675 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.145905 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.147486 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.148377 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.148510 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:54.148736 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:54.148836 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 17:12:54.148956 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":220,"threads_started":1}
I20260811 17:12:54.149816 6903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:54.143303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:36075 (local address 127.0.0.1:52182)
0811 17:12:54.144791 (+ 1488us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:54.144804 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:54.144889 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:54.145383 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:54.145387 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:54.145406 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:54.145501 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:54.145508 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.146889 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.146892 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:54.147926 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:54.147935 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.149355 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.149359 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:54.149450 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:54.149476 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 17:12:54.149568 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 17:12:54.149649 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1426,"thread_start_us":146,"threads_started":1}
I20260811 17:12:54.149878 6911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:54.143802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52182 (local address 127.4.146.194:36075)
0811 17:12:54.144196 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:54.144209 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:54.144944 (+ 735us) server_negotiation.cc:407] Connection header received
0811 17:12:54.145087 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:54.145091 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:54.145242 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:54.145409 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:54.145605 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.146751 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.148063 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.148933 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.149069 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:54.149272 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:54.149607 (+ 335us) server_negotiation.cc:299] Negotiation successful
0811 17:12:54.149713 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":145,"threads_started":1}
I20260811 17:12:54.150154 6909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:54.143575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50846 (local address 127.4.146.193:45101)
0811 17:12:54.144311 (+ 736us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:54.144320 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:54.144344 (+ 24us) server_negotiation.cc:407] Connection header received
0811 17:12:54.144427 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:54.144432 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:54.144596 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:54.144774 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:54.145020 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.146127 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.147724 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.148864 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.149643 (+ 779us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:54.149829 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:54.149882 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 17:12:54.149988 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":104,"threads_started":1}
I20260811 17:12:54.153043 6539 tablet_service.cc:1467] Processing CreateTablet for tablet cdd8a5cafb5142f6b8819c111ac71dc1 (DEFAULT_TABLE table=test-table [id=3e874711e62e483faac0d1502d64eabc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:12:54.153117 6764 tablet_service.cc:1467] Processing CreateTablet for tablet cdd8a5cafb5142f6b8819c111ac71dc1 (DEFAULT_TABLE table=test-table [id=3e874711e62e483faac0d1502d64eabc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:12:54.153117 6288 tablet_service.cc:1467] Processing CreateTablet for tablet cdd8a5cafb5142f6b8819c111ac71dc1 (DEFAULT_TABLE table=test-table [id=3e874711e62e483faac0d1502d64eabc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:12:54.154289 6539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdd8a5cafb5142f6b8819c111ac71dc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:54.154335 6288 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdd8a5cafb5142f6b8819c111ac71dc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:54.154335 6764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdd8a5cafb5142f6b8819c111ac71dc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:54.161856 6912 tablet_bootstrap.cc:492] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77: Bootstrap starting.
I20260811 17:12:54.163664 6916 tablet_bootstrap.cc:492] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba: Bootstrap starting.
I20260811 17:12:54.163664 6917 tablet_bootstrap.cc:492] T cdd8a5cafb5142f6b8819c111ac71dc1 P cef709b10cc4462c848206931add518f: Bootstrap starting.
I20260811 17:12:54.164446 6912 tablet_bootstrap.cc:654] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:54.165226 6912 log.cc:824] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:54.166198 6917 tablet_bootstrap.cc:654] T cdd8a5cafb5142f6b8819c111ac71dc1 P cef709b10cc4462c848206931add518f: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:54.166198 6916 tablet_bootstrap.cc:654] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:54.167200 6916 log.cc:824] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:54.167200 6917 log.cc:824] T cdd8a5cafb5142f6b8819c111ac71dc1 P cef709b10cc4462c848206931add518f: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:54.167621 6912 tablet_bootstrap.cc:492] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77: No bootstrap required, opened a new log
I20260811 17:12:54.167887 6912 ts_tablet_manager.cc:1397] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 17:12:54.169404 6917 tablet_bootstrap.cc:492] T cdd8a5cafb5142f6b8819c111ac71dc1 P cef709b10cc4462c848206931add518f: No bootstrap required, opened a new log
I20260811 17:12:54.169642 6917 ts_tablet_manager.cc:1397] T cdd8a5cafb5142f6b8819c111ac71dc1 P cef709b10cc4462c848206931add518f: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 17:12:54.169935 6916 tablet_bootstrap.cc:492] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba: No bootstrap required, opened a new log
I20260811 17:12:54.170169 6916 ts_tablet_manager.cc:1397] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 17:12:54.172482 6912 raft_consensus.cc:348] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cef709b10cc4462c848206931add518f" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 40759 } } peers { permanent_uuid: "af78e3c3d2a04b65a70088dfba1232ba" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 45101 } } peers { permanent_uuid: "70aacb4b2a004638b3a841d143629a77" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 36075 } }
I20260811 17:12:54.172756 6912 raft_consensus.cc:374] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:54.172828 6912 raft_consensus.cc:729] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70aacb4b2a004638b3a841d143629a77, State: Initialized, Role: FOLLOWER
I20260811 17:12:54.173291 6912 consensus_queue.cc:260] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cef709b10cc4462c848206931add518f" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 40759 } } peers { permanent_uuid: "af78e3c3d2a04b65a70088dfba1232ba" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 45101 } } peers { permanent_uuid: "70aacb4b2a004638b3a841d143629a77" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 36075 } }
I20260811 17:12:54.174398 6912 ts_tablet_manager.cc:1428] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 17:12:54.174268 6917 raft_consensus.cc:348] T cdd8a5cafb5142f6b8819c111ac71dc1 P cef709b10cc4462c848206931add518f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cef709b10cc4462c848206931add518f" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 40759 } } peers { permanent_uuid: "af78e3c3d2a04b65a70088dfba1232ba" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 45101 } } peers { permanent_uuid: "70aacb4b2a004638b3a841d143629a77" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 36075 } }
I20260811 17:12:54.174528 6917 raft_consensus.cc:374] T cdd8a5cafb5142f6b8819c111ac71dc1 P cef709b10cc4462c848206931add518f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:54.174575 6917 raft_consensus.cc:729] T cdd8a5cafb5142f6b8819c111ac71dc1 P cef709b10cc4462c848206931add518f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cef709b10cc4462c848206931add518f, State: Initialized, Role: FOLLOWER
I20260811 17:12:54.174440 6916 raft_consensus.cc:348] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cef709b10cc4462c848206931add518f" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 40759 } } peers { permanent_uuid: "af78e3c3d2a04b65a70088dfba1232ba" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 45101 } } peers { permanent_uuid: "70aacb4b2a004638b3a841d143629a77" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 36075 } }
I20260811 17:12:54.174865 6648 heartbeater.cc:503] Master 127.4.146.254:39129 was elected leader, sending a full tablet report...
I20260811 17:12:54.175108 6917 consensus_queue.cc:260] T cdd8a5cafb5142f6b8819c111ac71dc1 P cef709b10cc4462c848206931add518f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cef709b10cc4462c848206931add518f" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 40759 } } peers { permanent_uuid: "af78e3c3d2a04b65a70088dfba1232ba" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 45101 } } peers { permanent_uuid: "70aacb4b2a004638b3a841d143629a77" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 36075 } }
I20260811 17:12:54.174666 6916 raft_consensus.cc:374] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:54.175890 6881 heartbeater.cc:503] Master 127.4.146.254:39129 was elected leader, sending a full tablet report...
I20260811 17:12:54.175907 6916 raft_consensus.cc:729] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af78e3c3d2a04b65a70088dfba1232ba, State: Initialized, Role: FOLLOWER
I20260811 17:12:54.176237 6917 ts_tablet_manager.cc:1428] T cdd8a5cafb5142f6b8819c111ac71dc1 P cef709b10cc4462c848206931add518f: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260811 17:12:54.176421 6916 consensus_queue.cc:260] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cef709b10cc4462c848206931add518f" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 40759 } } peers { permanent_uuid: "af78e3c3d2a04b65a70088dfba1232ba" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 45101 } } peers { permanent_uuid: "70aacb4b2a004638b3a841d143629a77" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 36075 } }
I20260811 17:12:54.177260 6416 heartbeater.cc:503] Master 127.4.146.254:39129 was elected leader, sending a full tablet report...
I20260811 17:12:54.177892 6916 ts_tablet_manager.cc:1428] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
W20260811 17:12:54.351996 6882 tablet.cc:2369] T cdd8a5cafb5142f6b8819c111ac71dc1 P cef709b10cc4462c848206931add518f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 17:12:54.393637 6649 tablet.cc:2369] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 17:12:54.402861 6928 raft_consensus.cc:482] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:12:54.403185 6928 raft_consensus.cc:504] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cef709b10cc4462c848206931add518f" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 40759 } } peers { permanent_uuid: "af78e3c3d2a04b65a70088dfba1232ba" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 45101 } } peers { permanent_uuid: "70aacb4b2a004638b3a841d143629a77" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 36075 } }
I20260811 17:12:54.404620 6928 leader_election.cc:288] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cef709b10cc4462c848206931add518f (127.4.146.195:40759), 70aacb4b2a004638b3a841d143629a77 (127.4.146.194:36075)
I20260811 17:12:54.410401 6925 raft_consensus.cc:482] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:12:54.410614 6933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:54.404876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:36075 (local address 127.4.146.193:57805)
0811 17:12:54.405306 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:54.405319 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:54.405422 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:54.405744 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:54.405747 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:54.405790 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:54.406137 (+ 347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:54.406145 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.407235 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.407239 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:54.408902 (+ 1663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:54.408915 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.409834 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.409838 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:54.410039 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:54.410146 (+ 107us) client_negotiation.cc:769] Sending connection context
0811 17:12:54.410228 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 17:12:54.410386 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"mutex_wait_us":288,"spinlock_wait_cycles":210560,"thread_start_us":147,"threads_started":1}
I20260811 17:12:54.410705 6904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:54.404974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:49315 (local address 127.4.146.195:40759)
0811 17:12:54.405172 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:54.405177 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:54.405265 (+ 88us) server_negotiation.cc:407] Connection header received
0811 17:12:54.405536 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:54.405540 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:54.405607 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:54.405702 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:54.406269 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.407095 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.409052 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.409697 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.409807 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:54.409861 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:54.410460 (+ 599us) server_negotiation.cc:299] Negotiation successful
0811 17:12:54.410560 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 17:12:54.410641 6925 raft_consensus.cc:504] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cef709b10cc4462c848206931add518f" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 40759 } } peers { permanent_uuid: "af78e3c3d2a04b65a70088dfba1232ba" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 45101 } } peers { permanent_uuid: "70aacb4b2a004638b3a841d143629a77" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 36075 } }
I20260811 17:12:54.411001 6929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:54.404864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:40759 (local address 127.4.146.193:49315)
0811 17:12:54.405152 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:54.405172 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:54.405317 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:54.405744 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:54.405747 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:54.405792 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:54.406138 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:54.406145 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.407235 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.407239 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:54.408902 (+ 1663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:54.408915 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.409834 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.409838 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:54.410066 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:54.410143 (+ 77us) client_negotiation.cc:769] Sending connection context
0811 17:12:54.410228 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 17:12:54.410386 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"mutex_wait_us":398,"spinlock_wait_cycles":9984,"thread_start_us":85,"threads_started":1}
I20260811 17:12:54.411096 6911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:54.405406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:57805 (local address 127.4.146.194:36075)
0811 17:12:54.405522 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:54.405526 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:54.405540 (+ 14us) server_negotiation.cc:407] Connection header received
0811 17:12:54.405587 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:54.405590 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:54.405638 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:54.405718 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:54.406269 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.407099 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.409052 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.409666 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.409807 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:54.409861 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:54.410265 (+ 404us) server_negotiation.cc:299] Negotiation successful
0811 17:12:54.410356 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 17:12:54.411649 6570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdd8a5cafb5142f6b8819c111ac71dc1" candidate_uuid: "af78e3c3d2a04b65a70088dfba1232ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70aacb4b2a004638b3a841d143629a77" is_pre_election: true
I20260811 17:12:54.411676 6795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdd8a5cafb5142f6b8819c111ac71dc1" candidate_uuid: "af78e3c3d2a04b65a70088dfba1232ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cef709b10cc4462c848206931add518f" is_pre_election: true
I20260811 17:12:54.411872 6570 raft_consensus.cc:2454] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af78e3c3d2a04b65a70088dfba1232ba in term 0.
I20260811 17:12:54.412009 6795 raft_consensus.cc:2454] T cdd8a5cafb5142f6b8819c111ac71dc1 P cef709b10cc4462c848206931add518f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af78e3c3d2a04b65a70088dfba1232ba in term 0.
I20260811 17:12:54.412048 6925 leader_election.cc:288] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cef709b10cc4462c848206931add518f (127.4.146.195:40759), af78e3c3d2a04b65a70088dfba1232ba (127.4.146.193:45101)
I20260811 17:12:54.412469 6204 leader_election.cc:302] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70aacb4b2a004638b3a841d143629a77, af78e3c3d2a04b65a70088dfba1232ba; no voters:
I20260811 17:12:54.412817 6928 raft_consensus.cc:2781] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:12:54.413270 6928 raft_consensus.cc:482] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:12:54.413349 6928 raft_consensus.cc:3037] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:54.414748 6928 raft_consensus.cc:504] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cef709b10cc4462c848206931add518f" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 40759 } } peers { permanent_uuid: "af78e3c3d2a04b65a70088dfba1232ba" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 45101 } } peers { permanent_uuid: "70aacb4b2a004638b3a841d143629a77" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 36075 } }
I20260811 17:12:54.415491 6570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdd8a5cafb5142f6b8819c111ac71dc1" candidate_uuid: "af78e3c3d2a04b65a70088dfba1232ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70aacb4b2a004638b3a841d143629a77"
I20260811 17:12:54.415493 6795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdd8a5cafb5142f6b8819c111ac71dc1" candidate_uuid: "af78e3c3d2a04b65a70088dfba1232ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cef709b10cc4462c848206931add518f"
I20260811 17:12:54.415665 6570 raft_consensus.cc:3037] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:54.415647 6795 raft_consensus.cc:3037] T cdd8a5cafb5142f6b8819c111ac71dc1 P cef709b10cc4462c848206931add518f [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:54.416813 6928 leader_election.cc:288] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba [CANDIDATE]: Term 1 election: Requested vote from peers cef709b10cc4462c848206931add518f (127.4.146.195:40759), 70aacb4b2a004638b3a841d143629a77 (127.4.146.194:36075)
I20260811 17:12:54.417143 6570 raft_consensus.cc:2454] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af78e3c3d2a04b65a70088dfba1232ba in term 1.
I20260811 17:12:54.417143 6795 raft_consensus.cc:2454] T cdd8a5cafb5142f6b8819c111ac71dc1 P cef709b10cc4462c848206931add518f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af78e3c3d2a04b65a70088dfba1232ba in term 1.
I20260811 17:12:54.417339 6909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:54.412759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:55447 (local address 127.4.146.193:45101)
0811 17:12:54.413005 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:54.413008 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:54.413018 (+ 10us) server_negotiation.cc:407] Connection header received
0811 17:12:54.413061 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:54.413063 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:54.413100 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:54.413191 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:54.413459 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.414202 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.415753 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.416370 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.416468 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:54.416530 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:54.417124 (+ 594us) server_negotiation.cc:299] Negotiation successful
0811 17:12:54.417223 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177}
I20260811 17:12:54.417440 6934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:54.412421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:40759 (local address 127.4.146.194:51759)
0811 17:12:54.412874 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:54.412889 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:54.412980 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:54.413564 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:54.413568 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:54.413590 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:54.413726 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:54.413733 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.414597 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.414601 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:54.415633 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:54.415646 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.416677 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.416680 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:54.416826 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:54.416853 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 17:12:54.417171 (+ 318us) client_negotiation.cc:240] Negotiation successful
0811 17:12:54.417265 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"mutex_wait_us":5,"thread_start_us":87,"threads_started":1}
I20260811 17:12:54.417523 6204 leader_election.cc:302] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70aacb4b2a004638b3a841d143629a77, af78e3c3d2a04b65a70088dfba1232ba; no voters:
I20260811 17:12:54.417723 6928 raft_consensus.cc:2781] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:12:54.417865 6935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:54.412370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:45101 (local address 127.4.146.194:55447)
0811 17:12:54.412695 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:54.412710 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:54.412799 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:54.413203 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:54.413206 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:54.413223 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:54.413348 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:54.413354 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.414346 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.414350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:54.415599 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:54.415610 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.416646 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.416649 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:54.416935 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:54.416977 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 17:12:54.417614 (+ 637us) client_negotiation.cc:240] Negotiation successful
0811 17:12:54.417703 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"mutex_wait_us":158,"thread_start_us":87,"threads_started":1}
I20260811 17:12:54.417940 6904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:54.412884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:51759 (local address 127.4.146.195:40759)
0811 17:12:54.412994 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:54.412999 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:54.413024 (+ 25us) server_negotiation.cc:407] Connection header received
0811 17:12:54.413068 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:54.413074 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:54.413118 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:54.413183 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:54.413833 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.414481 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.415808 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.416426 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.416524 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:54.416572 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:54.416983 (+ 411us) server_negotiation.cc:299] Negotiation successful
0811 17:12:54.417100 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 17:12:54.417949 6928 raft_consensus.cc:686] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba [term 1 LEADER]: Becoming Leader. State: Replica: af78e3c3d2a04b65a70088dfba1232ba, State: Running, Role: LEADER
I20260811 17:12:54.418356 6928 consensus_queue.cc:237] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cef709b10cc4462c848206931add518f" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 40759 } } peers { permanent_uuid: "af78e3c3d2a04b65a70088dfba1232ba" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 45101 } } peers { permanent_uuid: "70aacb4b2a004638b3a841d143629a77" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 36075 } }
I20260811 17:12:54.418568 6330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdd8a5cafb5142f6b8819c111ac71dc1" candidate_uuid: "70aacb4b2a004638b3a841d143629a77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af78e3c3d2a04b65a70088dfba1232ba" is_pre_election: true
I20260811 17:12:54.418745 6795 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdd8a5cafb5142f6b8819c111ac71dc1" candidate_uuid: "70aacb4b2a004638b3a841d143629a77" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cef709b10cc4462c848206931add518f" is_pre_election: true
I20260811 17:12:54.418931 6795 raft_consensus.cc:2379] T cdd8a5cafb5142f6b8819c111ac71dc1 P cef709b10cc4462c848206931add518f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 70aacb4b2a004638b3a841d143629a77 in current term 1: Already voted for candidate af78e3c3d2a04b65a70088dfba1232ba in this term.
I20260811 17:12:54.419647 6462 leader_election.cc:302] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 70aacb4b2a004638b3a841d143629a77; no voters: af78e3c3d2a04b65a70088dfba1232ba, cef709b10cc4462c848206931add518f
I20260811 17:12:54.419961 6925 raft_consensus.cc:2726] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 17:12:54.422322 6054 catalog_manager.cc:5495] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba reported cstate change: term changed from 0 to 1, leader changed from <none> to af78e3c3d2a04b65a70088dfba1232ba (127.4.146.193). New cstate: current_term: 1 leader_uuid: "af78e3c3d2a04b65a70088dfba1232ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cef709b10cc4462c848206931add518f" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 40759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af78e3c3d2a04b65a70088dfba1232ba" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 45101 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "70aacb4b2a004638b3a841d143629a77" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 36075 } health_report { overall_health: UNKNOWN } } }
W20260811 17:12:54.427996 6417 tablet.cc:2369] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 17:12:54.446842 6909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:54.442988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50852 (local address 127.4.146.193:45101)
0811 17:12:54.443154 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:54.443161 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:54.443176 (+ 15us) server_negotiation.cc:407] Connection header received
0811 17:12:54.443271 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:54.443274 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:54.443330 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:54.443451 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:12:54.443717 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.444316 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.445227 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:54.445455 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:54.445567 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:54.445919 (+ 352us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:12:54.446367 (+ 448us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:12:54.446534 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:54.446646 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 17:12:54.446690 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 17:12:54.453527 6570 raft_consensus.cc:1261] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77 [term 1 FOLLOWER]: Refusing update from remote peer af78e3c3d2a04b65a70088dfba1232ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:12:54.453531 6795 raft_consensus.cc:1261] T cdd8a5cafb5142f6b8819c111ac71dc1 P cef709b10cc4462c848206931add518f [term 1 FOLLOWER]: Refusing update from remote peer af78e3c3d2a04b65a70088dfba1232ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:12:54.454298 6936 consensus_queue.cc:1035] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "70aacb4b2a004638b3a841d143629a77" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 36075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:12:54.454552 6928 consensus_queue.cc:1035] T cdd8a5cafb5142f6b8819c111ac71dc1 P af78e3c3d2a04b65a70088dfba1232ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "cef709b10cc4462c848206931add518f" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 40759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:12:54.462356 6940 mvcc.cc:205] Tried to move back new op lower bound from 7317374461752205312 to 7317374461621321728. Current Snapshot: MvccSnapshot[applied={T|T < 7317374461752205312}]
I20260811 17:12:54.472868 6057 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:12:54.473040 6057 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:34616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:12:54.475728 6057 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7aba6c746f48439cb998741aa53fd7d9: Sending DeleteTablet for 3 replicas of tablet cdd8a5cafb5142f6b8819c111ac71dc1
I20260811 17:12:54.476619 6764 tablet_service.cc:1514] Processing DeleteTablet for tablet cdd8a5cafb5142f6b8819c111ac71dc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:12:54 UTC) from {username='slave'} at 127.0.0.1:50244
I20260811 17:12:54.476822 6539 tablet_service.cc:1514] Processing DeleteTablet for tablet cdd8a5cafb5142f6b8819c111ac71dc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:12:54 UTC) from {username='slave'} at 127.0.0.1:52182
I20260811 17:12:54.476905 6288 tablet_service.cc:1514] Processing DeleteTablet for tablet cdd8a5cafb5142f6b8819c111ac71dc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:12:54 UTC) from {username='slave'} at 127.0.0.1:50846
I20260811 17:12:54.477339 6956 tablet_replica.cc:330] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77: stopping tablet replica
I20260811 17:12:54.477699 6956 raft_consensus.cc:2229] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:12:54.478034 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 6173
I20260811 17:12:54.478049 6956 raft_consensus.cc:2258] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:12:54.479969 6956 ts_tablet_manager.cc:1905] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:12:54.482975 6955 tablet_replica.cc:330] T cdd8a5cafb5142f6b8819c111ac71dc1 P cef709b10cc4462c848206931add518f: stopping tablet replica
I20260811 17:12:54.483335 6955 raft_consensus.cc:2229] T cdd8a5cafb5142f6b8819c111ac71dc1 P cef709b10cc4462c848206931add518f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:12:54.483454 6956 ts_tablet_manager.cc:1918] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:12:54.483589 6956 log.cc:1196] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-1/wal/wals/cdd8a5cafb5142f6b8819c111ac71dc1
I20260811 17:12:54.483778 6955 raft_consensus.cc:2258] T cdd8a5cafb5142f6b8819c111ac71dc1 P cef709b10cc4462c848206931add518f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:12:54.483995 6956 ts_tablet_manager.cc:1939] T cdd8a5cafb5142f6b8819c111ac71dc1 P 70aacb4b2a004638b3a841d143629a77: Deleting consensus metadata
I20260811 17:12:54.486474 6034 catalog_manager.cc:4841] TS 70aacb4b2a004638b3a841d143629a77 (127.4.146.194:36075): tablet cdd8a5cafb5142f6b8819c111ac71dc1 (table test-table [id=3e874711e62e483faac0d1502d64eabc]) successfully deleted
I20260811 17:12:54.487934 6955 ts_tablet_manager.cc:1905] T cdd8a5cafb5142f6b8819c111ac71dc1 P cef709b10cc4462c848206931add518f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:12:54.492522 6955 ts_tablet_manager.cc:1918] T cdd8a5cafb5142f6b8819c111ac71dc1 P cef709b10cc4462c848206931add518f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:12:54.492684 6955 log.cc:1196] T cdd8a5cafb5142f6b8819c111ac71dc1 P cef709b10cc4462c848206931add518f: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/cdd8a5cafb5142f6b8819c111ac71dc1
I20260811 17:12:54.493070 6955 ts_tablet_manager.cc:1939] T cdd8a5cafb5142f6b8819c111ac71dc1 P cef709b10cc4462c848206931add518f: Deleting consensus metadata
I20260811 17:12:54.494715 6036 catalog_manager.cc:4841] TS cef709b10cc4462c848206931add518f (127.4.146.195:40759): tablet cdd8a5cafb5142f6b8819c111ac71dc1 (table test-table [id=3e874711e62e483faac0d1502d64eabc]) successfully deleted
W20260811 17:12:54.494974 6037 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.146.193:45101 (error 108)
I20260811 17:12:54.495134 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 6420
I20260811 17:12:54.501233 6903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:54.496056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:45101 (local address 127.0.0.1:50866)
0811 17:12:54.500978 (+ 4922us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:54.501107 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.193:45101: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4771}
W20260811 17:12:54.503482 6037 catalog_manager.cc:4584] TS af78e3c3d2a04b65a70088dfba1232ba (127.4.146.193:45101): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cdd8a5cafb5142f6b8819c111ac71dc1: Network error: Client connection negotiation failed: client connection to 127.4.146.193:45101: connect: Connection refused (error 111)
I20260811 17:12:54.509608 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 6651
I20260811 17:12:54.528081 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 6009
2026-08-11T17:12:54Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1392 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:12:54 dist-test-slave-7vjv krb5kdc[6967](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:12:54 dist-test-slave-7vjv krb5kdc[6967](info): set up 2 sockets
Aug 11 17:12:54 dist-test-slave-7vjv krb5kdc[6967](info): commencing operation
krb5kdc: starting...
W20260811 17:12:55.890309 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.322s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:12:55 dist-test-slave-7vjv krb5kdc[6967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468375, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:12:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:12:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:12:56.036839 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:41707
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:34767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:41707
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:12:56.159787 6986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:56.160239 6986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:56.160358 6986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:56.165504 6986 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:12:56.165621 6986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:56.165659 6986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:56.165704 6986 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:12:56.165740 6986 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:12:56.171650 6986 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:34767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:41707
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:41707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6986
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:56.172989 6986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:56.174144 6986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:56.183882 7002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:56.183887 6997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:56.183983 6986 server_base.cc:1034] running on GCE node
W20260811 17:12:56.183882 7004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:56.184988 6986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:56.186407 6986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:56.187660 6986 hybrid_clock.cc:648] HybridClock initialized: now 1786468376187644 us; error 30 us; skew 500 ppm
Aug 11 17:12:56 dist-test-slave-7vjv krb5kdc[6967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468376, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:12:56.191349 6986 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:12:56.192492 6986 webserver.cc:460] Webserver started at http://127.4.146.254:43571/ using document root <none> and password file <none>
I20260811 17:12:56.193118 6986 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:56.193193 6986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:56.193387 6986 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:12:56.195772 6986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "1a58f69b09f34d36ab6833c27bdf6a77"
format_stamp: "Formatted at 2026-08-11 17:12:56 on dist-test-slave-7vjv"
server_key: "d7e2d891158e3f87cd9e925913080edc"
server_key_iv: "545bca15c331b4ada69273aeb651ff64"
server_key_version: "encryptionkey@0"
I20260811 17:12:56.196472 6986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "1a58f69b09f34d36ab6833c27bdf6a77"
format_stamp: "Formatted at 2026-08-11 17:12:56 on dist-test-slave-7vjv"
server_key: "d7e2d891158e3f87cd9e925913080edc"
server_key_iv: "545bca15c331b4ada69273aeb651ff64"
server_key_version: "encryptionkey@0"
I20260811 17:12:56.201105 6986 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 17:12:56.204457 7018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:56.206213 6986 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 17:12:56.206421 6986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "1a58f69b09f34d36ab6833c27bdf6a77"
format_stamp: "Formatted at 2026-08-11 17:12:56 on dist-test-slave-7vjv"
server_key: "d7e2d891158e3f87cd9e925913080edc"
server_key_iv: "545bca15c331b4ada69273aeb651ff64"
server_key_version: "encryptionkey@0"
I20260811 17:12:56.206594 6986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:56.235276 6986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:56.239527 6986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:56.239866 6986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:56.249614 6986 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:41707
I20260811 17:12:56.249653 7108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:41707 every 8 connection(s)
I20260811 17:12:56.250916 6986 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:12:56.254232 7111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:56.256803 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 6986
I20260811 17:12:56.256990 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:12:56.257318 4683 external_mini_cluster.cc:1428] Setting key fdc8f2bb3fa415ade7b4b873392224f6
I20260811 17:12:56.262145 7111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a58f69b09f34d36ab6833c27bdf6a77: Bootstrap starting.
I20260811 17:12:56.265064 7111 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a58f69b09f34d36ab6833c27bdf6a77: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:56.266006 7111 log.cc:824] T 00000000000000000000000000000000 P 1a58f69b09f34d36ab6833c27bdf6a77: Log is configured to *not* fsync() on all Append() calls
Aug 11 17:12:56 dist-test-slave-7vjv krb5kdc[6967](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468375, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:12:56.268664 7111 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a58f69b09f34d36ab6833c27bdf6a77: No bootstrap required, opened a new log
I20260811 17:12:56.272697 7111 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1a58f69b09f34d36ab6833c27bdf6a77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a58f69b09f34d36ab6833c27bdf6a77" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41707 } }
I20260811 17:12:56.273015 7111 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1a58f69b09f34d36ab6833c27bdf6a77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:56.273097 7111 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1a58f69b09f34d36ab6833c27bdf6a77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a58f69b09f34d36ab6833c27bdf6a77, State: Initialized, Role: FOLLOWER
I20260811 17:12:56.273653 7111 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a58f69b09f34d36ab6833c27bdf6a77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a58f69b09f34d36ab6833c27bdf6a77" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41707 } }
I20260811 17:12:56.273840 7111 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1a58f69b09f34d36ab6833c27bdf6a77 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:12:56.273923 7111 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1a58f69b09f34d36ab6833c27bdf6a77 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:12:56.274076 7111 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1a58f69b09f34d36ab6833c27bdf6a77 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:56.275050 7116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:56.259124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34088 (local address 127.4.146.254:41707)
0811 17:12:56.259750 (+ 626us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:56.259770 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:56.259817 (+ 47us) server_negotiation.cc:407] Connection header received
0811 17:12:56.260977 (+ 1160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:56.261002 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:56.261440 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:56.261851 (+ 411us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:56.262803 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:56.263851 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:56.264861 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:56.265462 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:56.265651 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:56.268923 (+ 3272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:56.268929 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:56.268943 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:12:56.268973 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:56.271590 (+ 2617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:56.272196 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:56.272202 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:56.272208 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:56.272338 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:56.272673 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:56.272677 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:56.272678 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:56.273286 (+ 608us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:56.273533 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:56.273845 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 17:12:56.274193 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":176,"threads_started":1}
I20260811 17:12:56.275337 7111 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1a58f69b09f34d36ab6833c27bdf6a77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a58f69b09f34d36ab6833c27bdf6a77" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41707 } }
I20260811 17:12:56.275766 7111 leader_election.cc:302] T 00000000000000000000000000000000 P 1a58f69b09f34d36ab6833c27bdf6a77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1a58f69b09f34d36ab6833c27bdf6a77; no voters:
I20260811 17:12:56.276255 7111 leader_election.cc:288] T 00000000000000000000000000000000 P 1a58f69b09f34d36ab6833c27bdf6a77 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:12:56.276381 7121 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1a58f69b09f34d36ab6833c27bdf6a77 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:12:56.276629 7121 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1a58f69b09f34d36ab6833c27bdf6a77 [term 1 LEADER]: Becoming Leader. State: Replica: 1a58f69b09f34d36ab6833c27bdf6a77, State: Running, Role: LEADER
I20260811 17:12:56.276990 7121 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1a58f69b09f34d36ab6833c27bdf6a77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a58f69b09f34d36ab6833c27bdf6a77" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41707 } }
I20260811 17:12:56.277721 7111 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1a58f69b09f34d36ab6833c27bdf6a77 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:12:56.278296 7125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a58f69b09f34d36ab6833c27bdf6a77 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a58f69b09f34d36ab6833c27bdf6a77. Latest consensus state: current_term: 1 leader_uuid: "1a58f69b09f34d36ab6833c27bdf6a77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a58f69b09f34d36ab6833c27bdf6a77" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41707 } } }
I20260811 17:12:56.278443 7125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a58f69b09f34d36ab6833c27bdf6a77 [sys.catalog]: This master's current role is: LEADER
I20260811 17:12:56.278738 7122 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a58f69b09f34d36ab6833c27bdf6a77 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1a58f69b09f34d36ab6833c27bdf6a77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a58f69b09f34d36ab6833c27bdf6a77" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 41707 } } }
I20260811 17:12:56.278818 7122 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a58f69b09f34d36ab6833c27bdf6a77 [sys.catalog]: This master's current role is: LEADER
I20260811 17:12:56.279318 7137 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:12:56.282740 7137 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:12:56.289674 7137 catalog_manager.cc:1347] Generated new cluster ID: 74dc7e7dcd1543ef814619be8f130267
I20260811 17:12:56.289760 7137 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:12:56.304577 7137 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:12:56.306092 7137 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:12:56.322974 7137 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1a58f69b09f34d36ab6833c27bdf6a77: Generated new TSK 0
I20260811 17:12:56.324024 7137 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.4.146.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
Entry for principal kudu/127.4.146.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab.
I20260811 17:12:56.365417 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:41707
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:34767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:12:56.493468 7170 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:56.493774 7170 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:56.493824 7170 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:56.498056 7170 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:56.498131 7170 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:56.498194 7170 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:12:56.503720 7170 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:34767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.193.keytab
--principal=kudu/127.4.146.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:41707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7170
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:56.504858 7170 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:56.505890 7170 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:56.516374 7181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:56.516374 7184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:56.516376 7178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:56.516856 7170 server_base.cc:1034] running on GCE node
I20260811 17:12:56.517342 7170 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:56.518014 7170 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:56.519193 7170 hybrid_clock.cc:648] HybridClock initialized: now 1786468376519174 us; error 35 us; skew 500 ppm
Aug 11 17:12:56 dist-test-slave-7vjv krb5kdc[6967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468376, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:12:56.522254 7170 init.cc:377] Logged in from keytab as kudu/127.4.146.193@KRBTEST.COM (short username kudu)
I20260811 17:12:56.523180 7170 webserver.cc:460] Webserver started at http://127.4.146.193:35043/ using document root <none> and password file <none>
I20260811 17:12:56.523763 7170 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:56.523824 7170 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:56.524006 7170 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:12:56.526186 7170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "ba92a5c809af45e887a522a2dc455534"
format_stamp: "Formatted at 2026-08-11 17:12:56 on dist-test-slave-7vjv"
server_key: "1bc5d142977f9ee794bc4339e3541006"
server_key_iv: "a7736a8a0e68595772d14bd5576f3e3d"
server_key_version: "encryptionkey@0"
I20260811 17:12:56.526751 7170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "ba92a5c809af45e887a522a2dc455534"
format_stamp: "Formatted at 2026-08-11 17:12:56 on dist-test-slave-7vjv"
server_key: "1bc5d142977f9ee794bc4339e3541006"
server_key_iv: "a7736a8a0e68595772d14bd5576f3e3d"
server_key_version: "encryptionkey@0"
I20260811 17:12:56.530757 7170 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 17:12:56.533488 7196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:56.534916 7170 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 17:12:56.535069 7170 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "ba92a5c809af45e887a522a2dc455534"
format_stamp: "Formatted at 2026-08-11 17:12:56 on dist-test-slave-7vjv"
server_key: "1bc5d142977f9ee794bc4339e3541006"
server_key_iv: "a7736a8a0e68595772d14bd5576f3e3d"
server_key_version: "encryptionkey@0"
I20260811 17:12:56.535171 7170 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:56.552363 7170 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:56.555744 7170 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:56.555923 7170 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:56.556624 7170 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:12:56.557503 7170 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:12:56.557555 7170 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:56.557613 7170 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:12:56.557646 7170 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:56.566905 7170 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:36151
I20260811 17:12:56.566946 7386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:36151 every 8 connection(s)
I20260811 17:12:56.567826 7170 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:12:56.574879 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 7170
I20260811 17:12:56.575052 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
I20260811 17:12:56.575423 4683 external_mini_cluster.cc:1428] Setting key 31effb68bd55b4cdbe966913c97e3a2c
Aug 11 17:12:56 dist-test-slave-7vjv krb5kdc[6967](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468376, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.193@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:12:56.583988 7116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:56.569802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:39657 (local address 127.4.146.254:41707)
0811 17:12:56.569951 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:56.569955 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:56.570869 (+ 914us) server_negotiation.cc:407] Connection header received
0811 17:12:56.572275 (+ 1406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:56.572278 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:56.572330 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:56.572408 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:56.573740 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:56.574284 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:56.575976 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:56.576299 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:56.576386 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:56.579836 (+ 3450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:56.579843 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:56.579847 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:12:56.579885 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:56.581540 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:56.582097 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:56.582100 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:56.582101 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:56.582191 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:56.582616 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:56.582620 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:56.582621 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:56.582832 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:56.582949 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:56.583655 (+ 706us) server_negotiation.cc:299] Negotiation successful
0811 17:12:56.583805 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 17:12:56.584895 7390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:56.570216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:41707 (local address 127.4.146.193:39657)
0811 17:12:56.570702 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:56.570750 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:56.572006 (+ 1256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:56.572639 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:56.572646 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:56.573063 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:12:56.573590 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:56.573604 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:56.574422 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:56.574425 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:56.575842 (+ 1417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:56.575859 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:56.576462 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:56.576467 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:56.576665 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:56.577412 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:12:56.577430 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:12:56.579577 (+ 2147us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:12:56.581652 (+ 2075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:56.581658 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:56.581680 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:56.581960 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:56.582331 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:56.582334 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:56.582336 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:56.582505 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:56.582949 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:12:56.582958 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:12:56.583332 (+ 374us) client_negotiation.cc:769] Sending connection context
0811 17:12:56.583588 (+ 256us) client_negotiation.cc:240] Negotiation successful
0811 17:12:56.583959 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":116,"threads_started":1}
I20260811 17:12:56.586264 7387 heartbeater.cc:347] Connected to a master server at 127.4.146.254:41707
I20260811 17:12:56.586565 7387 heartbeater.cc:464] Registering TS with master...
I20260811 17:12:56.587247 7387 heartbeater.cc:511] Master 127.4.146.254:41707 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.4.146.194@KRBTEST.COM; defaulting to no policy
I20260811 17:12:56.589082 7040 ts_manager.cc:194] Registered new tserver with Master: ba92a5c809af45e887a522a2dc455534 (127.4.146.193:36151)
I20260811 17:12:56.590380 7040 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.193@KRBTEST.COM'} at 127.4.146.193:39657
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
Entry for principal kudu/127.4.146.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab.
I20260811 17:12:56.611158 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:41707
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:34767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:12:56.735040 7394 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:56.735421 7394 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:56.735510 7394 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:56.740011 7394 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:56.740154 7394 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:56.740317 7394 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:12:56.746233 7394 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:34767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.194.keytab
--principal=kudu/127.4.146.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:41707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7394
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:56.747542 7394 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:56.748706 7394 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:56.759500 7415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:56.759464 7403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:56.759629 7394 server_base.cc:1034] running on GCE node
W20260811 17:12:56.759835 7408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:56.760396 7394 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:56.761067 7394 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:56.762274 7394 hybrid_clock.cc:648] HybridClock initialized: now 1786468376762236 us; error 50 us; skew 500 ppm
Aug 11 17:12:56 dist-test-slave-7vjv krb5kdc[6967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468376, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:12:56.765412 7394 init.cc:377] Logged in from keytab as kudu/127.4.146.194@KRBTEST.COM (short username kudu)
I20260811 17:12:56.766412 7394 webserver.cc:460] Webserver started at http://127.4.146.194:38121/ using document root <none> and password file <none>
I20260811 17:12:56.767038 7394 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:56.767163 7394 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:56.767403 7394 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:12:56.769681 7394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "a8ae947457424487be8eb879b4e26f7c"
format_stamp: "Formatted at 2026-08-11 17:12:56 on dist-test-slave-7vjv"
server_key: "c422949ef438406904c9e8a7f9ccaa4d"
server_key_iv: "709fbca5a368618a768b36ab10b6ecb1"
server_key_version: "encryptionkey@0"
I20260811 17:12:56.770283 7394 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "a8ae947457424487be8eb879b4e26f7c"
format_stamp: "Formatted at 2026-08-11 17:12:56 on dist-test-slave-7vjv"
server_key: "c422949ef438406904c9e8a7f9ccaa4d"
server_key_iv: "709fbca5a368618a768b36ab10b6ecb1"
server_key_version: "encryptionkey@0"
I20260811 17:12:56.774518 7394 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 17:12:56.777531 7424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:56.778973 7394 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 17:12:56.779179 7394 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "a8ae947457424487be8eb879b4e26f7c"
format_stamp: "Formatted at 2026-08-11 17:12:56 on dist-test-slave-7vjv"
server_key: "c422949ef438406904c9e8a7f9ccaa4d"
server_key_iv: "709fbca5a368618a768b36ab10b6ecb1"
server_key_version: "encryptionkey@0"
I20260811 17:12:56.779305 7394 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:56.810479 7394 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:56.814222 7394 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:56.814406 7394 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:56.815047 7394 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:12:56.815953 7394 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:12:56.816002 7394 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:56.816045 7394 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:12:56.816061 7394 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:56.826534 7394 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:37125
I20260811 17:12:56.826649 7639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:37125 every 8 connection(s)
I20260811 17:12:56.827613 7394 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:12:56.830410 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 7394
I20260811 17:12:56.830531 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:12:56.830855 4683 external_mini_cluster.cc:1428] Setting key ee08beb4de126a432ee3c28dd3e68067
Aug 11 17:12:56 dist-test-slave-7vjv krb5kdc[6967](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468376, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.194@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.146.195@KRBTEST.COM; defaulting to no policy
I20260811 17:12:56.845968 7116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:56.829921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:47965 (local address 127.4.146.254:41707)
0811 17:12:56.830131 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:56.830138 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:56.831304 (+ 1166us) server_negotiation.cc:407] Connection header received
0811 17:12:56.833265 (+ 1961us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:56.833269 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:56.833334 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:56.833446 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:56.834822 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:56.835697 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:56.837811 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:56.838048 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:56.838298 (+ 250us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:56.841914 (+ 3616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:56.841918 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:56.841920 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:12:56.841948 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:56.843599 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:56.844243 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:56.844253 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:56.844255 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:56.844340 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:56.844730 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:56.844734 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:56.844735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:56.844952 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:56.845067 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:56.845649 (+ 582us) server_negotiation.cc:299] Negotiation successful
0811 17:12:56.845794 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.195@KRBTEST.COM" created.
I20260811 17:12:56.847144 7646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:56.830443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:41707 (local address 127.4.146.194:47965)
0811 17:12:56.831112 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:56.831179 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:56.833013 (+ 1834us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:56.833656 (+ 643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:56.833664 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:56.834091 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:12:56.834647 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:56.834663 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:56.835876 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:56.835882 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:56.837603 (+ 1721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:56.837620 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:56.838364 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:56.838372 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:56.838683 (+ 311us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:56.839638 (+ 955us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:12:56.839666 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:12:56.841687 (+ 2021us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:12:56.843742 (+ 2055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:56.843750 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:56.843770 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:56.844077 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:56.844441 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:56.844445 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:56.844447 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:56.844613 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:56.845072 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:12:56.845081 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:12:56.845383 (+ 302us) client_negotiation.cc:769] Sending connection context
0811 17:12:56.845589 (+ 206us) client_negotiation.cc:240] Negotiation successful
0811 17:12:56.845980 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":186,"threads_started":1}
I20260811 17:12:56.848727 7641 heartbeater.cc:347] Connected to a master server at 127.4.146.254:41707
I20260811 17:12:56.849038 7641 heartbeater.cc:464] Registering TS with master...
I20260811 17:12:56.849772 7641 heartbeater.cc:511] Master 127.4.146.254:41707 requested a full tablet report, sending...
I20260811 17:12:56.851382 7040 ts_manager.cc:194] Registered new tserver with Master: a8ae947457424487be8eb879b4e26f7c (127.4.146.194:37125)
I20260811 17:12:56.852151 7040 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.194@KRBTEST.COM'} at 127.4.146.194:47965
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
Entry for principal kudu/127.4.146.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab.
I20260811 17:12:56.868162 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:41707
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:34767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:12:57.002226 7650 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:57.002638 7650 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:57.002730 7650 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:57.007200 7650 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:57.007328 7650 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:57.007432 7650 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:12:57.013648 7650 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:34767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.195.keytab
--principal=kudu/127.4.146.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:41707
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7650
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:57.014901 7650 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:57.016018 7650 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:57.026806 7665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:57.026942 7650 server_base.cc:1034] running on GCE node
W20260811 17:12:57.026806 7659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:57.026806 7658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:57.027804 7650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:57.028697 7650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:57.029904 7650 hybrid_clock.cc:648] HybridClock initialized: now 1786468377029862 us; error 58 us; skew 500 ppm
Aug 11 17:12:57 dist-test-slave-7vjv krb5kdc[6967](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468377, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:12:57.036408 7650 init.cc:377] Logged in from keytab as kudu/127.4.146.195@KRBTEST.COM (short username kudu)
I20260811 17:12:57.037492 7650 webserver.cc:460] Webserver started at http://127.4.146.195:35001/ using document root <none> and password file <none>
I20260811 17:12:57.038164 7650 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:57.038304 7650 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:57.038587 7650 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:12:57.041116 7650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "43d0211be3bf40b092bd3a800beb93f3"
format_stamp: "Formatted at 2026-08-11 17:12:57 on dist-test-slave-7vjv"
server_key: "91c6d0d759472af1de17386bed9c3729"
server_key_iv: "c2728bf3500188f8073bd10453b5669b"
server_key_version: "encryptionkey@0"
I20260811 17:12:57.041805 7650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "43d0211be3bf40b092bd3a800beb93f3"
format_stamp: "Formatted at 2026-08-11 17:12:57 on dist-test-slave-7vjv"
server_key: "91c6d0d759472af1de17386bed9c3729"
server_key_iv: "c2728bf3500188f8073bd10453b5669b"
server_key_version: "encryptionkey@0"
I20260811 17:12:57.046239 7650 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 17:12:57.049276 7681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:57.050766 7650 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:12:57.050956 7650 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "43d0211be3bf40b092bd3a800beb93f3"
format_stamp: "Formatted at 2026-08-11 17:12:57 on dist-test-slave-7vjv"
server_key: "91c6d0d759472af1de17386bed9c3729"
server_key_iv: "c2728bf3500188f8073bd10453b5669b"
server_key_version: "encryptionkey@0"
I20260811 17:12:57.051105 7650 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:57.064814 7650 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:57.068806 7650 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:57.069067 7650 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:57.069764 7650 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:12:57.070714 7650 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:12:57.070792 7650 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:57.070870 7650 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:12:57.070914 7650 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:57.081365 7650 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:45409
I20260811 17:12:57.081388 7885 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:45409 every 8 connection(s)
I20260811 17:12:57.082396 7650 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:12:57.089308 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 7650
I20260811 17:12:57.089486 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:12:57.089818 4683 external_mini_cluster.cc:1428] Setting key bbecfafd736d00dbf43d1241c7b61d03
Aug 11 17:12:57 dist-test-slave-7vjv krb5kdc[6967](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468377, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.195@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:12:57.097777 7116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:57.084806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:51255 (local address 127.4.146.254:41707)
0811 17:12:57.084968 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:57.084972 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:57.085941 (+ 969us) server_negotiation.cc:407] Connection header received
0811 17:12:57.087405 (+ 1464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:57.087408 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:57.087470 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:57.087579 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:57.088904 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.089561 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.090940 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.091187 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.091302 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:57.094112 (+ 2810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:57.094115 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:57.094117 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:12:57.094145 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:57.095522 (+ 1377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:57.096080 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:57.096083 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:57.096084 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:57.096252 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:57.096608 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:57.096611 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:57.096617 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:57.096825 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:57.096908 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:57.097505 (+ 597us) server_negotiation.cc:299] Negotiation successful
0811 17:12:57.097635 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 17:12:57.098721 7889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:57.085181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:41707 (local address 127.4.146.195:51255)
0811 17:12:57.085761 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:57.085829 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:57.087169 (+ 1340us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:57.087767 (+ 598us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:57.087774 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:57.088231 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:12:57.088749 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:57.088763 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.089691 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.089700 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:57.090800 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:57.090811 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.091360 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.091364 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:57.091560 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:57.092300 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:12:57.092323 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:12:57.093932 (+ 1609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:12:57.095644 (+ 1712us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:57.095650 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:57.095668 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:57.095959 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:57.096348 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:12:57.096351 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:12:57.096353 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:12:57.096512 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:12:57.096922 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:12:57.096929 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:12:57.097233 (+ 304us) client_negotiation.cc:769] Sending connection context
0811 17:12:57.097412 (+ 179us) client_negotiation.cc:240] Negotiation successful
0811 17:12:57.097719 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":126,"threads_started":1}
I20260811 17:12:57.100153 7886 heartbeater.cc:347] Connected to a master server at 127.4.146.254:41707
I20260811 17:12:57.100463 7886 heartbeater.cc:464] Registering TS with master...
I20260811 17:12:57.101058 7886 heartbeater.cc:511] Master 127.4.146.254:41707 requested a full tablet report, sending...
I20260811 17:12:57.102447 7040 ts_manager.cc:194] Registered new tserver with Master: 43d0211be3bf40b092bd3a800beb93f3 (127.4.146.195:45409)
I20260811 17:12:57.103112 7040 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.4.146.195@KRBTEST.COM'} at 127.4.146.195:51255
I20260811 17:12:57.104314 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 17:12:57.114365 7116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:57.106378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34100 (local address 127.4.146.254:41707)
0811 17:12:57.106513 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:57.106517 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:57.106673 (+ 156us) server_negotiation.cc:407] Connection header received
0811 17:12:57.106799 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:57.106802 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:57.106841 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:57.106901 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:57.107641 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.108234 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.109076 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.109313 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.109397 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:57.111036 (+ 1639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:57.111038 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:57.111040 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:12:57.111063 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:57.112662 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:57.113088 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:57.113090 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:57.113091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:57.113185 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:12:57.113430 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:12:57.113432 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:12:57.113433 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:12:57.113662 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:57.113771 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:57.114019 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 17:12:57.114141 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 17:12:57.117544 7040 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34100:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 17:12:57.120795 7040 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:12:57.136751 7904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:57.130571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:37125 (local address 127.0.0.1:43010)
0811 17:12:57.131386 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:57.131449 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:57.131602 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:57.132642 (+ 1040us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:57.132644 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:57.132677 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:57.132855 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:57.132862 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.133930 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.133934 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:57.135193 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:57.135203 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.136067 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.136071 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:57.136214 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:57.136254 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 17:12:57.136410 (+ 156us) client_negotiation.cc:240] Negotiation successful
0811 17:12:57.136552 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"mutex_wait_us":17,"spinlock_wait_cycles":5376,"thread_start_us":105,"threads_started":1}
I20260811 17:12:57.136754 7906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:57.130728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43010 (local address 127.4.146.194:37125)
0811 17:12:57.132238 (+ 1510us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:57.132249 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:57.132270 (+ 21us) server_negotiation.cc:407] Connection header received
0811 17:12:57.132333 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:57.132337 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:57.132480 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:57.132759 (+ 279us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:57.132961 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.133786 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.135330 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.135928 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.136061 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:57.136273 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:57.136444 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 17:12:57.136551 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1308,"thread_start_us":192,"threads_started":1}
I20260811 17:12:57.137485 7905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:57.130794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:45409 (local address 127.0.0.1:37652)
0811 17:12:57.131736 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:57.131750 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:57.131835 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:57.132879 (+ 1044us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:57.132881 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:57.132897 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:57.132984 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:57.132988 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.134495 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.134498 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:57.135977 (+ 1479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:57.135983 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.137190 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.137192 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:57.137260 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:57.137280 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 17:12:57.137335 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 17:12:57.137388 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":880,"mutex_wait_us":188,"thread_start_us":125,"threads_started":1}
I20260811 17:12:57.137635 7907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:57.130979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37652 (local address 127.4.146.195:45409)
0811 17:12:57.132301 (+ 1322us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:57.132313 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:57.132334 (+ 21us) server_negotiation.cc:407] Connection header received
0811 17:12:57.132402 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:57.132406 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:57.132571 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:57.132705 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:57.133113 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.134336 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.136155 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.137002 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.137113 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:57.137267 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:57.137389 (+ 122us) server_negotiation.cc:299] Negotiation successful
0811 17:12:57.137488 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1220,"thread_start_us":147,"threads_started":1}
I20260811 17:12:57.140228 7520 tablet_service.cc:1467] Processing CreateTablet for tablet fb916bc25ba74182862872892de295c6 (DEFAULT_TABLE table=test-table [id=3362aafa1a1b424b853b07b07d7fd447]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:12:57.141412 7520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb916bc25ba74182862872892de295c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:57.142442 7758 tablet_service.cc:1467] Processing CreateTablet for tablet fb916bc25ba74182862872892de295c6 (DEFAULT_TABLE table=test-table [id=3362aafa1a1b424b853b07b07d7fd447]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:12:57.143841 7758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb916bc25ba74182862872892de295c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:57.148485 7910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:57.131423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:36151 (local address 127.0.0.1:56354)
0811 17:12:57.131876 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:57.131889 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:57.131977 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:57.132631 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:57.132638 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:57.132678 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:57.133043 (+ 365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:57.133050 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.134495 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.134498 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:57.135970 (+ 1472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:57.135983 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.147889 (+ 11906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.147893 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:57.148005 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:57.148033 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 17:12:57.148161 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 17:12:57.148270 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"mutex_wait_us":122,"spinlock_wait_cycles":6784,"thread_start_us":100,"threads_started":1}
I20260811 17:12:57.148540 7911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:57.131629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56354 (local address 127.4.146.193:36151)
0811 17:12:57.132069 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:57.132076 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:57.132125 (+ 49us) server_negotiation.cc:407] Connection header received
0811 17:12:57.132209 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:57.132215 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:57.132435 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:57.132602 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:57.133182 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.134336 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.136157 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.147470 (+ 11313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.147609 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:57.147796 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:57.148235 (+ 439us) server_negotiation.cc:299] Negotiation successful
0811 17:12:57.148372 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":122,"threads_started":1}
I20260811 17:12:57.149380 7913 tablet_bootstrap.cc:492] T fb916bc25ba74182862872892de295c6 P a8ae947457424487be8eb879b4e26f7c: Bootstrap starting.
I20260811 17:12:57.150661 7916 tablet_bootstrap.cc:492] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3: Bootstrap starting.
I20260811 17:12:57.152019 7273 tablet_service.cc:1467] Processing CreateTablet for tablet fb916bc25ba74182862872892de295c6 (DEFAULT_TABLE table=test-table [id=3362aafa1a1b424b853b07b07d7fd447]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:12:57.153275 7916 tablet_bootstrap.cc:654] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:57.153357 7273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb916bc25ba74182862872892de295c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:57.154732 7916 log.cc:824] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:57.154891 7913 tablet_bootstrap.cc:654] T fb916bc25ba74182862872892de295c6 P a8ae947457424487be8eb879b4e26f7c: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:57.155876 7913 log.cc:824] T fb916bc25ba74182862872892de295c6 P a8ae947457424487be8eb879b4e26f7c: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:57.157342 7916 tablet_bootstrap.cc:492] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3: No bootstrap required, opened a new log
I20260811 17:12:57.157585 7916 ts_tablet_manager.cc:1397] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 17:12:57.157979 7913 tablet_bootstrap.cc:492] T fb916bc25ba74182862872892de295c6 P a8ae947457424487be8eb879b4e26f7c: No bootstrap required, opened a new log
I20260811 17:12:57.158197 7913 ts_tablet_manager.cc:1397] T fb916bc25ba74182862872892de295c6 P a8ae947457424487be8eb879b4e26f7c: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260811 17:12:57.161619 7921 tablet_bootstrap.cc:492] T fb916bc25ba74182862872892de295c6 P ba92a5c809af45e887a522a2dc455534: Bootstrap starting.
I20260811 17:12:57.161890 7916 raft_consensus.cc:348] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ae947457424487be8eb879b4e26f7c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 37125 } } peers { permanent_uuid: "43d0211be3bf40b092bd3a800beb93f3" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45409 } } peers { permanent_uuid: "ba92a5c809af45e887a522a2dc455534" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 36151 } }
I20260811 17:12:57.161964 7913 raft_consensus.cc:348] T fb916bc25ba74182862872892de295c6 P a8ae947457424487be8eb879b4e26f7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ae947457424487be8eb879b4e26f7c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 37125 } } peers { permanent_uuid: "43d0211be3bf40b092bd3a800beb93f3" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45409 } } peers { permanent_uuid: "ba92a5c809af45e887a522a2dc455534" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 36151 } }
I20260811 17:12:57.162235 7913 raft_consensus.cc:374] T fb916bc25ba74182862872892de295c6 P a8ae947457424487be8eb879b4e26f7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:57.162237 7916 raft_consensus.cc:374] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:57.162294 7913 raft_consensus.cc:729] T fb916bc25ba74182862872892de295c6 P a8ae947457424487be8eb879b4e26f7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8ae947457424487be8eb879b4e26f7c, State: Initialized, Role: FOLLOWER
I20260811 17:12:57.162297 7916 raft_consensus.cc:729] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43d0211be3bf40b092bd3a800beb93f3, State: Initialized, Role: FOLLOWER
I20260811 17:12:57.162743 7916 consensus_queue.cc:260] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ae947457424487be8eb879b4e26f7c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 37125 } } peers { permanent_uuid: "43d0211be3bf40b092bd3a800beb93f3" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45409 } } peers { permanent_uuid: "ba92a5c809af45e887a522a2dc455534" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 36151 } }
I20260811 17:12:57.162756 7913 consensus_queue.cc:260] T fb916bc25ba74182862872892de295c6 P a8ae947457424487be8eb879b4e26f7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ae947457424487be8eb879b4e26f7c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 37125 } } peers { permanent_uuid: "43d0211be3bf40b092bd3a800beb93f3" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45409 } } peers { permanent_uuid: "ba92a5c809af45e887a522a2dc455534" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 36151 } }
I20260811 17:12:57.163524 7641 heartbeater.cc:503] Master 127.4.146.254:41707 was elected leader, sending a full tablet report...
I20260811 17:12:57.163795 7886 heartbeater.cc:503] Master 127.4.146.254:41707 was elected leader, sending a full tablet report...
I20260811 17:12:57.163837 7913 ts_tablet_manager.cc:1428] T fb916bc25ba74182862872892de295c6 P a8ae947457424487be8eb879b4e26f7c: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260811 17:12:57.164379 7921 tablet_bootstrap.cc:654] T fb916bc25ba74182862872892de295c6 P ba92a5c809af45e887a522a2dc455534: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:57.165073 7916 ts_tablet_manager.cc:1428] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260811 17:12:57.165341 7921 log.cc:824] T fb916bc25ba74182862872892de295c6 P ba92a5c809af45e887a522a2dc455534: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:57.167835 7921 tablet_bootstrap.cc:492] T fb916bc25ba74182862872892de295c6 P ba92a5c809af45e887a522a2dc455534: No bootstrap required, opened a new log
I20260811 17:12:57.168047 7921 ts_tablet_manager.cc:1397] T fb916bc25ba74182862872892de295c6 P ba92a5c809af45e887a522a2dc455534: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 17:12:57.172292 7921 raft_consensus.cc:348] T fb916bc25ba74182862872892de295c6 P ba92a5c809af45e887a522a2dc455534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ae947457424487be8eb879b4e26f7c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 37125 } } peers { permanent_uuid: "43d0211be3bf40b092bd3a800beb93f3" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45409 } } peers { permanent_uuid: "ba92a5c809af45e887a522a2dc455534" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 36151 } }
I20260811 17:12:57.172546 7921 raft_consensus.cc:374] T fb916bc25ba74182862872892de295c6 P ba92a5c809af45e887a522a2dc455534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:57.172583 7921 raft_consensus.cc:729] T fb916bc25ba74182862872892de295c6 P ba92a5c809af45e887a522a2dc455534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba92a5c809af45e887a522a2dc455534, State: Initialized, Role: FOLLOWER
I20260811 17:12:57.173075 7921 consensus_queue.cc:260] T fb916bc25ba74182862872892de295c6 P ba92a5c809af45e887a522a2dc455534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ae947457424487be8eb879b4e26f7c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 37125 } } peers { permanent_uuid: "43d0211be3bf40b092bd3a800beb93f3" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45409 } } peers { permanent_uuid: "ba92a5c809af45e887a522a2dc455534" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 36151 } }
I20260811 17:12:57.173813 7387 heartbeater.cc:503] Master 127.4.146.254:41707 was elected leader, sending a full tablet report...
I20260811 17:12:57.174144 7921 ts_tablet_manager.cc:1428] T fb916bc25ba74182862872892de295c6 P ba92a5c809af45e887a522a2dc455534: Time spent starting tablet: real 0.006s user 0.002s sys 0.003s
I20260811 17:12:57.262701 7926 raft_consensus.cc:482] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:12:57.262966 7926 raft_consensus.cc:504] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ae947457424487be8eb879b4e26f7c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 37125 } } peers { permanent_uuid: "43d0211be3bf40b092bd3a800beb93f3" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45409 } } peers { permanent_uuid: "ba92a5c809af45e887a522a2dc455534" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 36151 } }
I20260811 17:12:57.264235 7926 leader_election.cc:288] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8ae947457424487be8eb879b4e26f7c (127.4.146.194:37125), ba92a5c809af45e887a522a2dc455534 (127.4.146.193:36151)
I20260811 17:12:57.268055 7906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:57.264783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:51493 (local address 127.4.146.194:37125)
0811 17:12:57.264936 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:57.264942 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:57.264960 (+ 18us) server_negotiation.cc:407] Connection header received
0811 17:12:57.265021 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:57.265026 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:57.265075 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:57.265178 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:57.265461 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.265977 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.267024 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.267444 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.267608 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:57.267676 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:57.267837 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 17:12:57.267911 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 17:12:57.268055 7889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:57.264552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:37125 (local address 127.4.146.195:51493)
0811 17:12:57.264731 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:57.264750 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:57.264892 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:57.265192 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:57.265195 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:57.265213 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:57.265339 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:57.265345 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.266106 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.266109 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:57.266891 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:57.266900 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.267575 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.267579 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:57.267689 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:57.267719 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 17:12:57.267820 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 17:12:57.267902 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84}
I20260811 17:12:57.268668 7911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:57.264690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:41055 (local address 127.4.146.193:36151)
0811 17:12:57.264854 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:57.264860 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:57.265327 (+ 467us) server_negotiation.cc:407] Connection header received
0811 17:12:57.265489 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:57.265495 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:57.265542 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:57.265633 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:57.265933 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.266464 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.267529 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.268017 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.268206 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:57.268258 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:57.268483 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 17:12:57.268562 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 17:12:57.268683 7933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:57.264552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:36151 (local address 127.4.146.195:41055)
0811 17:12:57.265220 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:57.265233 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:57.265364 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:57.265646 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:57.265648 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:57.265666 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:57.265814 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:57.265820 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.266590 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.266594 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:57.267395 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:57.267405 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.268201 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.268205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:57.268307 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:57.268337 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 17:12:57.268452 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 17:12:57.268524 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"mutex_wait_us":282,"thread_start_us":164,"threads_started":1}
I20260811 17:12:57.268836 7560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb916bc25ba74182862872892de295c6" candidate_uuid: "43d0211be3bf40b092bd3a800beb93f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8ae947457424487be8eb879b4e26f7c" is_pre_election: true
I20260811 17:12:57.269243 7560 raft_consensus.cc:2454] T fb916bc25ba74182862872892de295c6 P a8ae947457424487be8eb879b4e26f7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43d0211be3bf40b092bd3a800beb93f3 in term 0.
I20260811 17:12:57.269472 7307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb916bc25ba74182862872892de295c6" candidate_uuid: "43d0211be3bf40b092bd3a800beb93f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba92a5c809af45e887a522a2dc455534" is_pre_election: true
I20260811 17:12:57.269753 7307 raft_consensus.cc:2454] T fb916bc25ba74182862872892de295c6 P ba92a5c809af45e887a522a2dc455534 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43d0211be3bf40b092bd3a800beb93f3 in term 0.
I20260811 17:12:57.269801 7687 leader_election.cc:302] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43d0211be3bf40b092bd3a800beb93f3, a8ae947457424487be8eb879b4e26f7c; no voters:
I20260811 17:12:57.270054 7926 raft_consensus.cc:2781] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:12:57.270171 7926 raft_consensus.cc:482] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:12:57.270236 7926 raft_consensus.cc:3037] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:57.271342 7926 raft_consensus.cc:504] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ae947457424487be8eb879b4e26f7c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 37125 } } peers { permanent_uuid: "43d0211be3bf40b092bd3a800beb93f3" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45409 } } peers { permanent_uuid: "ba92a5c809af45e887a522a2dc455534" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 36151 } }
I20260811 17:12:57.271721 7926 leader_election.cc:288] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3 [CANDIDATE]: Term 1 election: Requested vote from peers a8ae947457424487be8eb879b4e26f7c (127.4.146.194:37125), ba92a5c809af45e887a522a2dc455534 (127.4.146.193:36151)
I20260811 17:12:57.272136 7560 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb916bc25ba74182862872892de295c6" candidate_uuid: "43d0211be3bf40b092bd3a800beb93f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8ae947457424487be8eb879b4e26f7c"
I20260811 17:12:57.272264 7307 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb916bc25ba74182862872892de295c6" candidate_uuid: "43d0211be3bf40b092bd3a800beb93f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba92a5c809af45e887a522a2dc455534"
I20260811 17:12:57.272266 7560 raft_consensus.cc:3037] T fb916bc25ba74182862872892de295c6 P a8ae947457424487be8eb879b4e26f7c [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:57.272428 7307 raft_consensus.cc:3037] T fb916bc25ba74182862872892de295c6 P ba92a5c809af45e887a522a2dc455534 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:57.273473 7560 raft_consensus.cc:2454] T fb916bc25ba74182862872892de295c6 P a8ae947457424487be8eb879b4e26f7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43d0211be3bf40b092bd3a800beb93f3 in term 1.
I20260811 17:12:57.273561 7307 raft_consensus.cc:2454] T fb916bc25ba74182862872892de295c6 P ba92a5c809af45e887a522a2dc455534 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43d0211be3bf40b092bd3a800beb93f3 in term 1.
I20260811 17:12:57.273834 7687 leader_election.cc:302] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43d0211be3bf40b092bd3a800beb93f3, a8ae947457424487be8eb879b4e26f7c; no voters:
I20260811 17:12:57.274017 7926 raft_consensus.cc:2781] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:12:57.274324 7926 raft_consensus.cc:686] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3 [term 1 LEADER]: Becoming Leader. State: Replica: 43d0211be3bf40b092bd3a800beb93f3, State: Running, Role: LEADER
I20260811 17:12:57.274770 7926 consensus_queue.cc:237] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ae947457424487be8eb879b4e26f7c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 37125 } } peers { permanent_uuid: "43d0211be3bf40b092bd3a800beb93f3" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45409 } } peers { permanent_uuid: "ba92a5c809af45e887a522a2dc455534" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 36151 } }
I20260811 17:12:57.278769 7039 catalog_manager.cc:5495] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 43d0211be3bf40b092bd3a800beb93f3 (127.4.146.195). New cstate: current_term: 1 leader_uuid: "43d0211be3bf40b092bd3a800beb93f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8ae947457424487be8eb879b4e26f7c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 37125 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43d0211be3bf40b092bd3a800beb93f3" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 45409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba92a5c809af45e887a522a2dc455534" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 36151 } health_report { overall_health: UNKNOWN } } }
I20260811 17:12:57.291378 7907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:57.287825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37658 (local address 127.4.146.195:45409)
0811 17:12:57.287974 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:57.287977 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:57.287992 (+ 15us) server_negotiation.cc:407] Connection header received
0811 17:12:57.288177 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:57.288180 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:57.288238 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:57.288371 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:12:57.288655 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.289158 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.290006 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.290213 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.290290 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:57.290568 (+ 278us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:12:57.291028 (+ 460us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:12:57.291125 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:57.291201 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 17:12:57.291256 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 17:12:57.297935 7560 raft_consensus.cc:1261] T fb916bc25ba74182862872892de295c6 P a8ae947457424487be8eb879b4e26f7c [term 1 FOLLOWER]: Refusing update from remote peer 43d0211be3bf40b092bd3a800beb93f3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:12:57.297960 7307 raft_consensus.cc:1261] T fb916bc25ba74182862872892de295c6 P ba92a5c809af45e887a522a2dc455534 [term 1 FOLLOWER]: Refusing update from remote peer 43d0211be3bf40b092bd3a800beb93f3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:12:57.298717 7926 consensus_queue.cc:1035] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba92a5c809af45e887a522a2dc455534" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 36151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:12:57.298945 7935 consensus_queue.cc:1035] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8ae947457424487be8eb879b4e26f7c" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 37125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:12:57.308496 7945 mvcc.cc:205] Tried to move back new op lower bound from 7317374473403654144 to 7317374473320751104. Current Snapshot: MvccSnapshot[applied={T|T < 7317374473403654144}]
I20260811 17:12:57.318356 7040 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34100:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:12:57.318586 7040 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34100:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:12:57.321666 7040 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1a58f69b09f34d36ab6833c27bdf6a77: Sending DeleteTablet for 3 replicas of tablet fb916bc25ba74182862872892de295c6
I20260811 17:12:57.322847 7520 tablet_service.cc:1514] Processing DeleteTablet for tablet fb916bc25ba74182862872892de295c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:12:57 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:43010
I20260811 17:12:57.322858 7758 tablet_service.cc:1514] Processing DeleteTablet for tablet fb916bc25ba74182862872892de295c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:12:57 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:37652
I20260811 17:12:57.323190 7273 tablet_service.cc:1514] Processing DeleteTablet for tablet fb916bc25ba74182862872892de295c6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:12:57 UTC) from {username='kudu', principal='kudu/127.4.146.254@KRBTEST.COM'} at 127.0.0.1:56354
I20260811 17:12:57.323681 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 7170
I20260811 17:12:57.332435 7959 tablet_replica.cc:330] T fb916bc25ba74182862872892de295c6 P a8ae947457424487be8eb879b4e26f7c: stopping tablet replica
I20260811 17:12:57.332985 7959 raft_consensus.cc:2229] T fb916bc25ba74182862872892de295c6 P a8ae947457424487be8eb879b4e26f7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:12:57.333482 7959 raft_consensus.cc:2258] T fb916bc25ba74182862872892de295c6 P a8ae947457424487be8eb879b4e26f7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:12:57.333985 7960 tablet_replica.cc:330] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3: stopping tablet replica
I20260811 17:12:57.334383 7960 raft_consensus.cc:2229] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3 [term 1 LEADER]: Raft consensus shutting down.
I20260811 17:12:57.334964 7960 raft_consensus.cc:2258] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:12:57.338776 7960 ts_tablet_manager.cc:1905] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:12:57.340272 7959 ts_tablet_manager.cc:1905] T fb916bc25ba74182862872892de295c6 P a8ae947457424487be8eb879b4e26f7c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:12:57.341995 7960 ts_tablet_manager.cc:1918] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:12:57.342206 7960 log.cc:1196] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/fb916bc25ba74182862872892de295c6
I20260811 17:12:57.342669 7960 ts_tablet_manager.cc:1939] T fb916bc25ba74182862872892de295c6 P 43d0211be3bf40b092bd3a800beb93f3: Deleting consensus metadata
I20260811 17:12:57.343245 7959 ts_tablet_manager.cc:1918] T fb916bc25ba74182862872892de295c6 P a8ae947457424487be8eb879b4e26f7c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:12:57.343356 7959 log.cc:1196] T fb916bc25ba74182862872892de295c6 P a8ae947457424487be8eb879b4e26f7c: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786468091870818-4683-0/minicluster-data/ts-1/wal/wals/fb916bc25ba74182862872892de295c6
I20260811 17:12:57.343678 7959 ts_tablet_manager.cc:1939] T fb916bc25ba74182862872892de295c6 P a8ae947457424487be8eb879b4e26f7c: Deleting consensus metadata
I20260811 17:12:57.344523 7019 catalog_manager.cc:4841] TS 43d0211be3bf40b092bd3a800beb93f3 (127.4.146.195:45409): tablet fb916bc25ba74182862872892de295c6 (table test-table [id=3362aafa1a1b424b853b07b07d7fd447]) successfully deleted
I20260811 17:12:57.344901 7022 catalog_manager.cc:4841] TS a8ae947457424487be8eb879b4e26f7c (127.4.146.194:37125): tablet fb916bc25ba74182862872892de295c6 (table test-table [id=3362aafa1a1b424b853b07b07d7fd447]) successfully deleted
I20260811 17:12:57.355821 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 7394
W20260811 17:12:57.355770 7019 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.146.193:36151 (error 108)
I20260811 17:12:57.366164 7910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:57.365515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:36151 (local address 127.0.0.1:56368)
0811 17:12:57.365928 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:57.366023 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.193:36151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":281}
W20260811 17:12:57.366428 7019 catalog_manager.cc:4584] TS ba92a5c809af45e887a522a2dc455534 (127.4.146.193:36151): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fb916bc25ba74182862872892de295c6: Network error: Client connection negotiation failed: client connection to 127.4.146.193:36151: connect: Connection refused (error 111)
I20260811 17:12:57.369602 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 7650
I20260811 17:12:57.390035 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 6986
2026-08-11T17:12:57Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2859 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T17:12:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:12:57Z Disabled control of system clock
I20260811 17:12:57.437719 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:32905
--webserver_interface=127.4.146.254
--webserver_port=0
--builtin_ntp_servers=127.4.146.212:32873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:32905
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 17:12:57.556278 7967 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:57.556610 7967 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:57.556650 7967 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:57.560865 7967 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:12:57.560945 7967 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:57.560961 7967 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:57.560979 7967 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:12:57.560994 7967 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:12:57.566040 7967 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:32873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:32905
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:32905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7967
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:57.567203 7967 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:57.568747 7967 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:57.578613 7975 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:57.578624 7976 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:57.578686 7967 server_base.cc:1034] running on GCE node
W20260811 17:12:57.578696 7989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:57.579545 7967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:57.580847 7967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:57.582037 7967 hybrid_clock.cc:648] HybridClock initialized: now 1786468377582022 us; error 38 us; skew 500 ppm
I20260811 17:12:57.584312 7967 webserver.cc:460] Webserver started at http://127.4.146.254:38425/ using document root <none> and password file <none>
I20260811 17:12:57.584954 7967 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:57.585057 7967 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:57.585310 7967 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:12:57.587641 7967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "69cdf20f795b4dc88e9173782695df32"
format_stamp: "Formatted at 2026-08-11 17:12:57 on dist-test-slave-7vjv"
server_key: "dace57e727f641fe6327a088107e5aef"
server_key_iv: "854a6e472828c63eb91085cdca36ef06"
server_key_version: "encryptionkey@0"
I20260811 17:12:57.588348 7967 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "69cdf20f795b4dc88e9173782695df32"
format_stamp: "Formatted at 2026-08-11 17:12:57 on dist-test-slave-7vjv"
server_key: "dace57e727f641fe6327a088107e5aef"
server_key_iv: "854a6e472828c63eb91085cdca36ef06"
server_key_version: "encryptionkey@0"
I20260811 17:12:57.592469 7967 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260811 17:12:57.595139 7997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:57.596659 7967 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:12:57.596817 7967 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "69cdf20f795b4dc88e9173782695df32"
format_stamp: "Formatted at 2026-08-11 17:12:57 on dist-test-slave-7vjv"
server_key: "dace57e727f641fe6327a088107e5aef"
server_key_iv: "854a6e472828c63eb91085cdca36ef06"
server_key_version: "encryptionkey@0"
I20260811 17:12:57.596942 7967 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:57.621419 7967 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:57.622264 7967 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:57.622491 7967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:57.630479 7967 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:32905
I20260811 17:12:57.630511 8092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:32905 every 8 connection(s)
I20260811 17:12:57.631510 7967 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:12:57.634994 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 7967
I20260811 17:12:57.635054 8093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:57.635144 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:12:57.635488 4683 external_mini_cluster.cc:1428] Setting key f0e47dcd0ddc6bd4490d8aa23a5470c5
I20260811 17:12:57.641991 8093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69cdf20f795b4dc88e9173782695df32: Bootstrap starting.
I20260811 17:12:57.644281 8093 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 69cdf20f795b4dc88e9173782695df32: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:57.645141 8093 log.cc:824] T 00000000000000000000000000000000 P 69cdf20f795b4dc88e9173782695df32: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:57.645381 8096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:57.637229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38684 (local address 127.4.146.254:32905)
0811 17:12:57.637935 (+ 706us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:57.637951 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:57.637996 (+ 45us) server_negotiation.cc:407] Connection header received
0811 17:12:57.638713 (+ 717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:57.638730 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:57.639134 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:57.639508 (+ 374us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:57.639969 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.641015 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.641914 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.642450 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.642637 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:57.643559 (+ 922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:57.643564 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:57.643576 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:12:57.643967 (+ 391us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:57.644023 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:12:57.644042 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:57.644223 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:57.644342 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 17:12:57.644615 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":165,"threads_started":1}
I20260811 17:12:57.647256 8093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69cdf20f795b4dc88e9173782695df32: No bootstrap required, opened a new log
I20260811 17:12:57.651062 8093 raft_consensus.cc:348] T 00000000000000000000000000000000 P 69cdf20f795b4dc88e9173782695df32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69cdf20f795b4dc88e9173782695df32" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 32905 } }
I20260811 17:12:57.651358 8093 raft_consensus.cc:374] T 00000000000000000000000000000000 P 69cdf20f795b4dc88e9173782695df32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:57.651474 8093 raft_consensus.cc:729] T 00000000000000000000000000000000 P 69cdf20f795b4dc88e9173782695df32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69cdf20f795b4dc88e9173782695df32, State: Initialized, Role: FOLLOWER
I20260811 17:12:57.651995 8093 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69cdf20f795b4dc88e9173782695df32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69cdf20f795b4dc88e9173782695df32" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 32905 } }
I20260811 17:12:57.652184 8093 raft_consensus.cc:388] T 00000000000000000000000000000000 P 69cdf20f795b4dc88e9173782695df32 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:12:57.652282 8093 raft_consensus.cc:482] T 00000000000000000000000000000000 P 69cdf20f795b4dc88e9173782695df32 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:12:57.652411 8093 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 69cdf20f795b4dc88e9173782695df32 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:57.653877 8093 raft_consensus.cc:504] T 00000000000000000000000000000000 P 69cdf20f795b4dc88e9173782695df32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69cdf20f795b4dc88e9173782695df32" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 32905 } }
I20260811 17:12:57.654284 8093 leader_election.cc:302] T 00000000000000000000000000000000 P 69cdf20f795b4dc88e9173782695df32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 69cdf20f795b4dc88e9173782695df32; no voters:
I20260811 17:12:57.654605 8093 leader_election.cc:288] T 00000000000000000000000000000000 P 69cdf20f795b4dc88e9173782695df32 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:12:57.654776 8099 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 69cdf20f795b4dc88e9173782695df32 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:12:57.655072 8099 raft_consensus.cc:686] T 00000000000000000000000000000000 P 69cdf20f795b4dc88e9173782695df32 [term 1 LEADER]: Becoming Leader. State: Replica: 69cdf20f795b4dc88e9173782695df32, State: Running, Role: LEADER
I20260811 17:12:57.655422 8099 consensus_queue.cc:237] T 00000000000000000000000000000000 P 69cdf20f795b4dc88e9173782695df32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69cdf20f795b4dc88e9173782695df32" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 32905 } }
I20260811 17:12:57.655999 8093 sys_catalog.cc:564] T 00000000000000000000000000000000 P 69cdf20f795b4dc88e9173782695df32 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:12:57.657799 8104 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69cdf20f795b4dc88e9173782695df32 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "69cdf20f795b4dc88e9173782695df32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69cdf20f795b4dc88e9173782695df32" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 32905 } } }
I20260811 17:12:57.657804 8105 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69cdf20f795b4dc88e9173782695df32 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 69cdf20f795b4dc88e9173782695df32. Latest consensus state: current_term: 1 leader_uuid: "69cdf20f795b4dc88e9173782695df32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69cdf20f795b4dc88e9173782695df32" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 32905 } } }
I20260811 17:12:57.657943 8104 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69cdf20f795b4dc88e9173782695df32 [sys.catalog]: This master's current role is: LEADER
I20260811 17:12:57.657958 8105 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69cdf20f795b4dc88e9173782695df32 [sys.catalog]: This master's current role is: LEADER
W20260811 17:12:57.661229 8123 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 69cdf20f795b4dc88e9173782695df32: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 17:12:57.661324 8123 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 17:12:57.661397 8122 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:12:57.662112 8122 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:12:57.668037 8122 catalog_manager.cc:1347] Generated new cluster ID: ced088a39fed487dabde7832385e27e2
I20260811 17:12:57.668159 8122 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:12:57.678560 8122 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:12:57.679811 8122 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:12:57.696157 8122 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 69cdf20f795b4dc88e9173782695df32: Generated new TSK 0
I20260811 17:12:57.697041 8122 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:12:57.702739 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.193:0
--local_ip_for_outbound_sockets=127.4.146.193
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:32905
--builtin_ntp_servers=127.4.146.212:32873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 17:12:57.825290 8131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:57.825641 8131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:57.825718 8131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:57.829914 8131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:57.830024 8131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:57.830129 8131 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.193
I20260811 17:12:57.835191 8131 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:32873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.4.146.193
--webserver_port=0
--tserver_master_addrs=127.4.146.254:32905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8131
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.193
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:57.836463 8131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:57.837950 8131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:57.848538 8138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:57.848613 8143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:57.848661 8131 server_base.cc:1034] running on GCE node
W20260811 17:12:57.848862 8145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:57.849323 8131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:57.850106 8131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:57.851337 8131 hybrid_clock.cc:648] HybridClock initialized: now 1786468377851325 us; error 36 us; skew 500 ppm
I20260811 17:12:57.853621 8131 webserver.cc:460] Webserver started at http://127.4.146.193:42921/ using document root <none> and password file <none>
I20260811 17:12:57.854267 8131 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:57.854372 8131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:57.854635 8131 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:12:57.857259 8131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-0/data/instance:
uuid: "1a6c8ff8ec55471b92eac5fef011b216"
format_stamp: "Formatted at 2026-08-11 17:12:57 on dist-test-slave-7vjv"
server_key: "9263e8a348ae7feeae886a65a00b6c17"
server_key_iv: "1fd18d284b3c30d252ee896b045b1ec4"
server_key_version: "encryptionkey@0"
I20260811 17:12:57.857945 8131 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance:
uuid: "1a6c8ff8ec55471b92eac5fef011b216"
format_stamp: "Formatted at 2026-08-11 17:12:57 on dist-test-slave-7vjv"
server_key: "9263e8a348ae7feeae886a65a00b6c17"
server_key_iv: "1fd18d284b3c30d252ee896b045b1ec4"
server_key_version: "encryptionkey@0"
I20260811 17:12:57.862191 8131 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 17:12:57.865088 8159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:57.866729 8131 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:12:57.866904 8131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-0/wal
uuid: "1a6c8ff8ec55471b92eac5fef011b216"
format_stamp: "Formatted at 2026-08-11 17:12:57 on dist-test-slave-7vjv"
server_key: "9263e8a348ae7feeae886a65a00b6c17"
server_key_iv: "1fd18d284b3c30d252ee896b045b1ec4"
server_key_version: "encryptionkey@0"
I20260811 17:12:57.867053 8131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:57.884521 8131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:57.885353 8131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:57.885596 8131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:57.886296 8131 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:12:57.887408 8131 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:12:57.887499 8131 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:57.887583 8131 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:12:57.887632 8131 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:57.898212 8131 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.193:37235
I20260811 17:12:57.898244 8368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.193:37235 every 8 connection(s)
I20260811 17:12:57.899379 8131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-0/data/info.pb
I20260811 17:12:57.901459 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 8131
I20260811 17:12:57.901636 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-0/wal/instance
I20260811 17:12:57.901994 4683 external_mini_cluster.cc:1428] Setting key b849c289628455c484a2404f8a21463d
I20260811 17:12:57.904451 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.194:0
--local_ip_for_outbound_sockets=127.4.146.194
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:32905
--builtin_ntp_servers=127.4.146.212:32873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 17:12:57.911459 8096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:57.901824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:40551 (local address 127.4.146.254:32905)
0811 17:12:57.901983 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:57.901987 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:57.903576 (+ 1589us) server_negotiation.cc:407] Connection header received
0811 17:12:57.905267 (+ 1691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:57.905274 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:57.905340 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:57.905437 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:57.906746 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.907394 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.909164 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.909404 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.909548 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:57.910911 (+ 1363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:57.910914 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:57.910916 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:12:57.910931 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:57.910952 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:12:57.910960 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:57.911039 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:57.911226 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 17:12:57.911301 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 17:12:57.912473 8373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:57.902425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:32905 (local address 127.4.146.193:40551)
0811 17:12:57.903365 (+ 940us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:57.903440 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:57.905031 (+ 1591us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:57.905639 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:57.905647 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:57.905740 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:12:57.906525 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:57.906558 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.907561 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.907567 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:57.908989 (+ 1422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:57.909004 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:57.909613 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:57.909618 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:57.909809 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:57.910577 (+ 768us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 17:12:57.910593 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:12:57.910640 (+ 47us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 17:12:57.910720 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:12:57.911055 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:12:57.911066 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:12:57.911072 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 17:12:57.911211 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 17:12:57.911528 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":189,"threads_started":1}
I20260811 17:12:57.914211 8369 heartbeater.cc:347] Connected to a master server at 127.4.146.254:32905
I20260811 17:12:57.914517 8369 heartbeater.cc:464] Registering TS with master...
I20260811 17:12:57.915179 8369 heartbeater.cc:511] Master 127.4.146.254:32905 requested a full tablet report, sending...
I20260811 17:12:57.917505 8030 ts_manager.cc:194] Registered new tserver with Master: 1a6c8ff8ec55471b92eac5fef011b216 (127.4.146.193:37235)
I20260811 17:12:57.919430 8030 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.146.193:40551
W20260811 17:12:58.038611 8374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:58.038969 8374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:58.039012 8374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:58.043785 8374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:58.043917 8374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:58.044059 8374 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.194
I20260811 17:12:58.050798 8374 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:32873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.4.146.194
--webserver_port=0
--tserver_master_addrs=127.4.146.254:32905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.194
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:58.052084 8374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:58.053748 8374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:58.066037 8381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:58.066205 8374 server_base.cc:1034] running on GCE node
W20260811 17:12:58.066069 8380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:58.066069 8384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:58.066879 8374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:58.067662 8374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:58.068948 8374 hybrid_clock.cc:648] HybridClock initialized: now 1786468378068855 us; error 102 us; skew 500 ppm
I20260811 17:12:58.071569 8374 webserver.cc:460] Webserver started at http://127.4.146.194:43827/ using document root <none> and password file <none>
I20260811 17:12:58.072404 8374 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:58.072491 8374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:58.072746 8374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:12:58.075150 8374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-1/data/instance:
uuid: "8f57d089100740c59e22344a3c0e58db"
format_stamp: "Formatted at 2026-08-11 17:12:58 on dist-test-slave-7vjv"
server_key: "7db02bdb4356438c80b9b112f141f247"
server_key_iv: "d92810b6a310aecfe1f55bad5c1f0527"
server_key_version: "encryptionkey@0"
I20260811 17:12:58.075865 8374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance:
uuid: "8f57d089100740c59e22344a3c0e58db"
format_stamp: "Formatted at 2026-08-11 17:12:58 on dist-test-slave-7vjv"
server_key: "7db02bdb4356438c80b9b112f141f247"
server_key_iv: "d92810b6a310aecfe1f55bad5c1f0527"
server_key_version: "encryptionkey@0"
I20260811 17:12:58.080474 8374 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 17:12:58.083454 8392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:58.085053 8374 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:12:58.085228 8374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-1/wal
uuid: "8f57d089100740c59e22344a3c0e58db"
format_stamp: "Formatted at 2026-08-11 17:12:58 on dist-test-slave-7vjv"
server_key: "7db02bdb4356438c80b9b112f141f247"
server_key_iv: "d92810b6a310aecfe1f55bad5c1f0527"
server_key_version: "encryptionkey@0"
I20260811 17:12:58.085368 8374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:58.097818 8374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:58.098610 8374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:58.098839 8374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:58.099514 8374 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:12:58.100771 8374 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:12:58.100864 8374 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:58.100967 8374 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:12:58.101020 8374 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:58.111189 8374 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.194:41085
I20260811 17:12:58.111218 8584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.194:41085 every 8 connection(s)
I20260811 17:12:58.112323 8374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-1/data/info.pb
I20260811 17:12:58.115445 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 8374
I20260811 17:12:58.115653 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-1/wal/instance
I20260811 17:12:58.116070 4683 external_mini_cluster.cc:1428] Setting key 579a01f1697c69a6aa939b38db6bd86d
I20260811 17:12:58.118886 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.4.146.195:0
--local_ip_for_outbound_sockets=127.4.146.195
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:32905
--builtin_ntp_servers=127.4.146.212:32873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 17:12:58.124780 8096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:58.114682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.194:33233 (local address 127.4.146.254:32905)
0811 17:12:58.114851 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:58.114856 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:58.116082 (+ 1226us) server_negotiation.cc:407] Connection header received
0811 17:12:58.118289 (+ 2207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:58.118293 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:58.118350 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:58.118491 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:58.119663 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.120552 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.122081 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.122478 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.122616 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:58.124127 (+ 1511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:58.124135 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:58.124142 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:12:58.124165 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:58.124195 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:12:58.124209 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:58.124295 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:58.124501 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 17:12:58.124582 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 17:12:58.125847 8589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:58.115045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:32905 (local address 127.4.146.194:33233)
0811 17:12:58.115870 (+ 825us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:58.115932 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:58.117965 (+ 2033us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:58.118683 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:58.118691 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:58.118793 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:12:58.119492 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:58.119508 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.120740 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.120743 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:58.121893 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:58.121906 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.122702 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.122706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:58.122908 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:58.123756 (+ 848us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 17:12:58.123758 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:12:58.123810 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 17:12:58.123895 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:12:58.124320 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:12:58.124330 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:12:58.124336 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 17:12:58.124492 (+ 156us) client_negotiation.cc:240] Negotiation successful
0811 17:12:58.124846 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":173,"threads_started":1}
I20260811 17:12:58.127241 8585 heartbeater.cc:347] Connected to a master server at 127.4.146.254:32905
I20260811 17:12:58.127569 8585 heartbeater.cc:464] Registering TS with master...
I20260811 17:12:58.128409 8585 heartbeater.cc:511] Master 127.4.146.254:32905 requested a full tablet report, sending...
I20260811 17:12:58.129835 8030 ts_manager.cc:194] Registered new tserver with Master: 8f57d089100740c59e22344a3c0e58db (127.4.146.194:41085)
I20260811 17:12:58.130761 8030 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.146.194:33233
W20260811 17:12:58.250563 8590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:12:58.250876 8590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:12:58.250917 8590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:12:58.255236 8590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:12:58.255316 8590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:12:58.255375 8590 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.146.195
I20260811 17:12:58.261078 8590 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:32873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.4.146.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.4.146.195
--webserver_port=0
--tserver_master_addrs=127.4.146.254:32905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.4.146.195
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:12:58.262310 8590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:12:58.263738 8590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:12:58.275059 8600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:58.275002 8604 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:12:58.274994 8598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:12:58.275564 8590 server_base.cc:1034] running on GCE node
I20260811 17:12:58.276042 8590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:12:58.276953 8590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:12:58.278182 8590 hybrid_clock.cc:648] HybridClock initialized: now 1786468378278157 us; error 37 us; skew 500 ppm
I20260811 17:12:58.280845 8590 webserver.cc:460] Webserver started at http://127.4.146.195:36423/ using document root <none> and password file <none>
I20260811 17:12:58.281562 8590 fs_manager.cc:359] Metadata directory not provided
I20260811 17:12:58.281646 8590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:12:58.281911 8590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:12:58.284571 8590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-2/data/instance:
uuid: "215bcf09b27c4d179240c4a0f3874385"
format_stamp: "Formatted at 2026-08-11 17:12:58 on dist-test-slave-7vjv"
server_key: "fe9d7f6d6ad723310ad50feb4f702de7"
server_key_iv: "8a617736027c62a982df9bd0dcc61da6"
server_key_version: "encryptionkey@0"
I20260811 17:12:58.285290 8590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance:
uuid: "215bcf09b27c4d179240c4a0f3874385"
format_stamp: "Formatted at 2026-08-11 17:12:58 on dist-test-slave-7vjv"
server_key: "fe9d7f6d6ad723310ad50feb4f702de7"
server_key_iv: "8a617736027c62a982df9bd0dcc61da6"
server_key_version: "encryptionkey@0"
I20260811 17:12:58.290272 8590 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260811 17:12:58.293467 8618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:58.294925 8590 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 17:12:58.295137 8590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-2/wal
uuid: "215bcf09b27c4d179240c4a0f3874385"
format_stamp: "Formatted at 2026-08-11 17:12:58 on dist-test-slave-7vjv"
server_key: "fe9d7f6d6ad723310ad50feb4f702de7"
server_key_iv: "8a617736027c62a982df9bd0dcc61da6"
server_key_version: "encryptionkey@0"
I20260811 17:12:58.295289 8590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:12:58.311066 8590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:12:58.311915 8590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:12:58.312229 8590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:12:58.312927 8590 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 17:12:58.314124 8590 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 17:12:58.314203 8590 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:58.314282 8590 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 17:12:58.314327 8590 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 17:12:58.324745 8590 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.195:36785
I20260811 17:12:58.324775 8845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.195:36785 every 8 connection(s)
I20260811 17:12:58.325791 8590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-2/data/info.pb
I20260811 17:12:58.328717 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 8590
I20260811 17:12:58.328910 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-2/wal/instance
I20260811 17:12:58.329310 4683 external_mini_cluster.cc:1428] Setting key d4b7554740fd091b20ff25c1655a07cd
I20260811 17:12:58.340266 8096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:58.327933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.195:57081 (local address 127.4.146.254:32905)
0811 17:12:58.328134 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:58.328139 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:58.329616 (+ 1477us) server_negotiation.cc:407] Connection header received
0811 17:12:58.331466 (+ 1850us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:58.331470 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:58.331562 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:58.331782 (+ 220us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:58.333258 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.333842 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.335629 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.336130 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.336302 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:58.339016 (+ 2714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:58.339023 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:58.339027 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:12:58.339086 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:58.339157 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:12:58.339177 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:58.339361 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:58.339590 (+ 229us) server_negotiation.cc:299] Negotiation successful
0811 17:12:58.339837 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 17:12:58.341741 8853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:58.328485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:32905 (local address 127.4.146.195:57081)
0811 17:12:58.329398 (+ 913us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:58.329466 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:58.331173 (+ 1707us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:58.332171 (+ 998us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:58.332183 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:58.332312 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:12:58.332920 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:58.332937 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.334009 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.334012 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:58.335394 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:58.335410 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.336550 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.336556 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:58.336836 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:58.338322 (+ 1486us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 17:12:58.338325 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:12:58.338408 (+ 83us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 17:12:58.338538 (+ 130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:12:58.339349 (+ 811us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:12:58.339364 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:12:58.339374 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 17:12:58.339569 (+ 195us) client_negotiation.cc:240] Negotiation successful
0811 17:12:58.340052 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":124,"threads_started":1}
I20260811 17:12:58.343418 8849 heartbeater.cc:347] Connected to a master server at 127.4.146.254:32905
I20260811 17:12:58.343713 8849 heartbeater.cc:464] Registering TS with master...
I20260811 17:12:58.344535 8849 heartbeater.cc:511] Master 127.4.146.254:32905 requested a full tablet report, sending...
I20260811 17:12:58.347360 8029 ts_manager.cc:194] Registered new tserver with Master: 215bcf09b27c4d179240c4a0f3874385 (127.4.146.195:36785)
I20260811 17:12:58.348351 8029 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.4.146.195:57081
I20260811 17:12:58.356673 4683 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 17:12:58.368974 8096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:58.362248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38696 (local address 127.4.146.254:32905)
0811 17:12:58.362404 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:58.362409 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:58.362689 (+ 280us) server_negotiation.cc:407] Connection header received
0811 17:12:58.362884 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:58.362887 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:58.362978 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:58.363068 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:12:58.363428 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.364490 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.366070 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.366315 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.366444 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:58.368274 (+ 1830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:12:58.368281 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:12:58.368286 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:12:58.368306 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:12:58.368334 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:12:58.368345 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:12:58.368422 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:58.368682 (+ 260us) server_negotiation.cc:299] Negotiation successful
0811 17:12:58.368788 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 17:12:58.373526 8029 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38696:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 17:12:58.378270 8029 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 17:12:58.395375 8870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:58.388311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:37235 (local address 127.0.0.1:58166)
0811 17:12:58.388994 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:58.389053 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:58.389207 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:58.390269 (+ 1062us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:58.390276 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:58.390316 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:58.390599 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:58.390608 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.392250 (+ 1642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.392253 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:58.393470 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:58.393481 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.394644 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.394648 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:58.394793 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:58.394852 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 17:12:58.394999 (+ 147us) client_negotiation.cc:240] Negotiation successful
0811 17:12:58.395172 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"mutex_wait_us":69,"spinlock_wait_cycles":9984,"thread_start_us":106,"threads_started":1}
I20260811 17:12:58.395599 8879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:58.389184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37946 (local address 127.4.146.194:41085)
0811 17:12:58.390681 (+ 1497us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:58.390696 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:58.390721 (+ 25us) server_negotiation.cc:407] Connection header received
0811 17:12:58.390801 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:58.390806 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:58.391003 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:58.391176 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:58.391435 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.392729 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.394181 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.394898 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.395016 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:58.395218 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:58.395279 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 17:12:58.395389 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1351,"thread_start_us":108,"threads_started":1}
I20260811 17:12:58.395869 8876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:58.388423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58166 (local address 127.4.146.193:37235)
0811 17:12:58.389729 (+ 1306us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:58.389737 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:58.389765 (+ 28us) server_negotiation.cc:407] Connection header received
0811 17:12:58.389857 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:58.389864 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:58.390086 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:58.390274 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:58.390721 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.392097 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.393608 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.394490 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.394604 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:58.394818 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:58.395565 (+ 747us) server_negotiation.cc:299] Negotiation successful
0811 17:12:58.395690 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1164,"thread_start_us":148,"threads_started":1}
I20260811 17:12:58.395448 8873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:58.388704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:41085 (local address 127.0.0.1:37946)
0811 17:12:58.389450 (+ 746us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:58.389463 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:58.389543 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:58.391186 (+ 1643us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:58.391188 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:58.391207 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:58.391306 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:58.391311 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.392875 (+ 1564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.392879 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:58.394035 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:58.394045 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.395028 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.395032 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:58.395134 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:58.395161 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 17:12:58.395222 (+ 61us) client_negotiation.cc:240] Negotiation successful
0811 17:12:58.395292 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"mutex_wait_us":1,"thread_start_us":99,"threads_started":1}
I20260811 17:12:58.397074 8878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:58.388353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:36785 (local address 127.0.0.1:37232)
0811 17:12:58.389282 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:58.389355 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:58.389443 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:58.390269 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:58.390276 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:58.390314 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:58.390602 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:58.390608 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.393705 (+ 3097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.393708 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:58.394791 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:58.394802 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.396667 (+ 1865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.396672 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:58.396763 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:58.396786 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 17:12:58.396850 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 17:12:58.396927 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":855,"mutex_wait_us":65,"spinlock_wait_cycles":6656,"thread_start_us":103,"threads_started":1}
I20260811 17:12:58.397169 8884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:58.389196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37232 (local address 127.4.146.195:36785)
0811 17:12:58.389799 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:58.389811 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:58.389831 (+ 20us) server_negotiation.cc:407] Connection header received
0811 17:12:58.389900 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:58.389904 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:58.390086 (+ 182us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:58.390273 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:58.392308 (+ 2035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.393588 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.394904 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.396519 (+ 1615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.396656 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:58.396853 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:58.396907 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 17:12:58.397003 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":168,"threads_started":1}
I20260811 17:12:58.399818 8731 tablet_service.cc:1467] Processing CreateTablet for tablet b148494d87264cb0945cf9bab78d081a (DEFAULT_TABLE table=test-table [id=7848d7532e914a6387fe2622588276f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:12:58.399824 8487 tablet_service.cc:1467] Processing CreateTablet for tablet b148494d87264cb0945cf9bab78d081a (DEFAULT_TABLE table=test-table [id=7848d7532e914a6387fe2622588276f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:12:58.399828 8252 tablet_service.cc:1467] Processing CreateTablet for tablet b148494d87264cb0945cf9bab78d081a (DEFAULT_TABLE table=test-table [id=7848d7532e914a6387fe2622588276f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 17:12:58.401149 8731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b148494d87264cb0945cf9bab78d081a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:58.401386 8487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b148494d87264cb0945cf9bab78d081a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:58.401450 8252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b148494d87264cb0945cf9bab78d081a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:12:58.409050 8885 tablet_bootstrap.cc:492] T b148494d87264cb0945cf9bab78d081a P 215bcf09b27c4d179240c4a0f3874385: Bootstrap starting.
I20260811 17:12:58.410746 8890 tablet_bootstrap.cc:492] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216: Bootstrap starting.
I20260811 17:12:58.411628 8885 tablet_bootstrap.cc:654] T b148494d87264cb0945cf9bab78d081a P 215bcf09b27c4d179240c4a0f3874385: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:58.412698 8885 log.cc:824] T b148494d87264cb0945cf9bab78d081a P 215bcf09b27c4d179240c4a0f3874385: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:58.413311 8890 tablet_bootstrap.cc:654] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:58.414242 8890 log.cc:824] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:58.414106 8893 tablet_bootstrap.cc:492] T b148494d87264cb0945cf9bab78d081a P 8f57d089100740c59e22344a3c0e58db: Bootstrap starting.
I20260811 17:12:58.416605 8890 tablet_bootstrap.cc:492] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216: No bootstrap required, opened a new log
I20260811 17:12:58.416616 8893 tablet_bootstrap.cc:654] T b148494d87264cb0945cf9bab78d081a P 8f57d089100740c59e22344a3c0e58db: Neither blocks nor log segments found. Creating new log.
I20260811 17:12:58.416842 8890 ts_tablet_manager.cc:1397] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 17:12:58.417497 8893 log.cc:824] T b148494d87264cb0945cf9bab78d081a P 8f57d089100740c59e22344a3c0e58db: Log is configured to *not* fsync() on all Append() calls
I20260811 17:12:58.417951 8885 tablet_bootstrap.cc:492] T b148494d87264cb0945cf9bab78d081a P 215bcf09b27c4d179240c4a0f3874385: No bootstrap required, opened a new log
I20260811 17:12:58.418192 8885 ts_tablet_manager.cc:1397] T b148494d87264cb0945cf9bab78d081a P 215bcf09b27c4d179240c4a0f3874385: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260811 17:12:58.419817 8893 tablet_bootstrap.cc:492] T b148494d87264cb0945cf9bab78d081a P 8f57d089100740c59e22344a3c0e58db: No bootstrap required, opened a new log
I20260811 17:12:58.420014 8893 ts_tablet_manager.cc:1397] T b148494d87264cb0945cf9bab78d081a P 8f57d089100740c59e22344a3c0e58db: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 17:12:58.420775 8890 raft_consensus.cc:348] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a6c8ff8ec55471b92eac5fef011b216" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 37235 } } peers { permanent_uuid: "215bcf09b27c4d179240c4a0f3874385" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 36785 } } peers { permanent_uuid: "8f57d089100740c59e22344a3c0e58db" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41085 } }
I20260811 17:12:58.421147 8890 raft_consensus.cc:374] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:58.421208 8890 raft_consensus.cc:729] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a6c8ff8ec55471b92eac5fef011b216, State: Initialized, Role: FOLLOWER
I20260811 17:12:58.421746 8890 consensus_queue.cc:260] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a6c8ff8ec55471b92eac5fef011b216" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 37235 } } peers { permanent_uuid: "215bcf09b27c4d179240c4a0f3874385" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 36785 } } peers { permanent_uuid: "8f57d089100740c59e22344a3c0e58db" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41085 } }
I20260811 17:12:58.422497 8369 heartbeater.cc:503] Master 127.4.146.254:32905 was elected leader, sending a full tablet report...
I20260811 17:12:58.422900 8890 ts_tablet_manager.cc:1428] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 17:12:58.422760 8885 raft_consensus.cc:348] T b148494d87264cb0945cf9bab78d081a P 215bcf09b27c4d179240c4a0f3874385 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a6c8ff8ec55471b92eac5fef011b216" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 37235 } } peers { permanent_uuid: "215bcf09b27c4d179240c4a0f3874385" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 36785 } } peers { permanent_uuid: "8f57d089100740c59e22344a3c0e58db" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41085 } }
I20260811 17:12:58.423027 8885 raft_consensus.cc:374] T b148494d87264cb0945cf9bab78d081a P 215bcf09b27c4d179240c4a0f3874385 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:58.423077 8885 raft_consensus.cc:729] T b148494d87264cb0945cf9bab78d081a P 215bcf09b27c4d179240c4a0f3874385 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 215bcf09b27c4d179240c4a0f3874385, State: Initialized, Role: FOLLOWER
I20260811 17:12:58.423595 8885 consensus_queue.cc:260] T b148494d87264cb0945cf9bab78d081a P 215bcf09b27c4d179240c4a0f3874385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a6c8ff8ec55471b92eac5fef011b216" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 37235 } } peers { permanent_uuid: "215bcf09b27c4d179240c4a0f3874385" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 36785 } } peers { permanent_uuid: "8f57d089100740c59e22344a3c0e58db" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41085 } }
I20260811 17:12:58.424376 8849 heartbeater.cc:503] Master 127.4.146.254:32905 was elected leader, sending a full tablet report...
I20260811 17:12:58.424727 8885 ts_tablet_manager.cc:1428] T b148494d87264cb0945cf9bab78d081a P 215bcf09b27c4d179240c4a0f3874385: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260811 17:12:58.424984 8893 raft_consensus.cc:348] T b148494d87264cb0945cf9bab78d081a P 8f57d089100740c59e22344a3c0e58db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a6c8ff8ec55471b92eac5fef011b216" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 37235 } } peers { permanent_uuid: "215bcf09b27c4d179240c4a0f3874385" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 36785 } } peers { permanent_uuid: "8f57d089100740c59e22344a3c0e58db" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41085 } }
I20260811 17:12:58.425190 8893 raft_consensus.cc:374] T b148494d87264cb0945cf9bab78d081a P 8f57d089100740c59e22344a3c0e58db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:12:58.425222 8893 raft_consensus.cc:729] T b148494d87264cb0945cf9bab78d081a P 8f57d089100740c59e22344a3c0e58db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f57d089100740c59e22344a3c0e58db, State: Initialized, Role: FOLLOWER
I20260811 17:12:58.425724 8893 consensus_queue.cc:260] T b148494d87264cb0945cf9bab78d081a P 8f57d089100740c59e22344a3c0e58db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a6c8ff8ec55471b92eac5fef011b216" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 37235 } } peers { permanent_uuid: "215bcf09b27c4d179240c4a0f3874385" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 36785 } } peers { permanent_uuid: "8f57d089100740c59e22344a3c0e58db" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41085 } }
I20260811 17:12:58.426862 8893 ts_tablet_manager.cc:1428] T b148494d87264cb0945cf9bab78d081a P 8f57d089100740c59e22344a3c0e58db: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260811 17:12:58.427275 8585 heartbeater.cc:503] Master 127.4.146.254:32905 was elected leader, sending a full tablet report...
I20260811 17:12:58.464893 8902 raft_consensus.cc:482] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 17:12:58.465147 8902 raft_consensus.cc:504] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a6c8ff8ec55471b92eac5fef011b216" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 37235 } } peers { permanent_uuid: "215bcf09b27c4d179240c4a0f3874385" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 36785 } } peers { permanent_uuid: "8f57d089100740c59e22344a3c0e58db" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41085 } }
I20260811 17:12:58.466409 8902 leader_election.cc:288] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 215bcf09b27c4d179240c4a0f3874385 (127.4.146.195:36785), 8f57d089100740c59e22344a3c0e58db (127.4.146.194:41085)
I20260811 17:12:58.471194 8884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:58.466759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:40797 (local address 127.4.146.195:36785)
0811 17:12:58.466920 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:58.466928 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:58.467090 (+ 162us) server_negotiation.cc:407] Connection header received
0811 17:12:58.467272 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:58.467280 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:58.467326 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:58.467414 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:58.467737 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.468348 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.469795 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.470430 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.470577 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:58.470633 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:58.470920 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 17:12:58.471020 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 17:12:58.471228 8911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:58.466719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.194:41085 (local address 127.4.146.193:60813)
0811 17:12:58.467128 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:58.467142 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:58.467258 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:58.467539 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:58.467542 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:58.467558 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:58.467688 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:58.467694 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.468604 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.468611 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:58.469759 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:58.469772 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.470746 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.470749 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:58.470883 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:58.470915 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 17:12:58.470995 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 17:12:58.471061 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"mutex_wait_us":87,"thread_start_us":145,"threads_started":1}
I20260811 17:12:58.471248 8879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:58.467040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.4.146.193:60813 (local address 127.4.146.194:41085)
0811 17:12:58.467176 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:58.467183 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:58.467200 (+ 17us) server_negotiation.cc:407] Connection header received
0811 17:12:58.467392 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:58.467395 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:58.467439 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:58.467528 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 17:12:58.467807 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.468463 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.469907 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.470511 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.470613 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:58.470658 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:58.471042 (+ 384us) server_negotiation.cc:299] Negotiation successful
0811 17:12:58.471135 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 17:12:58.471243 8910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:58.466627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.195:36785 (local address 127.4.146.193:40797)
0811 17:12:58.466985 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:58.467005 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 17:12:58.467136 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:12:58.467426 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:12:58.467428 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:12:58.467445 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 17:12:58.467590 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:58.467596 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.468467 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.468471 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:58.469646 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:12:58.469657 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.470600 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.470605 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:12:58.470712 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:58.470755 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 17:12:58.470900 (+ 145us) client_negotiation.cc:240] Negotiation successful
0811 17:12:58.471055 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":48,"thread_start_us":147,"threads_started":1}
I20260811 17:12:58.472234 8522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b148494d87264cb0945cf9bab78d081a" candidate_uuid: "1a6c8ff8ec55471b92eac5fef011b216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f57d089100740c59e22344a3c0e58db" is_pre_election: true
I20260811 17:12:58.472230 8762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b148494d87264cb0945cf9bab78d081a" candidate_uuid: "1a6c8ff8ec55471b92eac5fef011b216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215bcf09b27c4d179240c4a0f3874385" is_pre_election: true
I20260811 17:12:58.472608 8762 raft_consensus.cc:2454] T b148494d87264cb0945cf9bab78d081a P 215bcf09b27c4d179240c4a0f3874385 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a6c8ff8ec55471b92eac5fef011b216 in term 0.
I20260811 17:12:58.472608 8522 raft_consensus.cc:2454] T b148494d87264cb0945cf9bab78d081a P 8f57d089100740c59e22344a3c0e58db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1a6c8ff8ec55471b92eac5fef011b216 in term 0.
I20260811 17:12:58.473176 8170 leader_election.cc:302] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a6c8ff8ec55471b92eac5fef011b216, 215bcf09b27c4d179240c4a0f3874385; no voters:
I20260811 17:12:58.473466 8902 raft_consensus.cc:2781] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 17:12:58.473573 8902 raft_consensus.cc:482] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 17:12:58.473634 8902 raft_consensus.cc:3037] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:58.474820 8902 raft_consensus.cc:504] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a6c8ff8ec55471b92eac5fef011b216" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 37235 } } peers { permanent_uuid: "215bcf09b27c4d179240c4a0f3874385" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 36785 } } peers { permanent_uuid: "8f57d089100740c59e22344a3c0e58db" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41085 } }
I20260811 17:12:58.475253 8902 leader_election.cc:288] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216 [CANDIDATE]: Term 1 election: Requested vote from peers 215bcf09b27c4d179240c4a0f3874385 (127.4.146.195:36785), 8f57d089100740c59e22344a3c0e58db (127.4.146.194:41085)
I20260811 17:12:58.475620 8762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b148494d87264cb0945cf9bab78d081a" candidate_uuid: "1a6c8ff8ec55471b92eac5fef011b216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "215bcf09b27c4d179240c4a0f3874385"
I20260811 17:12:58.475787 8762 raft_consensus.cc:3037] T b148494d87264cb0945cf9bab78d081a P 215bcf09b27c4d179240c4a0f3874385 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:58.475886 8522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b148494d87264cb0945cf9bab78d081a" candidate_uuid: "1a6c8ff8ec55471b92eac5fef011b216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f57d089100740c59e22344a3c0e58db"
I20260811 17:12:58.476020 8522 raft_consensus.cc:3037] T b148494d87264cb0945cf9bab78d081a P 8f57d089100740c59e22344a3c0e58db [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:12:58.477421 8522 raft_consensus.cc:2454] T b148494d87264cb0945cf9bab78d081a P 8f57d089100740c59e22344a3c0e58db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a6c8ff8ec55471b92eac5fef011b216 in term 1.
I20260811 17:12:58.477421 8762 raft_consensus.cc:2454] T b148494d87264cb0945cf9bab78d081a P 215bcf09b27c4d179240c4a0f3874385 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1a6c8ff8ec55471b92eac5fef011b216 in term 1.
I20260811 17:12:58.477813 8170 leader_election.cc:302] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a6c8ff8ec55471b92eac5fef011b216, 215bcf09b27c4d179240c4a0f3874385; no voters:
I20260811 17:12:58.478075 8902 raft_consensus.cc:2781] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:12:58.478328 8902 raft_consensus.cc:686] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216 [term 1 LEADER]: Becoming Leader. State: Replica: 1a6c8ff8ec55471b92eac5fef011b216, State: Running, Role: LEADER
I20260811 17:12:58.478703 8902 consensus_queue.cc:237] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a6c8ff8ec55471b92eac5fef011b216" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 37235 } } peers { permanent_uuid: "215bcf09b27c4d179240c4a0f3874385" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 36785 } } peers { permanent_uuid: "8f57d089100740c59e22344a3c0e58db" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41085 } }
I20260811 17:12:58.482586 8029 catalog_manager.cc:5495] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1a6c8ff8ec55471b92eac5fef011b216 (127.4.146.193). New cstate: current_term: 1 leader_uuid: "1a6c8ff8ec55471b92eac5fef011b216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1a6c8ff8ec55471b92eac5fef011b216" member_type: VOTER last_known_addr { host: "127.4.146.193" port: 37235 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "215bcf09b27c4d179240c4a0f3874385" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 36785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8f57d089100740c59e22344a3c0e58db" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41085 } health_report { overall_health: UNKNOWN } } }
I20260811 17:12:58.498795 8876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:58.494998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58172 (local address 127.4.146.193:37235)
0811 17:12:58.495165 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 17:12:58.495170 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:12:58.495186 (+ 16us) server_negotiation.cc:407] Connection header received
0811 17:12:58.495402 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:12:58.495405 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:12:58.495472 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:12:58.495583 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:12:58.495817 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.496451 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.497425 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:12:58.497652 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:12:58.497735 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:12:58.498033 (+ 298us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:12:58.498469 (+ 436us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:12:58.498566 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 17:12:58.498625 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 17:12:58.498677 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 17:12:58.505323 8522 raft_consensus.cc:1261] T b148494d87264cb0945cf9bab78d081a P 8f57d089100740c59e22344a3c0e58db [term 1 FOLLOWER]: Refusing update from remote peer 1a6c8ff8ec55471b92eac5fef011b216: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:12:58.505323 8762 raft_consensus.cc:1261] T b148494d87264cb0945cf9bab78d081a P 215bcf09b27c4d179240c4a0f3874385 [term 1 FOLLOWER]: Refusing update from remote peer 1a6c8ff8ec55471b92eac5fef011b216: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:12:58.506129 8912 consensus_queue.cc:1035] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f57d089100740c59e22344a3c0e58db" member_type: VOTER last_known_addr { host: "127.4.146.194" port: 41085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:12:58.506346 8902 consensus_queue.cc:1035] T b148494d87264cb0945cf9bab78d081a P 1a6c8ff8ec55471b92eac5fef011b216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "215bcf09b27c4d179240c4a0f3874385" member_type: VOTER last_known_addr { host: "127.4.146.195" port: 36785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:12:58.513193 8918 mvcc.cc:205] Tried to move back new op lower bound from 7317374478349713408 to 7317374478252072960. Current Snapshot: MvccSnapshot[applied={T|T < 7317374478349713408}]
I20260811 17:12:58.514942 8920 mvcc.cc:205] Tried to move back new op lower bound from 7317374478349713408 to 7317374478252072960. Current Snapshot: MvccSnapshot[applied={T|T < 7317374478349713408}]
I20260811 17:12:58.518224 8923 mvcc.cc:205] Tried to move back new op lower bound from 7317374478349713408 to 7317374478252072960. Current Snapshot: MvccSnapshot[applied={T|T < 7317374478349713408}]
I20260811 17:12:58.525718 8030 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38696:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:12:58.526043 8030 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38696:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 17:12:58.529002 8030 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 69cdf20f795b4dc88e9173782695df32: Sending DeleteTablet for 3 replicas of tablet b148494d87264cb0945cf9bab78d081a
I20260811 17:12:58.530004 8731 tablet_service.cc:1514] Processing DeleteTablet for tablet b148494d87264cb0945cf9bab78d081a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:12:58 UTC) from {username='slave'} at 127.0.0.1:37232
I20260811 17:12:58.530009 8487 tablet_service.cc:1514] Processing DeleteTablet for tablet b148494d87264cb0945cf9bab78d081a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:12:58 UTC) from {username='slave'} at 127.0.0.1:37946
I20260811 17:12:58.530009 8252 tablet_service.cc:1514] Processing DeleteTablet for tablet b148494d87264cb0945cf9bab78d081a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 17:12:58 UTC) from {username='slave'} at 127.0.0.1:58166
I20260811 17:12:58.530633 8941 tablet_replica.cc:330] T b148494d87264cb0945cf9bab78d081a P 8f57d089100740c59e22344a3c0e58db: stopping tablet replica
I20260811 17:12:58.530994 8941 raft_consensus.cc:2229] T b148494d87264cb0945cf9bab78d081a P 8f57d089100740c59e22344a3c0e58db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:12:58.531335 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 8131
I20260811 17:12:58.531407 8941 raft_consensus.cc:2258] T b148494d87264cb0945cf9bab78d081a P 8f57d089100740c59e22344a3c0e58db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:12:58.534657 8940 tablet_replica.cc:330] T b148494d87264cb0945cf9bab78d081a P 215bcf09b27c4d179240c4a0f3874385: stopping tablet replica
I20260811 17:12:58.535096 8940 raft_consensus.cc:2229] T b148494d87264cb0945cf9bab78d081a P 215bcf09b27c4d179240c4a0f3874385 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 17:12:58.535463 8940 raft_consensus.cc:2258] T b148494d87264cb0945cf9bab78d081a P 215bcf09b27c4d179240c4a0f3874385 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 17:12:58.548024 8941 ts_tablet_manager.cc:1905] T b148494d87264cb0945cf9bab78d081a P 8f57d089100740c59e22344a3c0e58db: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:12:58.551996 8941 ts_tablet_manager.cc:1918] T b148494d87264cb0945cf9bab78d081a P 8f57d089100740c59e22344a3c0e58db: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:12:58.552153 8941 log.cc:1196] T b148494d87264cb0945cf9bab78d081a P 8f57d089100740c59e22344a3c0e58db: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-1/wal/wals/b148494d87264cb0945cf9bab78d081a
I20260811 17:12:58.552470 8941 ts_tablet_manager.cc:1939] T b148494d87264cb0945cf9bab78d081a P 8f57d089100740c59e22344a3c0e58db: Deleting consensus metadata
I20260811 17:12:58.554339 7999 catalog_manager.cc:4841] TS 8f57d089100740c59e22344a3c0e58db (127.4.146.194:41085): tablet b148494d87264cb0945cf9bab78d081a (table test-table [id=7848d7532e914a6387fe2622588276f7]) successfully deleted
I20260811 17:12:58.556304 8940 ts_tablet_manager.cc:1905] T b148494d87264cb0945cf9bab78d081a P 215bcf09b27c4d179240c4a0f3874385: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 17:12:58.559341 8940 ts_tablet_manager.cc:1918] T b148494d87264cb0945cf9bab78d081a P 215bcf09b27c4d179240c4a0f3874385: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 17:12:58.559495 8940 log.cc:1196] T b148494d87264cb0945cf9bab78d081a P 215bcf09b27c4d179240c4a0f3874385: Deleting WAL directory at /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786468091870818-4683-0/minicluster-data/ts-2/wal/wals/b148494d87264cb0945cf9bab78d081a
I20260811 17:12:58.559847 8940 ts_tablet_manager.cc:1939] T b148494d87264cb0945cf9bab78d081a P 215bcf09b27c4d179240c4a0f3874385: Deleting consensus metadata
I20260811 17:12:58.561334 8006 catalog_manager.cc:4841] TS 215bcf09b27c4d179240c4a0f3874385 (127.4.146.195:36785): tablet b148494d87264cb0945cf9bab78d081a (table test-table [id=7848d7532e914a6387fe2622588276f7]) successfully deleted
W20260811 17:12:58.562356 8010 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.4.146.193:37235 (error 108)
I20260811 17:12:58.563311 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 8374
I20260811 17:12:58.563530 8873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:12:58.563192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.193:37235 (local address 127.0.0.1:58184)
0811 17:12:58.563331 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 17:12:58.563409 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.193:37235: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 17:12:58.577105 8010 catalog_manager.cc:4584] TS 1a6c8ff8ec55471b92eac5fef011b216 (127.4.146.193:37235): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b148494d87264cb0945cf9bab78d081a: Network error: Client connection negotiation failed: client connection to 127.4.146.193:37235: connect: Connection refused (error 111)
I20260811 17:12:58.583906 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 8590
I20260811 17:12:58.601156 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 7967
2026-08-11T17:12:58Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1211 ms)
[----------] 6 tests from EncryptionPolicyTest (12383 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:12:58 dist-test-slave-7vjv krb5kdc[8951](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:12:58 dist-test-slave-7vjv krb5kdc[8951](info): set up 2 sockets
Aug 11 17:12:58 dist-test-slave-7vjv krb5kdc[8951](info): commencing operation
krb5kdc: starting...
W20260811 17:12:59.981271 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.342s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:13:00 dist-test-slave-7vjv krb5kdc[8951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468380, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:13:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:13:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 17:13:00.141171 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37173
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46665
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37173
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:13:00.286834 8979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:13:00.287210 8979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:13:00.287309 8979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:13:00.291675 8979 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:13:00.291808 8979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:13:00.291846 8979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:13:00.291888 8979 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:13:00.291926 8979 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:13:00.298535 8979 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46665
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37173
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37173
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8979
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:13:00.300258 8979 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:13:00.302237 8979 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:13:00.312819 8985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:00.312788 8986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:00.312852 8979 server_base.cc:1034] running on GCE node
W20260811 17:13:00.312791 8992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:00.313874 8979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:13:00.315263 8979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:13:00.316480 8979 hybrid_clock.cc:648] HybridClock initialized: now 1786468380316450 us; error 43 us; skew 500 ppm
Aug 11 17:13:00 dist-test-slave-7vjv krb5kdc[8951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468380, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:13:00.319959 8979 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 17:13:00.321178 8979 webserver.cc:460] Webserver started at http://127.0.0.1:44613/ using document root <none> and password file <none>
I20260811 17:13:00.321802 8979 fs_manager.cc:359] Metadata directory not provided
I20260811 17:13:00.321878 8979 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:13:00.322074 8979 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:13:00.324502 8979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "749e7b99d1994ef7a8a160c045b6bb2f"
format_stamp: "Formatted at 2026-08-11 17:13:00 on dist-test-slave-7vjv"
server_key: "f1b395c66d6cc03047be65253926f2c5"
server_key_iv: "59e18b0cee26e5ea501e4d30512f3f13"
server_key_version: "encryptionkey@0"
I20260811 17:13:00.325105 8979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "749e7b99d1994ef7a8a160c045b6bb2f"
format_stamp: "Formatted at 2026-08-11 17:13:00 on dist-test-slave-7vjv"
server_key: "f1b395c66d6cc03047be65253926f2c5"
server_key_iv: "59e18b0cee26e5ea501e4d30512f3f13"
server_key_version: "encryptionkey@0"
I20260811 17:13:00.329602 8979 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 17:13:00.333256 9005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:13:00.334822 8979 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 17:13:00.334980 8979 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "749e7b99d1994ef7a8a160c045b6bb2f"
format_stamp: "Formatted at 2026-08-11 17:13:00 on dist-test-slave-7vjv"
server_key: "f1b395c66d6cc03047be65253926f2c5"
server_key_iv: "59e18b0cee26e5ea501e4d30512f3f13"
server_key_version: "encryptionkey@0"
I20260811 17:13:00.335258 8979 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:13:00.350754 8979 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:13:00.354460 8979 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:13:00.354645 8979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:13:00.362979 8979 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37173
I20260811 17:13:00.363016 9113 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37173 every 8 connection(s)
I20260811 17:13:00.364074 8979 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:13:00.366264 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 8979
I20260811 17:13:00.366425 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:13:00.366741 4683 external_mini_cluster.cc:1428] Setting key db99bfec4746ea1a6d944f0f130cd8ef
I20260811 17:13:00.367652 9116 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:13:00.375211 9116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 749e7b99d1994ef7a8a160c045b6bb2f: Bootstrap starting.
Aug 11 17:13:00 dist-test-slave-7vjv krb5kdc[8951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468380, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 17:13:00.378259 9116 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 749e7b99d1994ef7a8a160c045b6bb2f: Neither blocks nor log segments found. Creating new log.
I20260811 17:13:00.379098 9116 log.cc:824] T 00000000000000000000000000000000 P 749e7b99d1994ef7a8a160c045b6bb2f: Log is configured to *not* fsync() on all Append() calls
I20260811 17:13:00.381709 9116 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 749e7b99d1994ef7a8a160c045b6bb2f: No bootstrap required, opened a new log
I20260811 17:13:00.383921 9120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:00.368355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42787 (local address 127.0.0.1:37173)
0811 17:13:00.368816 (+ 461us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:00.368844 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:00.368885 (+ 41us) server_negotiation.cc:407] Connection header received
0811 17:13:00.369596 (+ 711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:00.369615 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:00.369987 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:00.370303 (+ 316us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:00.371410 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:00.372683 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:00.373965 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:00.374539 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:00.374698 (+ 159us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:00.377981 (+ 3283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:00.377987 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:00.378002 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:00.378035 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:00.380329 (+ 2294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:00.381127 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:00.381134 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:00.381141 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:00.381303 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:00.381717 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:00.381720 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:00.381721 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:00.382231 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:00.382472 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:00.382869 (+ 397us) server_negotiation.cc:299] Negotiation successful
0811 17:13:00.383120 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":162,"threads_started":1}
I20260811 17:13:00.385931 9116 raft_consensus.cc:348] T 00000000000000000000000000000000 P 749e7b99d1994ef7a8a160c045b6bb2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "749e7b99d1994ef7a8a160c045b6bb2f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37173 } }
I20260811 17:13:00.386271 9116 raft_consensus.cc:374] T 00000000000000000000000000000000 P 749e7b99d1994ef7a8a160c045b6bb2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:13:00.386387 9116 raft_consensus.cc:729] T 00000000000000000000000000000000 P 749e7b99d1994ef7a8a160c045b6bb2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 749e7b99d1994ef7a8a160c045b6bb2f, State: Initialized, Role: FOLLOWER
I20260811 17:13:00.386898 9116 consensus_queue.cc:260] T 00000000000000000000000000000000 P 749e7b99d1994ef7a8a160c045b6bb2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "749e7b99d1994ef7a8a160c045b6bb2f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37173 } }
I20260811 17:13:00.387120 9116 raft_consensus.cc:388] T 00000000000000000000000000000000 P 749e7b99d1994ef7a8a160c045b6bb2f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:13:00.387202 9116 raft_consensus.cc:482] T 00000000000000000000000000000000 P 749e7b99d1994ef7a8a160c045b6bb2f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:13:00.387332 9116 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 749e7b99d1994ef7a8a160c045b6bb2f [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:13:00.387414 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:13:00.388593 9116 raft_consensus.cc:504] T 00000000000000000000000000000000 P 749e7b99d1994ef7a8a160c045b6bb2f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "749e7b99d1994ef7a8a160c045b6bb2f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37173 } }
I20260811 17:13:00.389014 9116 leader_election.cc:302] T 00000000000000000000000000000000 P 749e7b99d1994ef7a8a160c045b6bb2f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 749e7b99d1994ef7a8a160c045b6bb2f; no voters:
I20260811 17:13:00.389402 9116 leader_election.cc:288] T 00000000000000000000000000000000 P 749e7b99d1994ef7a8a160c045b6bb2f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:13:00.389492 9133 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 749e7b99d1994ef7a8a160c045b6bb2f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:13:00.389719 9133 raft_consensus.cc:686] T 00000000000000000000000000000000 P 749e7b99d1994ef7a8a160c045b6bb2f [term 1 LEADER]: Becoming Leader. State: Replica: 749e7b99d1994ef7a8a160c045b6bb2f, State: Running, Role: LEADER
I20260811 17:13:00.390053 9133 consensus_queue.cc:237] T 00000000000000000000000000000000 P 749e7b99d1994ef7a8a160c045b6bb2f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "749e7b99d1994ef7a8a160c045b6bb2f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37173 } }
I20260811 17:13:00.390905 9116 sys_catalog.cc:564] T 00000000000000000000000000000000 P 749e7b99d1994ef7a8a160c045b6bb2f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:13:00.392225 9135 sys_catalog.cc:455] T 00000000000000000000000000000000 P 749e7b99d1994ef7a8a160c045b6bb2f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "749e7b99d1994ef7a8a160c045b6bb2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "749e7b99d1994ef7a8a160c045b6bb2f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37173 } } }
I20260811 17:13:00.392386 9135 sys_catalog.cc:458] T 00000000000000000000000000000000 P 749e7b99d1994ef7a8a160c045b6bb2f [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:00.392731 9134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 749e7b99d1994ef7a8a160c045b6bb2f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 749e7b99d1994ef7a8a160c045b6bb2f. Latest consensus state: current_term: 1 leader_uuid: "749e7b99d1994ef7a8a160c045b6bb2f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "749e7b99d1994ef7a8a160c045b6bb2f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37173 } } }
I20260811 17:13:00.392870 9134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 749e7b99d1994ef7a8a160c045b6bb2f [sys.catalog]: This master's current role is: LEADER
W20260811 17:13:00.397015 9161 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 749e7b99d1994ef7a8a160c045b6bb2f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 17:13:00.397154 9161 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 17:13:00.397284 9151 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:13:00.398090 9151 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:13:00.400520 9120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:00.390247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51907 (local address 127.0.0.1:37173)
0811 17:13:00.390383 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:00.390389 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:00.390443 (+ 54us) server_negotiation.cc:407] Connection header received
0811 17:13:00.390685 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:00.390688 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:00.390742 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:00.390828 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:00.391693 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:00.392490 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:00.393630 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:00.394031 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:00.394137 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:00.395867 (+ 1730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:00.395872 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:00.395877 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:00.395911 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:00.397779 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:00.398421 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:00.398424 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:00.398426 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:00.398534 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:00.398961 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:00.398965 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:00.398966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:00.399210 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:00.399361 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:00.400299 (+ 938us) server_negotiation.cc:299] Negotiation successful
0811 17:13:00.400399 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 17:13:00.405068 9151 catalog_manager.cc:1347] Generated new cluster ID: c847dc7e6e894d0da5d324e9e6a16c8b
I20260811 17:13:00.405174 9151 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:13:00.435164 9151 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:13:00.436383 9151 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:13:00.449291 9151 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 749e7b99d1994ef7a8a160c045b6bb2f: Generated new TSK 0
I20260811 17:13:00.450270 9151 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:13:00.463351 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 8979
W20260811 17:13:00.475797 8947 connection.cc:535] client connection to 127.0.0.1:37173 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37173): Connection reset by peer (error 104)
2026-08-11T17:13:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1852 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:13:00 dist-test-slave-7vjv krb5kdc[9174](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:13:00 dist-test-slave-7vjv krb5kdc[9174](info): set up 2 sockets
Aug 11 17:13:00 dist-test-slave-7vjv krb5kdc[9174](info): commencing operation
krb5kdc: starting...
W20260811 17:13:01.828985 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.338s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:13:01 dist-test-slave-7vjv krb5kdc[9174](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468381, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:13:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:13:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 17:13:01.988603 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42261
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39497
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42261
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:13:02.119854 9193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:13:02.120309 9193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:13:02.120405 9193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:13:02.124902 9193 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:13:02.125065 9193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:13:02.125109 9193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:13:02.125149 9193 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:13:02.125185 9193 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:13:02.131150 9193 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39497
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42261
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42261
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9193
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:13:02.132737 9193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:13:02.133970 9193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:13:02.143443 9202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:02.143443 9209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:02.143458 9203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:02.143519 9193 server_base.cc:1034] running on GCE node
I20260811 17:13:02.144479 9193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:13:02.145779 9193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:13:02.147019 9193 hybrid_clock.cc:648] HybridClock initialized: now 1786468382146988 us; error 55 us; skew 500 ppm
Aug 11 17:13:02 dist-test-slave-7vjv krb5kdc[9174](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468382, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:13:02.155422 9193 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 17:13:02.156677 9193 webserver.cc:460] Webserver started at http://127.0.0.1:40775/ using document root <none> and password file <none>
I20260811 17:13:02.157323 9193 fs_manager.cc:359] Metadata directory not provided
I20260811 17:13:02.157395 9193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:13:02.157598 9193 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:13:02.160161 9193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "76b86d93c7b04d25b186e50858f4daa0"
format_stamp: "Formatted at 2026-08-11 17:13:02 on dist-test-slave-7vjv"
server_key: "5775b7336c2923985d2b74a3421a24b5"
server_key_iv: "e84bedbed73c30977466fd53028a820f"
server_key_version: "encryptionkey@0"
I20260811 17:13:02.160825 9193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "76b86d93c7b04d25b186e50858f4daa0"
format_stamp: "Formatted at 2026-08-11 17:13:02 on dist-test-slave-7vjv"
server_key: "5775b7336c2923985d2b74a3421a24b5"
server_key_iv: "e84bedbed73c30977466fd53028a820f"
server_key_version: "encryptionkey@0"
I20260811 17:13:02.165341 9193 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 17:13:02.168422 9224 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:13:02.170161 9193 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260811 17:13:02.170329 9193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "76b86d93c7b04d25b186e50858f4daa0"
format_stamp: "Formatted at 2026-08-11 17:13:02 on dist-test-slave-7vjv"
server_key: "5775b7336c2923985d2b74a3421a24b5"
server_key_iv: "e84bedbed73c30977466fd53028a820f"
server_key_version: "encryptionkey@0"
I20260811 17:13:02.170459 9193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:13:02.193024 9193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:13:02.196775 9193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:13:02.196957 9193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:13:02.205217 9193 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42261
I20260811 17:13:02.205243 9312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42261 every 8 connection(s)
I20260811 17:13:02.206300 9193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:13:02.208387 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 9193
I20260811 17:13:02.208582 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:13:02.208987 4683 external_mini_cluster.cc:1428] Setting key 7d5f9d19460309b277015e8968300e9f
I20260811 17:13:02.209528 9313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:13:02.217474 9313 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76b86d93c7b04d25b186e50858f4daa0: Bootstrap starting.
I20260811 17:13:02.220235 9313 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 76b86d93c7b04d25b186e50858f4daa0: Neither blocks nor log segments found. Creating new log.
I20260811 17:13:02.220494 9317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:02.210602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42255 (local address 127.0.0.1:42261)
0811 17:13:02.211240 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:02.211270 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:02.211329 (+ 59us) server_negotiation.cc:407] Connection header received
0811 17:13:02.212272 (+ 943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:02.212300 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:02.212867 (+ 567us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:02.213325 (+ 458us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:02.213832 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:02.214995 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:02.216172 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:02.216779 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:02.217014 (+ 235us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:02.218192 (+ 1178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:02.218199 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:02.218214 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:13:02.218693 (+ 479us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:02.218771 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:13:02.218800 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:02.219001 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:02.219243 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 17:13:02.219424 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":172,"threads_started":1}
I20260811 17:13:02.221161 9313 log.cc:824] T 00000000000000000000000000000000 P 76b86d93c7b04d25b186e50858f4daa0: Log is configured to *not* fsync() on all Append() calls
I20260811 17:13:02.223615 9313 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 76b86d93c7b04d25b186e50858f4daa0: No bootstrap required, opened a new log
I20260811 17:13:02.224377 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:13:02.228735 9313 raft_consensus.cc:348] T 00000000000000000000000000000000 P 76b86d93c7b04d25b186e50858f4daa0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76b86d93c7b04d25b186e50858f4daa0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42261 } }
I20260811 17:13:02.229151 9313 raft_consensus.cc:374] T 00000000000000000000000000000000 P 76b86d93c7b04d25b186e50858f4daa0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:13:02.229229 9313 raft_consensus.cc:729] T 00000000000000000000000000000000 P 76b86d93c7b04d25b186e50858f4daa0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76b86d93c7b04d25b186e50858f4daa0, State: Initialized, Role: FOLLOWER
I20260811 17:13:02.229712 9313 consensus_queue.cc:260] T 00000000000000000000000000000000 P 76b86d93c7b04d25b186e50858f4daa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76b86d93c7b04d25b186e50858f4daa0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42261 } }
I20260811 17:13:02.229895 9313 raft_consensus.cc:388] T 00000000000000000000000000000000 P 76b86d93c7b04d25b186e50858f4daa0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:13:02.229992 9313 raft_consensus.cc:482] T 00000000000000000000000000000000 P 76b86d93c7b04d25b186e50858f4daa0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:13:02.230110 9313 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 76b86d93c7b04d25b186e50858f4daa0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:13:02.231617 9313 raft_consensus.cc:504] T 00000000000000000000000000000000 P 76b86d93c7b04d25b186e50858f4daa0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76b86d93c7b04d25b186e50858f4daa0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42261 } }
I20260811 17:13:02.231927 9317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:02.227069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36731 (local address 127.0.0.1:42261)
0811 17:13:02.227206 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:02.227211 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:02.227286 (+ 75us) server_negotiation.cc:407] Connection header received
0811 17:13:02.227422 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:02.227425 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:02.227485 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:02.227579 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:02.227914 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:02.228834 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:02.229986 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:02.230315 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:02.230435 (+ 120us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:02.231332 (+ 897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:02.231336 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:02.231339 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:13:02.231357 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:02.231395 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:13:02.231414 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:02.231529 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:02.231722 (+ 193us) server_negotiation.cc:299] Negotiation successful
0811 17:13:02.231771 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 17:13:02.232257 9313 leader_election.cc:302] T 00000000000000000000000000000000 P 76b86d93c7b04d25b186e50858f4daa0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 76b86d93c7b04d25b186e50858f4daa0; no voters:
I20260811 17:13:02.232686 9313 leader_election.cc:288] T 00000000000000000000000000000000 P 76b86d93c7b04d25b186e50858f4daa0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:13:02.232772 9335 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 76b86d93c7b04d25b186e50858f4daa0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:13:02.233026 9335 raft_consensus.cc:686] T 00000000000000000000000000000000 P 76b86d93c7b04d25b186e50858f4daa0 [term 1 LEADER]: Becoming Leader. State: Replica: 76b86d93c7b04d25b186e50858f4daa0, State: Running, Role: LEADER
I20260811 17:13:02.233368 9335 consensus_queue.cc:237] T 00000000000000000000000000000000 P 76b86d93c7b04d25b186e50858f4daa0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76b86d93c7b04d25b186e50858f4daa0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42261 } }
I20260811 17:13:02.234239 9313 sys_catalog.cc:564] T 00000000000000000000000000000000 P 76b86d93c7b04d25b186e50858f4daa0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:13:02.235174 9337 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76b86d93c7b04d25b186e50858f4daa0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "76b86d93c7b04d25b186e50858f4daa0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76b86d93c7b04d25b186e50858f4daa0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42261 } } }
I20260811 17:13:02.235332 9337 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76b86d93c7b04d25b186e50858f4daa0 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:02.235702 9338 sys_catalog.cc:455] T 00000000000000000000000000000000 P 76b86d93c7b04d25b186e50858f4daa0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 76b86d93c7b04d25b186e50858f4daa0. Latest consensus state: current_term: 1 leader_uuid: "76b86d93c7b04d25b186e50858f4daa0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "76b86d93c7b04d25b186e50858f4daa0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42261 } } }
I20260811 17:13:02.235812 9338 sys_catalog.cc:458] T 00000000000000000000000000000000 P 76b86d93c7b04d25b186e50858f4daa0 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:02.236171 9349 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:13:02.239809 9349 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:13:02.246433 9349 catalog_manager.cc:1347] Generated new cluster ID: 26928ba626de4c848f27921496a49a60
I20260811 17:13:02.246562 9349 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:13:02.267850 9349 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:13:02.269044 9349 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:13:02.274887 9349 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 76b86d93c7b04d25b186e50858f4daa0: Generated new TSK 0
I20260811 17:13:02.275781 9349 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:13:02.288201 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 9193
W20260811 17:13:02.305962 9166 connection.cc:535] client connection to 127.0.0.1:42261 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42261): Connection reset by peer (error 104)
2026-08-11T17:13:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1829 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:13:02 dist-test-slave-7vjv krb5kdc[9376](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:13:02 dist-test-slave-7vjv krb5kdc[9376](info): set up 2 sockets
Aug 11 17:13:02 dist-test-slave-7vjv krb5kdc[9376](info): commencing operation
krb5kdc: starting...
W20260811 17:13:03.657223 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.336s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:13:03 dist-test-slave-7vjv krb5kdc[9376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468383, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:13:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:13:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 17:13:03.806875 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42167
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42167
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:13:03.927763 9400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:13:03.928169 9400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:13:03.928277 9400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:13:03.932603 9400 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:13:03.932722 9400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:13:03.932763 9400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:13:03.932819 9400 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:13:03.932870 9400 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:13:03.938616 9400 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42167
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42167
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9400
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:13:03.939932 9400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:13:03.941141 9400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:13:03.950706 9406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:03.950677 9412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:03.950755 9409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:03.951275 9400 server_base.cc:1034] running on GCE node
I20260811 17:13:03.951988 9400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:13:03.953258 9400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:13:03.954479 9400 hybrid_clock.cc:648] HybridClock initialized: now 1786468383954446 us; error 50 us; skew 500 ppm
Aug 11 17:13:03 dist-test-slave-7vjv krb5kdc[9376](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468383, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:13:03.957917 9400 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 17:13:03.959043 9400 webserver.cc:460] Webserver started at http://127.0.0.1:37111/ using document root <none> and password file <none>
I20260811 17:13:03.959683 9400 fs_manager.cc:359] Metadata directory not provided
I20260811 17:13:03.959791 9400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:13:03.960057 9400 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:13:03.962280 9400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "e073897ceb0f48d696e98f79bcd2f038"
format_stamp: "Formatted at 2026-08-11 17:13:03 on dist-test-slave-7vjv"
server_key: "01b1a35ee9da833a1925114db689b5a7"
server_key_iv: "8c77df13a81627053b127849af940507"
server_key_version: "encryptionkey@0"
I20260811 17:13:03.962901 9400 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "e073897ceb0f48d696e98f79bcd2f038"
format_stamp: "Formatted at 2026-08-11 17:13:03 on dist-test-slave-7vjv"
server_key: "01b1a35ee9da833a1925114db689b5a7"
server_key_iv: "8c77df13a81627053b127849af940507"
server_key_version: "encryptionkey@0"
I20260811 17:13:03.967465 9400 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260811 17:13:03.970572 9427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:13:03.972153 9400 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:13:03.972340 9400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "e073897ceb0f48d696e98f79bcd2f038"
format_stamp: "Formatted at 2026-08-11 17:13:03 on dist-test-slave-7vjv"
server_key: "01b1a35ee9da833a1925114db689b5a7"
server_key_iv: "8c77df13a81627053b127849af940507"
server_key_version: "encryptionkey@0"
I20260811 17:13:03.972491 9400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:13:03.978276 9400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:13:03.982304 9400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:13:03.982591 9400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:13:03.991618 9400 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42167
I20260811 17:13:03.991648 9523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42167 every 8 connection(s)
I20260811 17:13:03.992736 9400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:13:03.995357 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 9400
I20260811 17:13:03.995530 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:13:03.995882 4683 external_mini_cluster.cc:1428] Setting key 2b9b8974c3f0a910330f3b679ca39f8d
I20260811 17:13:03.996129 9524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:13:04.002271 9528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:03.997551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40439 (local address 127.0.0.1:42167)
0811 17:13:03.998198 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:03.998216 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:03.998260 (+ 44us) server_negotiation.cc:407] Connection header received
0811 17:13:03.999150 (+ 890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:03.999174 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:03.999504 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:03.999856 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:04.000845 (+ 989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:04.000850 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:04.000864 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:13:04.000875 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:04.000949 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:13:04.000971 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:04.001113 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:04.001218 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 17:13:04.001413 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":453,"thread_start_us":202,"threads_started":1}
I20260811 17:13:04.003791 9524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e073897ceb0f48d696e98f79bcd2f038: Bootstrap starting.
I20260811 17:13:04.005715 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:13:04.006731 9524 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e073897ceb0f48d696e98f79bcd2f038: Neither blocks nor log segments found. Creating new log.
I20260811 17:13:04.007738 9524 log.cc:824] T 00000000000000000000000000000000 P e073897ceb0f48d696e98f79bcd2f038: Log is configured to *not* fsync() on all Append() calls
I20260811 17:13:04.010149 9524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e073897ceb0f48d696e98f79bcd2f038: No bootstrap required, opened a new log
I20260811 17:13:04.013749 9528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:04.008419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35705 (local address 127.0.0.1:42167)
0811 17:13:04.008578 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:04.008584 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:04.012181 (+ 3597us) server_negotiation.cc:407] Connection header received
0811 17:13:04.012239 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:04.012242 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:04.012285 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:04.012382 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:04.013318 (+ 936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:04.013324 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:04.013328 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:13:04.013346 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:04.013382 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:13:04.013396 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:04.013500 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:04.013574 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 17:13:04.013617 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 17:13:04.014330 9524 raft_consensus.cc:348] T 00000000000000000000000000000000 P e073897ceb0f48d696e98f79bcd2f038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e073897ceb0f48d696e98f79bcd2f038" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42167 } }
I20260811 17:13:04.014585 9524 raft_consensus.cc:374] T 00000000000000000000000000000000 P e073897ceb0f48d696e98f79bcd2f038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:13:04.014657 9524 raft_consensus.cc:729] T 00000000000000000000000000000000 P e073897ceb0f48d696e98f79bcd2f038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e073897ceb0f48d696e98f79bcd2f038, State: Initialized, Role: FOLLOWER
I20260811 17:13:04.015195 9524 consensus_queue.cc:260] T 00000000000000000000000000000000 P e073897ceb0f48d696e98f79bcd2f038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e073897ceb0f48d696e98f79bcd2f038" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42167 } }
I20260811 17:13:04.015354 9524 raft_consensus.cc:388] T 00000000000000000000000000000000 P e073897ceb0f48d696e98f79bcd2f038 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:13:04.015447 9524 raft_consensus.cc:482] T 00000000000000000000000000000000 P e073897ceb0f48d696e98f79bcd2f038 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:13:04.015576 9524 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e073897ceb0f48d696e98f79bcd2f038 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:13:04.016788 9524 raft_consensus.cc:504] T 00000000000000000000000000000000 P e073897ceb0f48d696e98f79bcd2f038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e073897ceb0f48d696e98f79bcd2f038" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42167 } }
I20260811 17:13:04.017187 9524 leader_election.cc:302] T 00000000000000000000000000000000 P e073897ceb0f48d696e98f79bcd2f038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e073897ceb0f48d696e98f79bcd2f038; no voters:
I20260811 17:13:04.017504 9524 leader_election.cc:288] T 00000000000000000000000000000000 P e073897ceb0f48d696e98f79bcd2f038 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:13:04.017657 9540 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e073897ceb0f48d696e98f79bcd2f038 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:13:04.018039 9540 raft_consensus.cc:686] T 00000000000000000000000000000000 P e073897ceb0f48d696e98f79bcd2f038 [term 1 LEADER]: Becoming Leader. State: Replica: e073897ceb0f48d696e98f79bcd2f038, State: Running, Role: LEADER
I20260811 17:13:04.018383 9540 consensus_queue.cc:237] T 00000000000000000000000000000000 P e073897ceb0f48d696e98f79bcd2f038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e073897ceb0f48d696e98f79bcd2f038" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42167 } }
I20260811 17:13:04.018903 9524 sys_catalog.cc:564] T 00000000000000000000000000000000 P e073897ceb0f48d696e98f79bcd2f038 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:13:04.020198 9545 sys_catalog.cc:455] T 00000000000000000000000000000000 P e073897ceb0f48d696e98f79bcd2f038 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e073897ceb0f48d696e98f79bcd2f038. Latest consensus state: current_term: 1 leader_uuid: "e073897ceb0f48d696e98f79bcd2f038" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e073897ceb0f48d696e98f79bcd2f038" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42167 } } }
I20260811 17:13:04.020337 9545 sys_catalog.cc:458] T 00000000000000000000000000000000 P e073897ceb0f48d696e98f79bcd2f038 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:04.020748 9543 sys_catalog.cc:455] T 00000000000000000000000000000000 P e073897ceb0f48d696e98f79bcd2f038 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e073897ceb0f48d696e98f79bcd2f038" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e073897ceb0f48d696e98f79bcd2f038" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42167 } } }
I20260811 17:13:04.020915 9543 sys_catalog.cc:458] T 00000000000000000000000000000000 P e073897ceb0f48d696e98f79bcd2f038 [sys.catalog]: This master's current role is: LEADER
W20260811 17:13:04.024075 9565 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e073897ceb0f48d696e98f79bcd2f038: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 17:13:04.024375 9565 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 17:13:04.024535 9556 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:13:04.025409 9556 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:13:04.031994 9556 catalog_manager.cc:1347] Generated new cluster ID: 0956b0b16cda47f2a4bc309dbf5cae58
I20260811 17:13:04.032142 9556 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:13:04.048290 9556 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:13:04.048743 9556 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:13:04.062853 9556 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e073897ceb0f48d696e98f79bcd2f038: Generated new TSK 0
I20260811 17:13:04.063787 9556 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:13:04.070355 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 9400
2026-08-11T17:13:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1783 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:13:04 dist-test-slave-7vjv krb5kdc[9580](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:13:04 dist-test-slave-7vjv krb5kdc[9580](info): set up 2 sockets
Aug 11 17:13:04 dist-test-slave-7vjv krb5kdc[9580](info): commencing operation
krb5kdc: starting...
W20260811 17:13:05.453461 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.349s user 0.005s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:13:05 dist-test-slave-7vjv krb5kdc[9580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468385, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:13:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:13:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 17:13:05.600929 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38787
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38787
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:13:05.728653 9605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:13:05.728989 9605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:13:05.729084 9605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:13:05.733309 9605 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:13:05.733424 9605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:13:05.733460 9605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:13:05.733501 9605 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:13:05.733580 9605 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:13:05.739509 9605 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38787
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38787
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9605
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:13:05.740932 9605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:13:05.742053 9605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:13:05.752225 9618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:05.752238 9614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:05.752244 9613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:05.752291 9605 server_base.cc:1034] running on GCE node
I20260811 17:13:05.753140 9605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:13:05.754330 9605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:13:05.755528 9605 hybrid_clock.cc:648] HybridClock initialized: now 1786468385755497 us; error 42 us; skew 500 ppm
Aug 11 17:13:05 dist-test-slave-7vjv krb5kdc[9580](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468385, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:13:05.758577 9605 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 17:13:05.759656 9605 webserver.cc:460] Webserver started at http://127.0.0.1:38239/ using document root <none> and password file <none>
I20260811 17:13:05.760363 9605 fs_manager.cc:359] Metadata directory not provided
I20260811 17:13:05.760474 9605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:13:05.760730 9605 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:13:05.762878 9605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "62796dd14131401ebc13e64fd115995f"
format_stamp: "Formatted at 2026-08-11 17:13:05 on dist-test-slave-7vjv"
server_key: "1745d422b057b1cb6a6ac39d4eec816c"
server_key_iv: "0835d4db4bf094de38640950bbe6a000"
server_key_version: "encryptionkey@0"
I20260811 17:13:05.763471 9605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "62796dd14131401ebc13e64fd115995f"
format_stamp: "Formatted at 2026-08-11 17:13:05 on dist-test-slave-7vjv"
server_key: "1745d422b057b1cb6a6ac39d4eec816c"
server_key_iv: "0835d4db4bf094de38640950bbe6a000"
server_key_version: "encryptionkey@0"
I20260811 17:13:05.767499 9605 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 17:13:05.770567 9629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:13:05.772295 9605 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:13:05.772506 9605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "62796dd14131401ebc13e64fd115995f"
format_stamp: "Formatted at 2026-08-11 17:13:05 on dist-test-slave-7vjv"
server_key: "1745d422b057b1cb6a6ac39d4eec816c"
server_key_iv: "0835d4db4bf094de38640950bbe6a000"
server_key_version: "encryptionkey@0"
I20260811 17:13:05.772665 9605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:13:05.806653 9605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:13:05.810438 9605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:13:05.810685 9605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:13:05.818661 9605 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38787
I20260811 17:13:05.818686 9726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38787 every 8 connection(s)
I20260811 17:13:05.819702 9605 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:13:05.820011 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 9605
I20260811 17:13:05.820206 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:13:05.820585 4683 external_mini_cluster.cc:1428] Setting key 3d6ffe089a7d9be14040e9b764c6ab46
I20260811 17:13:05.823279 9728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:13:05.830193 9728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62796dd14131401ebc13e64fd115995f: Bootstrap starting.
Aug 11 17:13:05 dist-test-slave-7vjv krb5kdc[9580](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468385, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 17:13:05.833189 9728 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62796dd14131401ebc13e64fd115995f: Neither blocks nor log segments found. Creating new log.
I20260811 17:13:05.834148 9728 log.cc:824] T 00000000000000000000000000000000 P 62796dd14131401ebc13e64fd115995f: Log is configured to *not* fsync() on all Append() calls
I20260811 17:13:05.836719 9728 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62796dd14131401ebc13e64fd115995f: No bootstrap required, opened a new log
I20260811 17:13:05.837498 9735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:05.822161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42483 (local address 127.0.0.1:38787)
0811 17:13:05.822614 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:05.822640 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:05.822685 (+ 45us) server_negotiation.cc:407] Connection header received
0811 17:13:05.823576 (+ 891us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:05.823601 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:05.824046 (+ 445us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:05.824452 (+ 406us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:05.825268 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:05.826793 (+ 1525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:05.827729 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:05.828479 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:05.828643 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:05.831623 (+ 2980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:05.831630 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:05.831650 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:05.831686 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:05.833942 (+ 2256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:05.834484 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:05.834490 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:05.834496 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:05.834654 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:05.834993 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:05.834997 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:05.834999 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:05.835558 (+ 559us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:05.835733 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:05.836224 (+ 491us) server_negotiation.cc:299] Negotiation successful
0811 17:13:05.836537 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":130,"threads_started":1}
I20260811 17:13:05.841113 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:13:05.841411 9728 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62796dd14131401ebc13e64fd115995f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62796dd14131401ebc13e64fd115995f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38787 } }
I20260811 17:13:05.841701 9728 raft_consensus.cc:374] T 00000000000000000000000000000000 P 62796dd14131401ebc13e64fd115995f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:13:05.841799 9728 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62796dd14131401ebc13e64fd115995f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62796dd14131401ebc13e64fd115995f, State: Initialized, Role: FOLLOWER
I20260811 17:13:05.842303 9728 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62796dd14131401ebc13e64fd115995f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62796dd14131401ebc13e64fd115995f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38787 } }
I20260811 17:13:05.842465 9728 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62796dd14131401ebc13e64fd115995f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:13:05.842547 9728 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62796dd14131401ebc13e64fd115995f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:13:05.842660 9728 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62796dd14131401ebc13e64fd115995f [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:13:05.843883 9728 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62796dd14131401ebc13e64fd115995f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62796dd14131401ebc13e64fd115995f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38787 } }
I20260811 17:13:05.844333 9728 leader_election.cc:302] T 00000000000000000000000000000000 P 62796dd14131401ebc13e64fd115995f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62796dd14131401ebc13e64fd115995f; no voters:
I20260811 17:13:05.844713 9728 leader_election.cc:288] T 00000000000000000000000000000000 P 62796dd14131401ebc13e64fd115995f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:13:05.844817 9748 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62796dd14131401ebc13e64fd115995f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:13:05.844998 9748 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62796dd14131401ebc13e64fd115995f [term 1 LEADER]: Becoming Leader. State: Replica: 62796dd14131401ebc13e64fd115995f, State: Running, Role: LEADER
I20260811 17:13:05.845400 9748 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62796dd14131401ebc13e64fd115995f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62796dd14131401ebc13e64fd115995f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38787 } }
I20260811 17:13:05.846130 9728 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62796dd14131401ebc13e64fd115995f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:13:05.846726 9748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62796dd14131401ebc13e64fd115995f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62796dd14131401ebc13e64fd115995f. Latest consensus state: current_term: 1 leader_uuid: "62796dd14131401ebc13e64fd115995f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62796dd14131401ebc13e64fd115995f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38787 } } }
I20260811 17:13:05.846910 9748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62796dd14131401ebc13e64fd115995f [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:05.847137 9749 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62796dd14131401ebc13e64fd115995f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "62796dd14131401ebc13e64fd115995f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62796dd14131401ebc13e64fd115995f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38787 } } }
I20260811 17:13:05.847314 9749 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62796dd14131401ebc13e64fd115995f [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:05.847373 9760 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:13:05.851300 9760 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:13:05.853255 9735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:05.843537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39685 (local address 127.0.0.1:38787)
0811 17:13:05.843679 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:05.843686 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:05.843822 (+ 136us) server_negotiation.cc:407] Connection header received
0811 17:13:05.843913 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:05.843916 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:05.843973 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:05.844076 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:05.845105 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:05.845800 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:05.846815 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:05.847230 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:05.847313 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:05.849466 (+ 2153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:05.849471 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:05.849474 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:05.849505 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:05.851376 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:05.851914 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:05.851917 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:05.851920 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:05.852018 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:05.852352 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:05.852355 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:05.852357 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:05.852556 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:05.852698 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:05.852944 (+ 246us) server_negotiation.cc:299] Negotiation successful
0811 17:13:05.853067 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 17:13:05.858174 9760 catalog_manager.cc:1347] Generated new cluster ID: 12cf80a131e2480d8eb772e56b5cb300
I20260811 17:13:05.858268 9760 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:13:05.888666 9760 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:13:05.889724 9760 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:13:05.895422 9760 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 62796dd14131401ebc13e64fd115995f: Generated new TSK 0
I20260811 17:13:05.896389 9760 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:13:05.912619 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 9605
2026-08-11T17:13:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1849 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:13:05 dist-test-slave-7vjv krb5kdc[9782](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:13:05 dist-test-slave-7vjv krb5kdc[9782](info): set up 2 sockets
Aug 11 17:13:05 dist-test-slave-7vjv krb5kdc[9782](info): commencing operation
krb5kdc: starting...
W20260811 17:13:07.256404 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.302s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:13:07 dist-test-slave-7vjv krb5kdc[9782](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468387, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:13:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:13:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 17:13:07.405730 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34829
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34829
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:13:07.534859 9800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:13:07.535286 9800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:13:07.535390 9800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:13:07.540055 9800 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:13:07.540207 9800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:13:07.540247 9800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:13:07.540289 9800 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:13:07.540330 9800 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:13:07.546346 9800 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34829
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34829
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9800
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:13:07.547668 9800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:13:07.548888 9800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:13:07.558657 9806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:07.558671 9808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:07.558658 9805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:07.558880 9800 server_base.cc:1034] running on GCE node
I20260811 17:13:07.559739 9800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:13:07.561110 9800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:13:07.562356 9800 hybrid_clock.cc:648] HybridClock initialized: now 1786468387562335 us; error 40 us; skew 500 ppm
Aug 11 17:13:07 dist-test-slave-7vjv krb5kdc[9782](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468387, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:13:07.571199 9800 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 17:13:07.572485 9800 webserver.cc:460] Webserver started at http://127.0.0.1:39903/ using document root <none> and password file <none>
I20260811 17:13:07.573122 9800 fs_manager.cc:359] Metadata directory not provided
I20260811 17:13:07.573226 9800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:13:07.573484 9800 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:13:07.575723 9800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "818016e1807b4fe0a6896eb29baf2142"
format_stamp: "Formatted at 2026-08-11 17:13:07 on dist-test-slave-7vjv"
server_key: "910baf3c55ebd565c4941819b76dfe15"
server_key_iv: "8cf0d048f1d5b8d95c70728978ff0a4a"
server_key_version: "encryptionkey@0"
I20260811 17:13:07.576377 9800 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "818016e1807b4fe0a6896eb29baf2142"
format_stamp: "Formatted at 2026-08-11 17:13:07 on dist-test-slave-7vjv"
server_key: "910baf3c55ebd565c4941819b76dfe15"
server_key_iv: "8cf0d048f1d5b8d95c70728978ff0a4a"
server_key_version: "encryptionkey@0"
I20260811 17:13:07.580441 9800 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 17:13:07.583029 9827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:13:07.584447 9800 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:13:07.584633 9800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "818016e1807b4fe0a6896eb29baf2142"
format_stamp: "Formatted at 2026-08-11 17:13:07 on dist-test-slave-7vjv"
server_key: "910baf3c55ebd565c4941819b76dfe15"
server_key_iv: "8cf0d048f1d5b8d95c70728978ff0a4a"
server_key_version: "encryptionkey@0"
I20260811 17:13:07.584766 9800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:13:07.610462 9800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:13:07.614181 9800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:13:07.614430 9800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:13:07.623106 9800 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34829
I20260811 17:13:07.623129 9931 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34829 every 8 connection(s)
I20260811 17:13:07.624343 9800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:13:07.625676 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 9800
I20260811 17:13:07.625859 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:13:07.626197 4683 external_mini_cluster.cc:1428] Setting key bb2185167fc1ff4feebe32339d47d43f
I20260811 17:13:07.628482 9932 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:13:07.635047 9932 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 818016e1807b4fe0a6896eb29baf2142: Bootstrap starting.
I20260811 17:13:07.636204 9938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:07.627929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59213 (local address 127.0.0.1:34829)
0811 17:13:07.628479 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:07.628495 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:07.628534 (+ 39us) server_negotiation.cc:407] Connection header received
0811 17:13:07.629298 (+ 764us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:07.629318 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:07.629679 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:07.630037 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:07.630475 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:07.631489 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:07.632524 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:07.633020 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:07.633219 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:07.634257 (+ 1038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:07.634262 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:07.634277 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:13:07.634687 (+ 410us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:07.634748 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:13:07.634771 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:07.634888 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:07.635113 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 17:13:07.635359 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":211,"threads_started":1}
I20260811 17:13:07.637948 9932 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 818016e1807b4fe0a6896eb29baf2142: Neither blocks nor log segments found. Creating new log.
I20260811 17:13:07.638912 9932 log.cc:824] T 00000000000000000000000000000000 P 818016e1807b4fe0a6896eb29baf2142: Log is configured to *not* fsync() on all Append() calls
I20260811 17:13:07.639554 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:13:07.641458 9932 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 818016e1807b4fe0a6896eb29baf2142: No bootstrap required, opened a new log
I20260811 17:13:07.646854 9932 raft_consensus.cc:348] T 00000000000000000000000000000000 P 818016e1807b4fe0a6896eb29baf2142 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "818016e1807b4fe0a6896eb29baf2142" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34829 } }
I20260811 17:13:07.647212 9938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:07.642130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49785 (local address 127.0.0.1:34829)
0811 17:13:07.642284 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:07.642289 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:07.642524 (+ 235us) server_negotiation.cc:407] Connection header received
0811 17:13:07.642697 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:07.642699 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:07.642743 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:07.642810 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:07.643157 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:07.643735 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:07.645223 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:07.645476 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:07.645580 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:07.646577 (+ 997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:07.646580 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:07.646583 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:13:07.646596 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:07.646623 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:13:07.646634 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:07.646702 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:07.646848 (+ 146us) server_negotiation.cc:299] Negotiation successful
0811 17:13:07.646903 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 17:13:07.647223 9932 raft_consensus.cc:374] T 00000000000000000000000000000000 P 818016e1807b4fe0a6896eb29baf2142 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:13:07.647367 9932 raft_consensus.cc:729] T 00000000000000000000000000000000 P 818016e1807b4fe0a6896eb29baf2142 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 818016e1807b4fe0a6896eb29baf2142, State: Initialized, Role: FOLLOWER
I20260811 17:13:07.647922 9932 consensus_queue.cc:260] T 00000000000000000000000000000000 P 818016e1807b4fe0a6896eb29baf2142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "818016e1807b4fe0a6896eb29baf2142" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34829 } }
I20260811 17:13:07.648082 9932 raft_consensus.cc:388] T 00000000000000000000000000000000 P 818016e1807b4fe0a6896eb29baf2142 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:13:07.648234 9932 raft_consensus.cc:482] T 00000000000000000000000000000000 P 818016e1807b4fe0a6896eb29baf2142 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:13:07.648480 9932 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 818016e1807b4fe0a6896eb29baf2142 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:13:07.649597 9932 raft_consensus.cc:504] T 00000000000000000000000000000000 P 818016e1807b4fe0a6896eb29baf2142 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "818016e1807b4fe0a6896eb29baf2142" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34829 } }
I20260811 17:13:07.649986 9932 leader_election.cc:302] T 00000000000000000000000000000000 P 818016e1807b4fe0a6896eb29baf2142 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 818016e1807b4fe0a6896eb29baf2142; no voters:
I20260811 17:13:07.650341 9932 leader_election.cc:288] T 00000000000000000000000000000000 P 818016e1807b4fe0a6896eb29baf2142 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:13:07.650655 9949 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 818016e1807b4fe0a6896eb29baf2142 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:13:07.650887 9949 raft_consensus.cc:686] T 00000000000000000000000000000000 P 818016e1807b4fe0a6896eb29baf2142 [term 1 LEADER]: Becoming Leader. State: Replica: 818016e1807b4fe0a6896eb29baf2142, State: Running, Role: LEADER
I20260811 17:13:07.651250 9949 consensus_queue.cc:237] T 00000000000000000000000000000000 P 818016e1807b4fe0a6896eb29baf2142 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "818016e1807b4fe0a6896eb29baf2142" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34829 } }
I20260811 17:13:07.651859 9932 sys_catalog.cc:564] T 00000000000000000000000000000000 P 818016e1807b4fe0a6896eb29baf2142 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:13:07.653174 9953 sys_catalog.cc:455] T 00000000000000000000000000000000 P 818016e1807b4fe0a6896eb29baf2142 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 818016e1807b4fe0a6896eb29baf2142. Latest consensus state: current_term: 1 leader_uuid: "818016e1807b4fe0a6896eb29baf2142" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "818016e1807b4fe0a6896eb29baf2142" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34829 } } }
I20260811 17:13:07.653317 9953 sys_catalog.cc:458] T 00000000000000000000000000000000 P 818016e1807b4fe0a6896eb29baf2142 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:07.653718 9950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 818016e1807b4fe0a6896eb29baf2142 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "818016e1807b4fe0a6896eb29baf2142" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "818016e1807b4fe0a6896eb29baf2142" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34829 } } }
I20260811 17:13:07.653836 9950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 818016e1807b4fe0a6896eb29baf2142 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:07.653734 9963 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:13:07.657835 9963 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:13:07.664429 9963 catalog_manager.cc:1347] Generated new cluster ID: eb3b344ac69140d3bd4696c866c6a53f
I20260811 17:13:07.664515 9963 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:13:07.691079 9963 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:13:07.692229 9963 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:13:07.702929 9963 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 818016e1807b4fe0a6896eb29baf2142: Generated new TSK 0
I20260811 17:13:07.703837 9963 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:13:07.708583 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 9800
2026-08-11T17:13:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1799 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:13:07 dist-test-slave-7vjv krb5kdc[9982](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:13:07 dist-test-slave-7vjv krb5kdc[9982](info): set up 2 sockets
Aug 11 17:13:07 dist-test-slave-7vjv krb5kdc[9982](info): commencing operation
krb5kdc: starting...
W20260811 17:13:09.063347 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.309s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:13:09 dist-test-slave-7vjv krb5kdc[9982](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468389, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:13:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:13:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 17:13:09.208469 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33731
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33731
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:13:09.329885 10001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:13:09.330288 10001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:13:09.330384 10001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:13:09.334826 10001 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:13:09.334957 10001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:13:09.334997 10001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:13:09.335037 10001 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:13:09.335160 10001 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:13:09.340945 10001 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33731
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33731
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:13:09.342036 10001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:13:09.343047 10001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:13:09.352247 10013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:09.352249 10008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:09.352313 10001 server_base.cc:1034] running on GCE node
W20260811 17:13:09.352313 10016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:09.353294 10001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:13:09.354501 10001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:13:09.355715 10001 hybrid_clock.cc:648] HybridClock initialized: now 1786468389355701 us; error 30 us; skew 500 ppm
Aug 11 17:13:09 dist-test-slave-7vjv krb5kdc[9982](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468389, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:13:09.358911 10001 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 17:13:09.359992 10001 webserver.cc:460] Webserver started at http://127.0.0.1:44331/ using document root <none> and password file <none>
I20260811 17:13:09.360651 10001 fs_manager.cc:359] Metadata directory not provided
I20260811 17:13:09.360757 10001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:13:09.361016 10001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:13:09.363236 10001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "136b1fc9448f45c5a8b58a353574c8c8"
format_stamp: "Formatted at 2026-08-11 17:13:09 on dist-test-slave-7vjv"
server_key: "e0629d5023c33bf814e5a134b4c9e51f"
server_key_iv: "5aa668874f00ac5c79383f64f15a053a"
server_key_version: "encryptionkey@0"
I20260811 17:13:09.363859 10001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "136b1fc9448f45c5a8b58a353574c8c8"
format_stamp: "Formatted at 2026-08-11 17:13:09 on dist-test-slave-7vjv"
server_key: "e0629d5023c33bf814e5a134b4c9e51f"
server_key_iv: "5aa668874f00ac5c79383f64f15a053a"
server_key_version: "encryptionkey@0"
I20260811 17:13:09.368017 10001 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260811 17:13:09.370689 10027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:13:09.372061 10001 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 17:13:09.372298 10001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "136b1fc9448f45c5a8b58a353574c8c8"
format_stamp: "Formatted at 2026-08-11 17:13:09 on dist-test-slave-7vjv"
server_key: "e0629d5023c33bf814e5a134b4c9e51f"
server_key_iv: "5aa668874f00ac5c79383f64f15a053a"
server_key_version: "encryptionkey@0"
I20260811 17:13:09.372433 10001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:13:09.377647 10001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:13:09.381270 10001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:13:09.381502 10001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:13:09.390719 10001 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33731
I20260811 17:13:09.390731 10111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33731 every 8 connection(s)
I20260811 17:13:09.391790 10001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:13:09.394933 10112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:13:09.397502 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 10001
I20260811 17:13:09.397704 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:13:09.397996 4683 external_mini_cluster.cc:1428] Setting key ca48b77a09e911d23ecf8b1e9ee3cf35
I20260811 17:13:09.402031 10112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 136b1fc9448f45c5a8b58a353574c8c8: Bootstrap starting.
I20260811 17:13:09.404496 10119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:09.399522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41445 (local address 127.0.0.1:33731)
0811 17:13:09.400281 (+ 759us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:09.400303 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:09.400377 (+ 74us) server_negotiation.cc:407] Connection header received
0811 17:13:09.401473 (+ 1096us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:09.401499 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:09.401829 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:09.402237 (+ 408us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:09.403154 (+ 917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:09.403159 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:09.403171 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:13:09.403182 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:09.403240 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:13:09.403260 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:09.403420 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:09.403495 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 17:13:09.403666 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":199,"threads_started":1}
I20260811 17:13:09.404795 10112 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 136b1fc9448f45c5a8b58a353574c8c8: Neither blocks nor log segments found. Creating new log.
I20260811 17:13:09.405602 10112 log.cc:824] T 00000000000000000000000000000000 P 136b1fc9448f45c5a8b58a353574c8c8: Log is configured to *not* fsync() on all Append() calls
I20260811 17:13:09.407786 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:13:09.408006 10112 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 136b1fc9448f45c5a8b58a353574c8c8: No bootstrap required, opened a new log
I20260811 17:13:09.412269 10119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:09.410150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38243 (local address 127.0.0.1:33731)
0811 17:13:09.410286 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:09.410291 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:09.410566 (+ 275us) server_negotiation.cc:407] Connection header received
0811 17:13:09.410698 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:09.410701 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:09.410734 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:09.410794 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:09.411684 (+ 890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:09.411687 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:09.411689 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:13:09.411701 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:09.411731 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:13:09.411742 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:09.411832 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:09.411976 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 17:13:09.412056 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 17:13:09.412801 10112 raft_consensus.cc:348] T 00000000000000000000000000000000 P 136b1fc9448f45c5a8b58a353574c8c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "136b1fc9448f45c5a8b58a353574c8c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33731 } }
I20260811 17:13:09.413165 10112 raft_consensus.cc:374] T 00000000000000000000000000000000 P 136b1fc9448f45c5a8b58a353574c8c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:13:09.413234 10112 raft_consensus.cc:729] T 00000000000000000000000000000000 P 136b1fc9448f45c5a8b58a353574c8c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 136b1fc9448f45c5a8b58a353574c8c8, State: Initialized, Role: FOLLOWER
I20260811 17:13:09.413738 10112 consensus_queue.cc:260] T 00000000000000000000000000000000 P 136b1fc9448f45c5a8b58a353574c8c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "136b1fc9448f45c5a8b58a353574c8c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33731 } }
I20260811 17:13:09.413877 10112 raft_consensus.cc:388] T 00000000000000000000000000000000 P 136b1fc9448f45c5a8b58a353574c8c8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:13:09.413920 10112 raft_consensus.cc:482] T 00000000000000000000000000000000 P 136b1fc9448f45c5a8b58a353574c8c8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:13:09.414028 10112 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 136b1fc9448f45c5a8b58a353574c8c8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:13:09.415010 10112 raft_consensus.cc:504] T 00000000000000000000000000000000 P 136b1fc9448f45c5a8b58a353574c8c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "136b1fc9448f45c5a8b58a353574c8c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33731 } }
I20260811 17:13:09.415333 10112 leader_election.cc:302] T 00000000000000000000000000000000 P 136b1fc9448f45c5a8b58a353574c8c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 136b1fc9448f45c5a8b58a353574c8c8; no voters:
I20260811 17:13:09.415630 10112 leader_election.cc:288] T 00000000000000000000000000000000 P 136b1fc9448f45c5a8b58a353574c8c8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:13:09.415825 10134 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 136b1fc9448f45c5a8b58a353574c8c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:13:09.416180 10134 raft_consensus.cc:686] T 00000000000000000000000000000000 P 136b1fc9448f45c5a8b58a353574c8c8 [term 1 LEADER]: Becoming Leader. State: Replica: 136b1fc9448f45c5a8b58a353574c8c8, State: Running, Role: LEADER
I20260811 17:13:09.416563 10134 consensus_queue.cc:237] T 00000000000000000000000000000000 P 136b1fc9448f45c5a8b58a353574c8c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "136b1fc9448f45c5a8b58a353574c8c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33731 } }
I20260811 17:13:09.416939 10112 sys_catalog.cc:564] T 00000000000000000000000000000000 P 136b1fc9448f45c5a8b58a353574c8c8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:13:09.418619 10137 sys_catalog.cc:455] T 00000000000000000000000000000000 P 136b1fc9448f45c5a8b58a353574c8c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "136b1fc9448f45c5a8b58a353574c8c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "136b1fc9448f45c5a8b58a353574c8c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33731 } } }
I20260811 17:13:09.418658 10138 sys_catalog.cc:455] T 00000000000000000000000000000000 P 136b1fc9448f45c5a8b58a353574c8c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 136b1fc9448f45c5a8b58a353574c8c8. Latest consensus state: current_term: 1 leader_uuid: "136b1fc9448f45c5a8b58a353574c8c8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "136b1fc9448f45c5a8b58a353574c8c8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33731 } } }
I20260811 17:13:09.418763 10137 sys_catalog.cc:458] T 00000000000000000000000000000000 P 136b1fc9448f45c5a8b58a353574c8c8 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:09.418777 10138 sys_catalog.cc:458] T 00000000000000000000000000000000 P 136b1fc9448f45c5a8b58a353574c8c8 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:09.419210 10145 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:13:09.422356 10145 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:13:09.429033 10145 catalog_manager.cc:1347] Generated new cluster ID: 1776019b10c74b61b8f90afd2cb36592
I20260811 17:13:09.429150 10145 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:13:09.447284 10145 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:13:09.447702 10145 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:13:09.459369 10145 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 136b1fc9448f45c5a8b58a353574c8c8: Generated new TSK 0
I20260811 17:13:09.460436 10145 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:13:09.473630 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 10001
2026-08-11T17:13:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1755 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:13:09 dist-test-slave-7vjv krb5kdc[10167](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:13:09 dist-test-slave-7vjv krb5kdc[10167](info): set up 2 sockets
Aug 11 17:13:09 dist-test-slave-7vjv krb5kdc[10167](info): commencing operation
krb5kdc: starting...
W20260811 17:13:10.853726 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.344s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:13:10 dist-test-slave-7vjv krb5kdc[10167](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468390, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:13:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:13:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 17:13:11.001307 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36665
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36665
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:13:11.125119 10189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:13:11.125563 10189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:13:11.125665 10189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:13:11.129961 10189 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:13:11.130089 10189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:13:11.130129 10189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:13:11.130169 10189 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:13:11.130201 10189 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:13:11.135954 10189 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36665
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10189
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:13:11.137236 10189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:13:11.138355 10189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:13:11.148110 10201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:11.148080 10199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:11.148190 10189 server_base.cc:1034] running on GCE node
W20260811 17:13:11.148090 10198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:11.149005 10189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:13:11.150420 10189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:13:11.151674 10189 hybrid_clock.cc:648] HybridClock initialized: now 1786468391151637 us; error 53 us; skew 500 ppm
Aug 11 17:13:11 dist-test-slave-7vjv krb5kdc[10167](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468391, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:13:11.155082 10189 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 17:13:11.156199 10189 webserver.cc:460] Webserver started at http://127.0.0.1:41501/ using document root <none> and password file <none>
I20260811 17:13:11.156822 10189 fs_manager.cc:359] Metadata directory not provided
I20260811 17:13:11.156925 10189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:13:11.157172 10189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:13:11.159435 10189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "1e24d1c59f3d494b979453b7ac3c1435"
format_stamp: "Formatted at 2026-08-11 17:13:11 on dist-test-slave-7vjv"
server_key: "8431043d9950a95d255cd02198fb3fd3"
server_key_iv: "35a796d2fd3ca6949055f4098c76bfe5"
server_key_version: "encryptionkey@0"
I20260811 17:13:11.160071 10189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "1e24d1c59f3d494b979453b7ac3c1435"
format_stamp: "Formatted at 2026-08-11 17:13:11 on dist-test-slave-7vjv"
server_key: "8431043d9950a95d255cd02198fb3fd3"
server_key_iv: "35a796d2fd3ca6949055f4098c76bfe5"
server_key_version: "encryptionkey@0"
I20260811 17:13:11.164356 10189 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 17:13:11.167188 10214 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:13:11.168599 10189 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:13:11.168781 10189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "1e24d1c59f3d494b979453b7ac3c1435"
format_stamp: "Formatted at 2026-08-11 17:13:11 on dist-test-slave-7vjv"
server_key: "8431043d9950a95d255cd02198fb3fd3"
server_key_iv: "35a796d2fd3ca6949055f4098c76bfe5"
server_key_version: "encryptionkey@0"
I20260811 17:13:11.168915 10189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:13:11.186825 10189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:13:11.190644 10189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:13:11.190903 10189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:13:11.199150 10189 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36665
I20260811 17:13:11.199182 10303 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36665 every 8 connection(s)
I20260811 17:13:11.200380 10189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:13:11.201166 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 10189
I20260811 17:13:11.201344 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:13:11.201684 4683 external_mini_cluster.cc:1428] Setting key ae1b2e17b37a83770f76fa0bb2d115f9
I20260811 17:13:11.204241 10305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:13:11.210945 10305 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e24d1c59f3d494b979453b7ac3c1435: Bootstrap starting.
Aug 11 17:13:11 dist-test-slave-7vjv krb5kdc[10167](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468390, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 17:13:11.213827 10305 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e24d1c59f3d494b979453b7ac3c1435: Neither blocks nor log segments found. Creating new log.
I20260811 17:13:11.214881 10305 log.cc:824] T 00000000000000000000000000000000 P 1e24d1c59f3d494b979453b7ac3c1435: Log is configured to *not* fsync() on all Append() calls
I20260811 17:13:11.217947 10305 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e24d1c59f3d494b979453b7ac3c1435: No bootstrap required, opened a new log
I20260811 17:13:11.219100 10308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:11.203286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.91:34229 (local address 127.0.0.1:36665)
0811 17:13:11.203924 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:11.203942 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:11.203984 (+ 42us) server_negotiation.cc:407] Connection header received
0811 17:13:11.204831 (+ 847us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:11.204853 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:11.205246 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:11.205633 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:11.206557 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:11.207618 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:11.208686 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:11.209368 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:11.209572 (+ 204us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:11.212838 (+ 3266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:11.212845 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:11.212860 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:11.212899 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:11.215137 (+ 2238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:11.215960 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:11.215968 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:11.215975 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:11.216176 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:11.216591 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:11.216595 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:11.216597 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:11.217174 (+ 577us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:11.217400 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:11.217777 (+ 377us) server_negotiation.cc:299] Negotiation successful
0811 17:13:11.218051 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":173,"threads_started":1}
I20260811 17:13:11.222759 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:13:11.222708 10305 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e24d1c59f3d494b979453b7ac3c1435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e24d1c59f3d494b979453b7ac3c1435" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36665 } }
I20260811 17:13:11.223030 10305 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1e24d1c59f3d494b979453b7ac3c1435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:13:11.223110 10305 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e24d1c59f3d494b979453b7ac3c1435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e24d1c59f3d494b979453b7ac3c1435, State: Initialized, Role: FOLLOWER
I20260811 17:13:11.223628 10305 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e24d1c59f3d494b979453b7ac3c1435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e24d1c59f3d494b979453b7ac3c1435" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36665 } }
I20260811 17:13:11.223762 10305 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e24d1c59f3d494b979453b7ac3c1435 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:13:11.223850 10305 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e24d1c59f3d494b979453b7ac3c1435 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:13:11.223977 10305 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e24d1c59f3d494b979453b7ac3c1435 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:13:11.225137 10305 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e24d1c59f3d494b979453b7ac3c1435 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e24d1c59f3d494b979453b7ac3c1435" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36665 } }
I20260811 17:13:11.225540 10305 leader_election.cc:302] T 00000000000000000000000000000000 P 1e24d1c59f3d494b979453b7ac3c1435 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e24d1c59f3d494b979453b7ac3c1435; no voters:
I20260811 17:13:11.225956 10305 leader_election.cc:288] T 00000000000000000000000000000000 P 1e24d1c59f3d494b979453b7ac3c1435 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:13:11.226082 10316 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e24d1c59f3d494b979453b7ac3c1435 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:13:11.226337 10316 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e24d1c59f3d494b979453b7ac3c1435 [term 1 LEADER]: Becoming Leader. State: Replica: 1e24d1c59f3d494b979453b7ac3c1435, State: Running, Role: LEADER
I20260811 17:13:11.226776 10316 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e24d1c59f3d494b979453b7ac3c1435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e24d1c59f3d494b979453b7ac3c1435" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36665 } }
I20260811 17:13:11.227378 10305 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e24d1c59f3d494b979453b7ac3c1435 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:13:11.228189 10316 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e24d1c59f3d494b979453b7ac3c1435 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e24d1c59f3d494b979453b7ac3c1435. Latest consensus state: current_term: 1 leader_uuid: "1e24d1c59f3d494b979453b7ac3c1435" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e24d1c59f3d494b979453b7ac3c1435" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36665 } } }
I20260811 17:13:11.228389 10316 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e24d1c59f3d494b979453b7ac3c1435 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:11.228662 10319 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e24d1c59f3d494b979453b7ac3c1435 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1e24d1c59f3d494b979453b7ac3c1435" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e24d1c59f3d494b979453b7ac3c1435" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36665 } } }
I20260811 17:13:11.228778 10319 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e24d1c59f3d494b979453b7ac3c1435 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:11.228951 10336 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:13:11.233194 10336 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:13:11.235427 10308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:11.225228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.91:56611 (local address 127.0.0.1:36665)
0811 17:13:11.225358 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:11.225363 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:11.225593 (+ 230us) server_negotiation.cc:407] Connection header received
0811 17:13:11.225686 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:11.225689 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:11.225772 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:11.225872 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:11.226820 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:11.227587 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:11.228856 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:11.229194 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:11.229275 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:11.231465 (+ 2190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:11.231469 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:11.231472 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:11.231498 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:11.233357 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:11.234024 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:11.234031 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:11.234035 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:11.234138 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:11.234520 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:11.234524 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:11.234526 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:11.234721 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:11.234885 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:11.235175 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 17:13:11.235277 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 17:13:11.240150 10336 catalog_manager.cc:1347] Generated new cluster ID: 492bfef25d824484867f8d647f673d65
I20260811 17:13:11.240247 10336 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:13:11.261013 10336 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:13:11.262322 10336 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:13:11.276403 10336 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1e24d1c59f3d494b979453b7ac3c1435: Generated new TSK 0
I20260811 17:13:11.277264 10336 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:13:11.285434 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 10189
W20260811 17:13:11.305379 10163 connection.cc:535] client connection to 127.0.0.1:36665 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36665): Connection reset by peer (error 104)
2026-08-11T17:13:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1811 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:13:11 dist-test-slave-7vjv krb5kdc[10359](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:13:11 dist-test-slave-7vjv krb5kdc[10359](info): set up 2 sockets
Aug 11 17:13:11 dist-test-slave-7vjv krb5kdc[10359](info): commencing operation
krb5kdc: starting...
W20260811 17:13:12.669848 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.348s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:13:12 dist-test-slave-7vjv krb5kdc[10359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:13:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:13:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 17:13:12.811554 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38003
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38003
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:13:12.931346 10387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:13:12.931710 10387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:13:12.931788 10387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:13:12.936084 10387 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:13:12.936260 10387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:13:12.936300 10387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:13:12.936334 10387 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:13:12.936365 10387 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:13:12.941924 10387 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38003
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38003
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10387
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:13:12.943176 10387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:13:12.944301 10387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:13:12.953672 10403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:12.953748 10401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:12.953735 10387 server_base.cc:1034] running on GCE node
W20260811 17:13:12.953687 10396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:12.954734 10387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:13:12.956164 10387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:13:12.957396 10387 hybrid_clock.cc:648] HybridClock initialized: now 1786468392957372 us; error 63 us; skew 500 ppm
Aug 11 17:13:12 dist-test-slave-7vjv krb5kdc[10359](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468392, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:13:12.963711 10387 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 17:13:12.965176 10387 webserver.cc:460] Webserver started at http://127.0.0.1:42897/ using document root <none> and password file <none>
I20260811 17:13:12.965778 10387 fs_manager.cc:359] Metadata directory not provided
I20260811 17:13:12.965852 10387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:13:12.966040 10387 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:13:12.968504 10387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "90bc7d4772344590a4ed7c1d317e0af1"
format_stamp: "Formatted at 2026-08-11 17:13:12 on dist-test-slave-7vjv"
server_key: "2b1efe7525341215b27d8b3b84335109"
server_key_iv: "863ed2ef2c2e806208f84247eaa47a7d"
server_key_version: "encryptionkey@0"
I20260811 17:13:12.969110 10387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "90bc7d4772344590a4ed7c1d317e0af1"
format_stamp: "Formatted at 2026-08-11 17:13:12 on dist-test-slave-7vjv"
server_key: "2b1efe7525341215b27d8b3b84335109"
server_key_iv: "863ed2ef2c2e806208f84247eaa47a7d"
server_key_version: "encryptionkey@0"
I20260811 17:13:12.973423 10387 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 17:13:12.976284 10421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:13:12.977790 10387 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:13:12.977983 10387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "90bc7d4772344590a4ed7c1d317e0af1"
format_stamp: "Formatted at 2026-08-11 17:13:12 on dist-test-slave-7vjv"
server_key: "2b1efe7525341215b27d8b3b84335109"
server_key_iv: "863ed2ef2c2e806208f84247eaa47a7d"
server_key_version: "encryptionkey@0"
I20260811 17:13:12.978116 10387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:13:13.010665 10387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:13:13.014657 10387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:13:13.014853 10387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:13:13.024286 10387 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38003
I20260811 17:13:13.024406 10510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38003 every 8 connection(s)
I20260811 17:13:13.025524 10387 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:13:13.029002 10511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:13:13.030856 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 10387
I20260811 17:13:13.031090 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:13:13.031438 4683 external_mini_cluster.cc:1428] Setting key 0134d45f0f1e383f9857a111ae197b23
I20260811 17:13:13.036617 10511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90bc7d4772344590a4ed7c1d317e0af1: Bootstrap starting.
I20260811 17:13:13.039729 10511 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90bc7d4772344590a4ed7c1d317e0af1: Neither blocks nor log segments found. Creating new log.
I20260811 17:13:13.040684 10511 log.cc:824] T 00000000000000000000000000000000 P 90bc7d4772344590a4ed7c1d317e0af1: Log is configured to *not* fsync() on all Append() calls
I20260811 17:13:13.042318 10514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:13.033165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.91:45873 (local address 127.0.0.1:38003)
0811 17:13:13.033693 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:13.033711 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:13.033750 (+ 39us) server_negotiation.cc:407] Connection header received
0811 17:13:13.034442 (+ 692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:13.034462 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:13.034847 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:13.035152 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:13.035708 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:13.036904 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:13.038288 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:13.038837 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:13.038982 (+ 145us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:13.040077 (+ 1095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:13.040087 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:13.040155 (+ 68us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:13:13.040630 (+ 475us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:13.040701 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:13:13.040729 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:13.040970 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:13.041248 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 17:13:13.041414 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":173,"threads_started":1}
I20260811 17:13:13.043138 10511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90bc7d4772344590a4ed7c1d317e0af1: No bootstrap required, opened a new log
I20260811 17:13:13.046087 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:13:13.047729 10511 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90bc7d4772344590a4ed7c1d317e0af1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90bc7d4772344590a4ed7c1d317e0af1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38003 } }
I20260811 17:13:13.048029 10511 raft_consensus.cc:374] T 00000000000000000000000000000000 P 90bc7d4772344590a4ed7c1d317e0af1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:13:13.048147 10511 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90bc7d4772344590a4ed7c1d317e0af1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90bc7d4772344590a4ed7c1d317e0af1, State: Initialized, Role: FOLLOWER
I20260811 17:13:13.048715 10511 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90bc7d4772344590a4ed7c1d317e0af1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90bc7d4772344590a4ed7c1d317e0af1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38003 } }
I20260811 17:13:13.048916 10511 raft_consensus.cc:388] T 00000000000000000000000000000000 P 90bc7d4772344590a4ed7c1d317e0af1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:13:13.049005 10511 raft_consensus.cc:482] T 00000000000000000000000000000000 P 90bc7d4772344590a4ed7c1d317e0af1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:13:13.049116 10511 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90bc7d4772344590a4ed7c1d317e0af1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:13:13.050578 10511 raft_consensus.cc:504] T 00000000000000000000000000000000 P 90bc7d4772344590a4ed7c1d317e0af1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90bc7d4772344590a4ed7c1d317e0af1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38003 } }
I20260811 17:13:13.051021 10511 leader_election.cc:302] T 00000000000000000000000000000000 P 90bc7d4772344590a4ed7c1d317e0af1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 90bc7d4772344590a4ed7c1d317e0af1; no voters:
I20260811 17:13:13.051508 10511 leader_election.cc:288] T 00000000000000000000000000000000 P 90bc7d4772344590a4ed7c1d317e0af1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:13:13.051607 10524 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 90bc7d4772344590a4ed7c1d317e0af1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:13:13.051839 10524 raft_consensus.cc:686] T 00000000000000000000000000000000 P 90bc7d4772344590a4ed7c1d317e0af1 [term 1 LEADER]: Becoming Leader. State: Replica: 90bc7d4772344590a4ed7c1d317e0af1, State: Running, Role: LEADER
I20260811 17:13:13.052281 10524 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90bc7d4772344590a4ed7c1d317e0af1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90bc7d4772344590a4ed7c1d317e0af1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38003 } }
I20260811 17:13:13.053124 10511 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90bc7d4772344590a4ed7c1d317e0af1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:13:13.053700 10514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:13.048380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.91:41455 (local address 127.0.0.1:38003)
0811 17:13:13.048545 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:13.048550 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:13.048809 (+ 259us) server_negotiation.cc:407] Connection header received
0811 17:13:13.048962 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:13.048964 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:13.049084 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:13.049166 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:13.049595 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:13.050120 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:13.051419 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:13.051865 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:13.052500 (+ 635us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:13.053073 (+ 573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:13.053077 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:13.053080 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:13:13.053094 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:13.053127 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:13:13.053246 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:13.053369 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:13.053497 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 17:13:13.053546 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 17:13:13.054627 10526 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90bc7d4772344590a4ed7c1d317e0af1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90bc7d4772344590a4ed7c1d317e0af1. Latest consensus state: current_term: 1 leader_uuid: "90bc7d4772344590a4ed7c1d317e0af1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90bc7d4772344590a4ed7c1d317e0af1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38003 } } }
I20260811 17:13:13.054927 10527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90bc7d4772344590a4ed7c1d317e0af1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "90bc7d4772344590a4ed7c1d317e0af1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90bc7d4772344590a4ed7c1d317e0af1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38003 } } }
I20260811 17:13:13.055063 10526 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90bc7d4772344590a4ed7c1d317e0af1 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:13.055142 10527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90bc7d4772344590a4ed7c1d317e0af1 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:13.055634 10551 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:13:13.058936 10551 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:13:13.066289 10551 catalog_manager.cc:1347] Generated new cluster ID: 056178e281144e4e94247a23914c45e8
I20260811 17:13:13.066395 10551 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:13:13.088702 10551 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:13:13.089875 10551 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:13:13.094630 10551 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 90bc7d4772344590a4ed7c1d317e0af1: Generated new TSK 0
I20260811 17:13:13.095443 10551 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:13:13.100988 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 10387
W20260811 17:13:13.117327 10356 connection.cc:535] client connection to 127.0.0.1:38003 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38003): Connection reset by peer (error 104)
2026-08-11T17:13:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1811 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:13:13 dist-test-slave-7vjv krb5kdc[10568](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:13:13 dist-test-slave-7vjv krb5kdc[10568](info): set up 2 sockets
Aug 11 17:13:13 dist-test-slave-7vjv krb5kdc[10568](info): commencing operation
krb5kdc: starting...
W20260811 17:13:14.476128 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.344s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:13:14 dist-test-slave-7vjv krb5kdc[10568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468394, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:13:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:13:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 17:13:14.625598 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45711
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44405
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45711
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:13:14.747996 10587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:13:14.748435 10587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:13:14.748533 10587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:13:14.752797 10587 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:13:14.752923 10587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:13:14.752962 10587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:13:14.753000 10587 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:13:14.753031 10587 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:13:14.758811 10587 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44405
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45711
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:13:14.760208 10587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:13:14.761300 10587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:13:14.770648 10595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:14.770661 10599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:14.770658 10596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:14.771279 10587 server_base.cc:1034] running on GCE node
I20260811 17:13:14.771903 10587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:13:14.773195 10587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:13:14.774384 10587 hybrid_clock.cc:648] HybridClock initialized: now 1786468394774355 us; error 40 us; skew 500 ppm
Aug 11 17:13:14 dist-test-slave-7vjv krb5kdc[10568](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468394, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:13:14.777745 10587 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 17:13:14.778813 10587 webserver.cc:460] Webserver started at http://127.0.0.1:43541/ using document root <none> and password file <none>
I20260811 17:13:14.779472 10587 fs_manager.cc:359] Metadata directory not provided
I20260811 17:13:14.779592 10587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:13:14.779874 10587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:13:14.782361 10587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "c99bbd2061a94b8fae6d9f778e834600"
format_stamp: "Formatted at 2026-08-11 17:13:14 on dist-test-slave-7vjv"
server_key: "69f8aed10a758dd2799fdb0d949c3822"
server_key_iv: "5fe9036408df2c84456d7b71ef9b4ec4"
server_key_version: "encryptionkey@0"
I20260811 17:13:14.783066 10587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "c99bbd2061a94b8fae6d9f778e834600"
format_stamp: "Formatted at 2026-08-11 17:13:14 on dist-test-slave-7vjv"
server_key: "69f8aed10a758dd2799fdb0d949c3822"
server_key_iv: "5fe9036408df2c84456d7b71ef9b4ec4"
server_key_version: "encryptionkey@0"
I20260811 17:13:14.787940 10587 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.007s
I20260811 17:13:14.791075 10611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:13:14.792527 10587 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:13:14.792742 10587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "c99bbd2061a94b8fae6d9f778e834600"
format_stamp: "Formatted at 2026-08-11 17:13:14 on dist-test-slave-7vjv"
server_key: "69f8aed10a758dd2799fdb0d949c3822"
server_key_iv: "5fe9036408df2c84456d7b71ef9b4ec4"
server_key_version: "encryptionkey@0"
I20260811 17:13:14.792894 10587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:13:14.798369 10587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:13:14.802129 10587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:13:14.802390 10587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:13:14.810688 10587 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45711
I20260811 17:13:14.810716 10715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45711 every 8 connection(s)
I20260811 17:13:14.811818 10587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:13:14.814930 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 10587
I20260811 17:13:14.815078 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:13:14.815409 10718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:13:14.815580 4683 external_mini_cluster.cc:1428] Setting key 43d284fb205fa7f853b5f127beb61208
I20260811 17:13:14.821966 10724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:14.817563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.91:43807 (local address 127.0.0.1:45711)
0811 17:13:14.818075 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:14.818091 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:14.818134 (+ 43us) server_negotiation.cc:407] Connection header received
0811 17:13:14.818869 (+ 735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:14.818892 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:14.819238 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:14.819629 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:14.820654 (+ 1025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:14.820660 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:14.820676 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:13:14.820694 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:14.820757 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:13:14.820784 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:14.820954 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:14.821033 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 17:13:14.821220 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":155,"threads_started":1}
I20260811 17:13:14.823823 10718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c99bbd2061a94b8fae6d9f778e834600: Bootstrap starting.
I20260811 17:13:14.825309 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:13:14.826692 10718 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c99bbd2061a94b8fae6d9f778e834600: Neither blocks nor log segments found. Creating new log.
I20260811 17:13:14.828071 10718 log.cc:824] T 00000000000000000000000000000000 P c99bbd2061a94b8fae6d9f778e834600: Log is configured to *not* fsync() on all Append() calls
I20260811 17:13:14.829561 10724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:14.827608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.91:45549 (local address 127.0.0.1:45711)
0811 17:13:14.827790 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:14.827795 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:14.827891 (+ 96us) server_negotiation.cc:407] Connection header received
0811 17:13:14.828012 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:14.828016 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:14.828066 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:14.828225 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:14.829084 (+ 859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:14.829087 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:14.829089 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:13:14.829101 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:14.829172 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:13:14.829189 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:14.829290 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:14.829394 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 17:13:14.829436 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 17:13:14.830853 10718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c99bbd2061a94b8fae6d9f778e834600: No bootstrap required, opened a new log
I20260811 17:13:14.835034 10718 raft_consensus.cc:348] T 00000000000000000000000000000000 P c99bbd2061a94b8fae6d9f778e834600 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c99bbd2061a94b8fae6d9f778e834600" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45711 } }
I20260811 17:13:14.835292 10718 raft_consensus.cc:374] T 00000000000000000000000000000000 P c99bbd2061a94b8fae6d9f778e834600 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:13:14.835340 10718 raft_consensus.cc:729] T 00000000000000000000000000000000 P c99bbd2061a94b8fae6d9f778e834600 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99bbd2061a94b8fae6d9f778e834600, State: Initialized, Role: FOLLOWER
I20260811 17:13:14.835723 10718 consensus_queue.cc:260] T 00000000000000000000000000000000 P c99bbd2061a94b8fae6d9f778e834600 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c99bbd2061a94b8fae6d9f778e834600" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45711 } }
I20260811 17:13:14.835839 10718 raft_consensus.cc:388] T 00000000000000000000000000000000 P c99bbd2061a94b8fae6d9f778e834600 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:13:14.835888 10718 raft_consensus.cc:482] T 00000000000000000000000000000000 P c99bbd2061a94b8fae6d9f778e834600 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:13:14.835960 10718 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c99bbd2061a94b8fae6d9f778e834600 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:13:14.837121 10718 raft_consensus.cc:504] T 00000000000000000000000000000000 P c99bbd2061a94b8fae6d9f778e834600 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c99bbd2061a94b8fae6d9f778e834600" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45711 } }
I20260811 17:13:14.837582 10718 leader_election.cc:302] T 00000000000000000000000000000000 P c99bbd2061a94b8fae6d9f778e834600 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c99bbd2061a94b8fae6d9f778e834600; no voters:
I20260811 17:13:14.838039 10718 leader_election.cc:288] T 00000000000000000000000000000000 P c99bbd2061a94b8fae6d9f778e834600 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:13:14.838166 10742 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c99bbd2061a94b8fae6d9f778e834600 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:13:14.838428 10742 raft_consensus.cc:686] T 00000000000000000000000000000000 P c99bbd2061a94b8fae6d9f778e834600 [term 1 LEADER]: Becoming Leader. State: Replica: c99bbd2061a94b8fae6d9f778e834600, State: Running, Role: LEADER
I20260811 17:13:14.838827 10742 consensus_queue.cc:237] T 00000000000000000000000000000000 P c99bbd2061a94b8fae6d9f778e834600 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c99bbd2061a94b8fae6d9f778e834600" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45711 } }
I20260811 17:13:14.839403 10718 sys_catalog.cc:564] T 00000000000000000000000000000000 P c99bbd2061a94b8fae6d9f778e834600 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:13:14.840590 10743 sys_catalog.cc:455] T 00000000000000000000000000000000 P c99bbd2061a94b8fae6d9f778e834600 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c99bbd2061a94b8fae6d9f778e834600" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c99bbd2061a94b8fae6d9f778e834600" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45711 } } }
I20260811 17:13:14.840724 10743 sys_catalog.cc:458] T 00000000000000000000000000000000 P c99bbd2061a94b8fae6d9f778e834600 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:14.841161 10757 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:13:14.841668 10748 sys_catalog.cc:455] T 00000000000000000000000000000000 P c99bbd2061a94b8fae6d9f778e834600 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c99bbd2061a94b8fae6d9f778e834600. Latest consensus state: current_term: 1 leader_uuid: "c99bbd2061a94b8fae6d9f778e834600" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c99bbd2061a94b8fae6d9f778e834600" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45711 } } }
I20260811 17:13:14.841837 10748 sys_catalog.cc:458] T 00000000000000000000000000000000 P c99bbd2061a94b8fae6d9f778e834600 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:14.844156 10757 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:13:14.850556 10757 catalog_manager.cc:1347] Generated new cluster ID: 291b67c1beb7439dacc0c1329b4425b7
I20260811 17:13:14.850657 10757 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:13:14.870442 10757 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:13:14.870826 10757 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:13:14.876348 10757 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c99bbd2061a94b8fae6d9f778e834600: Generated new TSK 0
I20260811 17:13:14.877137 10757 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:13:14.887405 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 10587
2026-08-11T17:13:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1798 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:13:14 dist-test-slave-7vjv krb5kdc[10781](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:13:14 dist-test-slave-7vjv krb5kdc[10781](info): set up 2 sockets
Aug 11 17:13:14 dist-test-slave-7vjv krb5kdc[10781](info): commencing operation
krb5kdc: starting...
W20260811 17:13:16.241376 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.310s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:13:16 dist-test-slave-7vjv krb5kdc[10781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468396, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:13:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:13:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 17:13:16.393229 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34023
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34023
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:13:16.518617 10805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:13:16.518989 10805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:13:16.519078 10805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:13:16.523376 10805 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:13:16.523492 10805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:13:16.523533 10805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:13:16.523594 10805 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:13:16.523649 10805 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:13:16.529421 10805 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34023
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34023
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10805
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:13:16.530642 10805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:13:16.531826 10805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:13:16.541308 10818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:16.541323 10814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:16.541309 10811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:16.541536 10805 server_base.cc:1034] running on GCE node
I20260811 17:13:16.542359 10805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:13:16.543557 10805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:13:16.544807 10805 hybrid_clock.cc:648] HybridClock initialized: now 1786468396544773 us; error 48 us; skew 500 ppm
Aug 11 17:13:16 dist-test-slave-7vjv krb5kdc[10781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468396, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:13:16.548384 10805 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 17:13:16.549592 10805 webserver.cc:460] Webserver started at http://127.0.0.1:35379/ using document root <none> and password file <none>
I20260811 17:13:16.550298 10805 fs_manager.cc:359] Metadata directory not provided
I20260811 17:13:16.550421 10805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:13:16.550727 10805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:13:16.553411 10805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "4a94b6e6fbfb4f94b1fc44d360ce05fc"
format_stamp: "Formatted at 2026-08-11 17:13:16 on dist-test-slave-7vjv"
server_key: "e1be10429cd39880eba48d94ba48c114"
server_key_iv: "b2be8a0e5628646e5118a07a108df629"
server_key_version: "encryptionkey@0"
I20260811 17:13:16.554414 10805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "4a94b6e6fbfb4f94b1fc44d360ce05fc"
format_stamp: "Formatted at 2026-08-11 17:13:16 on dist-test-slave-7vjv"
server_key: "e1be10429cd39880eba48d94ba48c114"
server_key_iv: "b2be8a0e5628646e5118a07a108df629"
server_key_version: "encryptionkey@0"
I20260811 17:13:16.558941 10805 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 17:13:16.561926 10828 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:13:16.563308 10805 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 17:13:16.563485 10805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "4a94b6e6fbfb4f94b1fc44d360ce05fc"
format_stamp: "Formatted at 2026-08-11 17:13:16 on dist-test-slave-7vjv"
server_key: "e1be10429cd39880eba48d94ba48c114"
server_key_iv: "b2be8a0e5628646e5118a07a108df629"
server_key_version: "encryptionkey@0"
I20260811 17:13:16.563628 10805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:13:16.587646 10805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:13:16.591456 10805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:13:16.591720 10805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:13:16.600080 10928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34023 every 8 connection(s)
I20260811 17:13:16.600111 10805 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34023
I20260811 17:13:16.601464 10805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:13:16.603158 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 10805
I20260811 17:13:16.603348 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:13:16.603668 4683 external_mini_cluster.cc:1428] Setting key cb943a68b6f9b2aac18ea7be9062eb3e
I20260811 17:13:16.604909 10929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:13:16.612383 10929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a94b6e6fbfb4f94b1fc44d360ce05fc: Bootstrap starting.
Aug 11 17:13:16 dist-test-slave-7vjv krb5kdc[10781](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468396, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 17:13:16.615196 10929 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a94b6e6fbfb4f94b1fc44d360ce05fc: Neither blocks nor log segments found. Creating new log.
I20260811 17:13:16.616290 10929 log.cc:824] T 00000000000000000000000000000000 P 4a94b6e6fbfb4f94b1fc44d360ce05fc: Log is configured to *not* fsync() on all Append() calls
I20260811 17:13:16.618521 10929 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a94b6e6fbfb4f94b1fc44d360ce05fc: No bootstrap required, opened a new log
I20260811 17:13:16.620757 10935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:16.605426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.91:43539 (local address 127.0.0.1:34023)
0811 17:13:16.605917 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:16.605938 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:16.605986 (+ 48us) server_negotiation.cc:407] Connection header received
0811 17:13:16.606888 (+ 902us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:16.606914 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:16.607378 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:16.607789 (+ 411us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:16.608641 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:16.610173 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:16.611159 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:16.611885 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:16.612055 (+ 170us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:16.615245 (+ 3190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:16.615254 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:16.615277 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:16.615318 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:16.617435 (+ 2117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:16.618080 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:16.618086 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:16.618091 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:16.618216 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:16.618606 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:16.618615 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:16.618617 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:16.619088 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:16.619328 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:16.619656 (+ 328us) server_negotiation.cc:299] Negotiation successful
0811 17:13:16.619924 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":138,"threads_started":1}
I20260811 17:13:16.622814 10929 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4a94b6e6fbfb4f94b1fc44d360ce05fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a94b6e6fbfb4f94b1fc44d360ce05fc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34023 } }
I20260811 17:13:16.623117 10929 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4a94b6e6fbfb4f94b1fc44d360ce05fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:13:16.623209 10929 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4a94b6e6fbfb4f94b1fc44d360ce05fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a94b6e6fbfb4f94b1fc44d360ce05fc, State: Initialized, Role: FOLLOWER
I20260811 17:13:16.623724 10929 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a94b6e6fbfb4f94b1fc44d360ce05fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a94b6e6fbfb4f94b1fc44d360ce05fc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34023 } }
I20260811 17:13:16.623894 10929 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4a94b6e6fbfb4f94b1fc44d360ce05fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:13:16.623967 10929 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4a94b6e6fbfb4f94b1fc44d360ce05fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:13:16.624049 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:13:16.624073 10929 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4a94b6e6fbfb4f94b1fc44d360ce05fc [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:13:16.625118 10929 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4a94b6e6fbfb4f94b1fc44d360ce05fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a94b6e6fbfb4f94b1fc44d360ce05fc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34023 } }
I20260811 17:13:16.625521 10929 leader_election.cc:302] T 00000000000000000000000000000000 P 4a94b6e6fbfb4f94b1fc44d360ce05fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4a94b6e6fbfb4f94b1fc44d360ce05fc; no voters:
I20260811 17:13:16.625900 10929 leader_election.cc:288] T 00000000000000000000000000000000 P 4a94b6e6fbfb4f94b1fc44d360ce05fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:13:16.626056 10948 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4a94b6e6fbfb4f94b1fc44d360ce05fc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:13:16.626315 10948 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4a94b6e6fbfb4f94b1fc44d360ce05fc [term 1 LEADER]: Becoming Leader. State: Replica: 4a94b6e6fbfb4f94b1fc44d360ce05fc, State: Running, Role: LEADER
I20260811 17:13:16.626705 10948 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4a94b6e6fbfb4f94b1fc44d360ce05fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a94b6e6fbfb4f94b1fc44d360ce05fc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34023 } }
I20260811 17:13:16.627251 10929 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4a94b6e6fbfb4f94b1fc44d360ce05fc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:13:16.629089 10950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a94b6e6fbfb4f94b1fc44d360ce05fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a94b6e6fbfb4f94b1fc44d360ce05fc. Latest consensus state: current_term: 1 leader_uuid: "4a94b6e6fbfb4f94b1fc44d360ce05fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a94b6e6fbfb4f94b1fc44d360ce05fc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34023 } } }
I20260811 17:13:16.629379 10949 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a94b6e6fbfb4f94b1fc44d360ce05fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4a94b6e6fbfb4f94b1fc44d360ce05fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a94b6e6fbfb4f94b1fc44d360ce05fc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34023 } } }
I20260811 17:13:16.629830 10949 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a94b6e6fbfb4f94b1fc44d360ce05fc [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:16.629724 10950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a94b6e6fbfb4f94b1fc44d360ce05fc [sys.catalog]: This master's current role is: LEADER
W20260811 17:13:16.632817 10970 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4a94b6e6fbfb4f94b1fc44d360ce05fc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 17:13:16.632965 10970 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 17:13:16.633046 10973 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:13:16.633984 10973 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:13:16.636235 10935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:16.626202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.91:54331 (local address 127.0.0.1:34023)
0811 17:13:16.626353 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:16.626357 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:16.627041 (+ 684us) server_negotiation.cc:407] Connection header received
0811 17:13:16.627422 (+ 381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:16.627425 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:16.627476 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:16.627527 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:16.628592 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:16.629418 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:16.630660 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:16.630919 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:16.631039 (+ 120us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:16.632653 (+ 1614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:16.632657 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:16.632660 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:16.632686 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:16.634236 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:16.634819 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:16.634823 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:16.634825 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:16.634914 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:16.635276 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:16.635279 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:16.635281 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:16.635471 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:16.635639 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:16.635927 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 17:13:16.636041 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 17:13:16.641206 10973 catalog_manager.cc:1347] Generated new cluster ID: 4e11b269572e4ca88a0c911f643417a9
I20260811 17:13:16.641300 10973 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:13:16.670430 10973 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:13:16.671497 10973 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:13:16.679939 10973 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4a94b6e6fbfb4f94b1fc44d360ce05fc: Generated new TSK 0
I20260811 17:13:16.680781 10973 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:13:16.687690 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 10805
W20260811 17:13:16.705581 10776 connection.cc:535] client connection to 127.0.0.1:34023 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34023): Connection reset by peer (error 104)
2026-08-11T17:13:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1789 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:13:16 dist-test-slave-7vjv krb5kdc[10984](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:13:16 dist-test-slave-7vjv krb5kdc[10984](info): set up 2 sockets
Aug 11 17:13:16 dist-test-slave-7vjv krb5kdc[10984](info): commencing operation
krb5kdc: starting...
W20260811 17:13:18.067984 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.347s user 0.002s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:13:18 dist-test-slave-7vjv krb5kdc[10984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468398, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:13:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:13:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 17:13:18.225868 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33553
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33075
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33553
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:13:18.365350 11005 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:13:18.365718 11005 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:13:18.365809 11005 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:13:18.370209 11005 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:13:18.370321 11005 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:13:18.370360 11005 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:13:18.370421 11005 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:13:18.370456 11005 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:13:18.376433 11005 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33075
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33553
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11005
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:13:18.377669 11005 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:13:18.378808 11005 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 17:13:18.388185 11005 server_base.cc:1034] running on GCE node
W20260811 17:13:18.388162 11017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:18.388200 11018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:18.388144 11026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:18.389192 11005 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:13:18.390403 11005 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:13:18.391606 11005 hybrid_clock.cc:648] HybridClock initialized: now 1786468398391590 us; error 32 us; skew 500 ppm
Aug 11 17:13:18 dist-test-slave-7vjv krb5kdc[10984](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468398, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:13:18.399832 11005 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 17:13:18.401073 11005 webserver.cc:460] Webserver started at http://127.0.0.1:38799/ using document root <none> and password file <none>
I20260811 17:13:18.401739 11005 fs_manager.cc:359] Metadata directory not provided
I20260811 17:13:18.401813 11005 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:13:18.402058 11005 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:13:18.404498 11005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "fd12e6663b954cc98c5d172d3b4f9f27"
format_stamp: "Formatted at 2026-08-11 17:13:18 on dist-test-slave-7vjv"
server_key: "04f73dfc9b1cc6c21ecc06262c9c2b06"
server_key_iv: "cdc8f9ccab899cd19d4604b1755623ce"
server_key_version: "encryptionkey@0"
I20260811 17:13:18.405179 11005 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "fd12e6663b954cc98c5d172d3b4f9f27"
format_stamp: "Formatted at 2026-08-11 17:13:18 on dist-test-slave-7vjv"
server_key: "04f73dfc9b1cc6c21ecc06262c9c2b06"
server_key_iv: "cdc8f9ccab899cd19d4604b1755623ce"
server_key_version: "encryptionkey@0"
I20260811 17:13:18.409863 11005 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 17:13:18.413004 11033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:13:18.414438 11005 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:13:18.414613 11005 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "fd12e6663b954cc98c5d172d3b4f9f27"
format_stamp: "Formatted at 2026-08-11 17:13:18 on dist-test-slave-7vjv"
server_key: "04f73dfc9b1cc6c21ecc06262c9c2b06"
server_key_iv: "cdc8f9ccab899cd19d4604b1755623ce"
server_key_version: "encryptionkey@0"
I20260811 17:13:18.414788 11005 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:13:18.433094 11005 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:13:18.436781 11005 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:13:18.437175 11005 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:13:18.446467 11005 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33553
I20260811 17:13:18.446516 11123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33553 every 8 connection(s)
I20260811 17:13:18.447722 11005 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:13:18.451054 11124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:13:18.455684 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 11005
I20260811 17:13:18.455821 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:13:18.456207 4683 external_mini_cluster.cc:1428] Setting key 2edd17d6b136ece834e62c0c06b6012c
I20260811 17:13:18.457958 11124 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd12e6663b954cc98c5d172d3b4f9f27: Bootstrap starting.
I20260811 17:13:18.460577 11124 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd12e6663b954cc98c5d172d3b4f9f27: Neither blocks nor log segments found. Creating new log.
I20260811 17:13:18.461349 11124 log.cc:824] T 00000000000000000000000000000000 P fd12e6663b954cc98c5d172d3b4f9f27: Log is configured to *not* fsync() on all Append() calls
I20260811 17:13:18.463296 11124 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd12e6663b954cc98c5d172d3b4f9f27: No bootstrap required, opened a new log
I20260811 17:13:18.466990 11131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:18.457896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.91:38689 (local address 127.0.0.1:33553)
0811 17:13:18.459255 (+ 1359us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:18.459277 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:18.459347 (+ 70us) server_negotiation.cc:407] Connection header received
0811 17:13:18.460060 (+ 713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:18.460078 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:18.460539 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:18.460934 (+ 395us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:18.461383 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:18.462422 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:18.463363 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:18.463913 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:18.464104 (+ 191us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:18.465138 (+ 1034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:18.465144 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:18.465166 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:13:18.465591 (+ 425us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:18.465651 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:13:18.465678 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:18.465836 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:18.466025 (+ 189us) server_negotiation.cc:299] Negotiation successful
0811 17:13:18.466192 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1181,"thread_start_us":824,"threads_started":1}
I20260811 17:13:18.467259 11124 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd12e6663b954cc98c5d172d3b4f9f27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd12e6663b954cc98c5d172d3b4f9f27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33553 } }
I20260811 17:13:18.467566 11124 raft_consensus.cc:374] T 00000000000000000000000000000000 P fd12e6663b954cc98c5d172d3b4f9f27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:13:18.467630 11124 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd12e6663b954cc98c5d172d3b4f9f27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd12e6663b954cc98c5d172d3b4f9f27, State: Initialized, Role: FOLLOWER
I20260811 17:13:18.468139 11124 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd12e6663b954cc98c5d172d3b4f9f27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd12e6663b954cc98c5d172d3b4f9f27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33553 } }
I20260811 17:13:18.468338 11124 raft_consensus.cc:388] T 00000000000000000000000000000000 P fd12e6663b954cc98c5d172d3b4f9f27 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:13:18.468428 11124 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd12e6663b954cc98c5d172d3b4f9f27 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:13:18.468535 11124 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd12e6663b954cc98c5d172d3b4f9f27 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:13:18.469770 11124 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd12e6663b954cc98c5d172d3b4f9f27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd12e6663b954cc98c5d172d3b4f9f27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33553 } }
I20260811 17:13:18.470137 11124 leader_election.cc:302] T 00000000000000000000000000000000 P fd12e6663b954cc98c5d172d3b4f9f27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd12e6663b954cc98c5d172d3b4f9f27; no voters:
I20260811 17:13:18.470494 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:13:18.470579 11124 leader_election.cc:288] T 00000000000000000000000000000000 P fd12e6663b954cc98c5d172d3b4f9f27 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:13:18.470655 11135 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd12e6663b954cc98c5d172d3b4f9f27 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:13:18.470937 11135 raft_consensus.cc:686] T 00000000000000000000000000000000 P fd12e6663b954cc98c5d172d3b4f9f27 [term 1 LEADER]: Becoming Leader. State: Replica: fd12e6663b954cc98c5d172d3b4f9f27, State: Running, Role: LEADER
I20260811 17:13:18.471344 11135 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd12e6663b954cc98c5d172d3b4f9f27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd12e6663b954cc98c5d172d3b4f9f27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33553 } }
I20260811 17:13:18.472086 11124 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd12e6663b954cc98c5d172d3b4f9f27 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:13:18.472791 11135 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd12e6663b954cc98c5d172d3b4f9f27 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd12e6663b954cc98c5d172d3b4f9f27. Latest consensus state: current_term: 1 leader_uuid: "fd12e6663b954cc98c5d172d3b4f9f27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd12e6663b954cc98c5d172d3b4f9f27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33553 } } }
I20260811 17:13:18.472990 11135 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd12e6663b954cc98c5d172d3b4f9f27 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:18.473268 11136 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd12e6663b954cc98c5d172d3b4f9f27 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd12e6663b954cc98c5d172d3b4f9f27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd12e6663b954cc98c5d172d3b4f9f27" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33553 } } }
I20260811 17:13:18.473373 11136 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd12e6663b954cc98c5d172d3b4f9f27 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:18.473552 11157 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:13:18.477155 11157 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:13:18.482210 11131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:18.475042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.91:39205 (local address 127.0.0.1:33553)
0811 17:13:18.475170 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:18.475174 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:18.475581 (+ 407us) server_negotiation.cc:407] Connection header received
0811 17:13:18.475811 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:18.475814 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:18.475871 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:18.475964 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:18.476292 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:18.477139 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:18.478234 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:18.478482 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:18.478623 (+ 141us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:18.479605 (+ 982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:18.479609 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:18.479612 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:13:18.479628 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:18.479662 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:13:18.479685 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:18.479792 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:18.482010 (+ 2218us) server_negotiation.cc:299] Negotiation successful
0811 17:13:18.482056 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 17:13:18.484542 11157 catalog_manager.cc:1347] Generated new cluster ID: f0ed7b899d4b48b4a9cf0acf22200ee0
I20260811 17:13:18.484669 11157 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:13:18.496865 11157 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:13:18.498292 11157 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:13:18.510447 11157 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fd12e6663b954cc98c5d172d3b4f9f27: Generated new TSK 0
I20260811 17:13:18.511433 11157 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:13:18.518409 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 11005
W20260811 17:13:18.538333 10977 connection.cc:535] client connection to 127.0.0.1:33553 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33553): Connection reset by peer (error 104)
2026-08-11T17:13:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1832 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:13:18 dist-test-slave-7vjv krb5kdc[11175](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:13:18 dist-test-slave-7vjv krb5kdc[11175](info): set up 2 sockets
Aug 11 17:13:18 dist-test-slave-7vjv krb5kdc[11175](info): commencing operation
krb5kdc: starting...
W20260811 17:13:19.877851 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.324s user 0.002s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:13:19 dist-test-slave-7vjv krb5kdc[11175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468399, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:13:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:13:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 17:13:20.037142 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45463
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45463
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:13:20.165407 11192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:13:20.165802 11192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:13:20.165895 11192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:13:20.170163 11192 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:13:20.170300 11192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:13:20.170341 11192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:13:20.170382 11192 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:13:20.170414 11192 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:13:20.176331 11192 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45463
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45463
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11192
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:13:20.177590 11192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:13:20.178753 11192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:13:20.188165 11201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:20.188148 11203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:20.188253 11205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:20.188377 11192 server_base.cc:1034] running on GCE node
I20260811 17:13:20.189224 11192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:13:20.190456 11192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:13:20.191664 11192 hybrid_clock.cc:648] HybridClock initialized: now 1786468400191642 us; error 34 us; skew 500 ppm
Aug 11 17:13:20 dist-test-slave-7vjv krb5kdc[11175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468400, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:13:20.194629 11192 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 17:13:20.195605 11192 webserver.cc:460] Webserver started at http://127.0.0.1:45195/ using document root <none> and password file <none>
I20260811 17:13:20.196295 11192 fs_manager.cc:359] Metadata directory not provided
I20260811 17:13:20.196403 11192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:13:20.196650 11192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:13:20.198788 11192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "6d1da639e1d74c889c9b60d9ab1ad487"
format_stamp: "Formatted at 2026-08-11 17:13:20 on dist-test-slave-7vjv"
server_key: "abecc689c0c2b3b8212e1928ca9b97c6"
server_key_iv: "71fd3dd3d424f15b8da3457ce310078f"
server_key_version: "encryptionkey@0"
I20260811 17:13:20.199404 11192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "6d1da639e1d74c889c9b60d9ab1ad487"
format_stamp: "Formatted at 2026-08-11 17:13:20 on dist-test-slave-7vjv"
server_key: "abecc689c0c2b3b8212e1928ca9b97c6"
server_key_iv: "71fd3dd3d424f15b8da3457ce310078f"
server_key_version: "encryptionkey@0"
I20260811 17:13:20.203475 11192 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260811 17:13:20.206333 11223 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:13:20.207791 11192 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 17:13:20.207959 11192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "6d1da639e1d74c889c9b60d9ab1ad487"
format_stamp: "Formatted at 2026-08-11 17:13:20 on dist-test-slave-7vjv"
server_key: "abecc689c0c2b3b8212e1928ca9b97c6"
server_key_iv: "71fd3dd3d424f15b8da3457ce310078f"
server_key_version: "encryptionkey@0"
I20260811 17:13:20.208099 11192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:13:20.213394 11192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:13:20.216869 11192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:13:20.217105 11192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:13:20.225117 11192 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45463
I20260811 17:13:20.225185 11321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45463 every 8 connection(s)
I20260811 17:13:20.226318 11192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:13:20.229569 11323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:13:20.236045 11323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d1da639e1d74c889c9b60d9ab1ad487: Bootstrap starting.
I20260811 17:13:20.236478 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 11192
I20260811 17:13:20.236647 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:13:20.236961 4683 external_mini_cluster.cc:1428] Setting key 81c6eca3eae899920b043302e0b1bdec
I20260811 17:13:20.239105 11323 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d1da639e1d74c889c9b60d9ab1ad487: Neither blocks nor log segments found. Creating new log.
I20260811 17:13:20.239926 11323 log.cc:824] T 00000000000000000000000000000000 P 6d1da639e1d74c889c9b60d9ab1ad487: Log is configured to *not* fsync() on all Append() calls
I20260811 17:13:20.242514 11323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d1da639e1d74c889c9b60d9ab1ad487: No bootstrap required, opened a new log
I20260811 17:13:20.242926 11328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:20.238533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.91:42337 (local address 127.0.0.1:45463)
0811 17:13:20.239031 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:20.239047 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:20.239084 (+ 37us) server_negotiation.cc:407] Connection header received
0811 17:13:20.239851 (+ 767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:20.239871 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:20.240268 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:20.240580 (+ 312us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:20.241442 (+ 862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:20.241447 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:20.241463 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:13:20.241475 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:20.241542 (+ 67us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:13:20.241570 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:20.241707 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:20.241781 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 17:13:20.241948 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":165,"threads_started":1}
I20260811 17:13:20.246327 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:13:20.247134 11323 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6d1da639e1d74c889c9b60d9ab1ad487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d1da639e1d74c889c9b60d9ab1ad487" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45463 } }
I20260811 17:13:20.247392 11323 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6d1da639e1d74c889c9b60d9ab1ad487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:13:20.247428 11323 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6d1da639e1d74c889c9b60d9ab1ad487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d1da639e1d74c889c9b60d9ab1ad487, State: Initialized, Role: FOLLOWER
I20260811 17:13:20.247962 11323 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d1da639e1d74c889c9b60d9ab1ad487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d1da639e1d74c889c9b60d9ab1ad487" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45463 } }
I20260811 17:13:20.248144 11323 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6d1da639e1d74c889c9b60d9ab1ad487 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:13:20.248253 11323 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6d1da639e1d74c889c9b60d9ab1ad487 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:13:20.248386 11323 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6d1da639e1d74c889c9b60d9ab1ad487 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:13:20.249706 11323 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6d1da639e1d74c889c9b60d9ab1ad487 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d1da639e1d74c889c9b60d9ab1ad487" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45463 } }
I20260811 17:13:20.250144 11323 leader_election.cc:302] T 00000000000000000000000000000000 P 6d1da639e1d74c889c9b60d9ab1ad487 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d1da639e1d74c889c9b60d9ab1ad487; no voters:
I20260811 17:13:20.250600 11328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:20.248663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.91:39357 (local address 127.0.0.1:45463)
0811 17:13:20.248811 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:20.248815 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:20.248979 (+ 164us) server_negotiation.cc:407] Connection header received
0811 17:13:20.249091 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:20.249094 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:20.249137 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:20.249217 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:20.250097 (+ 880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:20.250101 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:20.250103 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:13:20.250115 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:20.250145 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:13:20.250157 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:20.250237 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:20.250397 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 17:13:20.250446 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 17:13:20.250602 11323 leader_election.cc:288] T 00000000000000000000000000000000 P 6d1da639e1d74c889c9b60d9ab1ad487 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:13:20.250655 11345 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6d1da639e1d74c889c9b60d9ab1ad487 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:13:20.250929 11345 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6d1da639e1d74c889c9b60d9ab1ad487 [term 1 LEADER]: Becoming Leader. State: Replica: 6d1da639e1d74c889c9b60d9ab1ad487, State: Running, Role: LEADER
I20260811 17:13:20.251251 11345 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d1da639e1d74c889c9b60d9ab1ad487 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d1da639e1d74c889c9b60d9ab1ad487" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45463 } }
I20260811 17:13:20.252081 11323 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6d1da639e1d74c889c9b60d9ab1ad487 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:13:20.252584 11346 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d1da639e1d74c889c9b60d9ab1ad487 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d1da639e1d74c889c9b60d9ab1ad487. Latest consensus state: current_term: 1 leader_uuid: "6d1da639e1d74c889c9b60d9ab1ad487" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d1da639e1d74c889c9b60d9ab1ad487" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45463 } } }
I20260811 17:13:20.252636 11347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d1da639e1d74c889c9b60d9ab1ad487 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d1da639e1d74c889c9b60d9ab1ad487" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d1da639e1d74c889c9b60d9ab1ad487" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45463 } } }
I20260811 17:13:20.252719 11346 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d1da639e1d74c889c9b60d9ab1ad487 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:20.252751 11347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d1da639e1d74c889c9b60d9ab1ad487 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:20.253103 11350 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:13:20.256675 11350 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:13:20.263149 11350 catalog_manager.cc:1347] Generated new cluster ID: 909bd103daac454582dc49cad05849cc
I20260811 17:13:20.263249 11350 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:13:20.280149 11350 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:13:20.280579 11350 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:13:20.286609 11350 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6d1da639e1d74c889c9b60d9ab1ad487: Generated new TSK 0
I20260811 17:13:20.287437 11350 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:13:20.297456 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 11192
2026-08-11T17:13:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1788 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:13:20 dist-test-slave-7vjv krb5kdc[11383](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:13:20 dist-test-slave-7vjv krb5kdc[11383](info): set up 2 sockets
Aug 11 17:13:20 dist-test-slave-7vjv krb5kdc[11383](info): commencing operation
krb5kdc: starting...
W20260811 17:13:21.666923 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.324s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:13:21 dist-test-slave-7vjv krb5kdc[11383](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468401, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:13:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:13:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:13:21.812448 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:34279
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:43185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:34279
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:13:21.931568 11414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:13:21.931857 11414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:13:21.931900 11414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:13:21.936031 11414 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:13:21.936136 11414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:13:21.936158 11414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:13:21.936177 11414 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:13:21.936192 11414 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:13:21.941773 11414 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:43185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:34279
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:34279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11414
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:13:21.942965 11414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:13:21.944069 11414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:13:21.952994 11421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:21.953081 11426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:21.952991 11422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:21.953306 11414 server_base.cc:1034] running on GCE node
I20260811 17:13:21.953922 11414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:13:21.955118 11414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:13:21.956324 11414 hybrid_clock.cc:648] HybridClock initialized: now 1786468401956316 us; error 32 us; skew 500 ppm
Aug 11 17:13:21 dist-test-slave-7vjv krb5kdc[11383](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468401, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:13:21.959543 11414 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:13:21.960755 11414 webserver.cc:460] Webserver started at http://127.4.146.254:42287/ using document root <none> and password file <none>
I20260811 17:13:21.961359 11414 fs_manager.cc:359] Metadata directory not provided
I20260811 17:13:21.961463 11414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:13:21.961717 11414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:13:21.963889 11414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "95778861570e4e8098429704f13f8553"
format_stamp: "Formatted at 2026-08-11 17:13:21 on dist-test-slave-7vjv"
server_key: "e5aac113cf261a2b552a6ca5738e25cc"
server_key_iv: "9918e42c25c21a5143cc388b4d530086"
server_key_version: "encryptionkey@0"
I20260811 17:13:21.964627 11414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "95778861570e4e8098429704f13f8553"
format_stamp: "Formatted at 2026-08-11 17:13:21 on dist-test-slave-7vjv"
server_key: "e5aac113cf261a2b552a6ca5738e25cc"
server_key_iv: "9918e42c25c21a5143cc388b4d530086"
server_key_version: "encryptionkey@0"
I20260811 17:13:21.968745 11414 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 17:13:21.971444 11449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:13:21.972891 11414 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:13:21.973058 11414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "95778861570e4e8098429704f13f8553"
format_stamp: "Formatted at 2026-08-11 17:13:21 on dist-test-slave-7vjv"
server_key: "e5aac113cf261a2b552a6ca5738e25cc"
server_key_iv: "9918e42c25c21a5143cc388b4d530086"
server_key_version: "encryptionkey@0"
I20260811 17:13:21.973229 11414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:13:22.026042 11414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:13:22.029507 11414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:13:22.029747 11414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:13:22.037427 11414 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:34279
I20260811 17:13:22.037461 11535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:34279 every 8 connection(s)
I20260811 17:13:22.038486 11414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:13:22.041493 11536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:13:22.041710 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 11414
I20260811 17:13:22.041879 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:13:22.042199 4683 external_mini_cluster.cc:1428] Setting key cf80eb39e50c30017f00468f59a40fe6
I20260811 17:13:22.049746 11536 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95778861570e4e8098429704f13f8553: Bootstrap starting.
I20260811 17:13:22.052861 11536 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95778861570e4e8098429704f13f8553: Neither blocks nor log segments found. Creating new log.
Aug 11 17:13:22 dist-test-slave-7vjv krb5kdc[11383](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468401, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:13:22.053757 11536 log.cc:824] T 00000000000000000000000000000000 P 95778861570e4e8098429704f13f8553: Log is configured to *not* fsync() on all Append() calls
I20260811 17:13:22.056638 11536 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95778861570e4e8098429704f13f8553: No bootstrap required, opened a new log
I20260811 17:13:22.059535 11539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:22.043762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33925 (local address 127.4.146.254:34279)
0811 17:13:22.044305 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:22.044327 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:22.044376 (+ 49us) server_negotiation.cc:407] Connection header received
0811 17:13:22.045277 (+ 901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:22.045306 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:22.045825 (+ 519us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:22.046256 (+ 431us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:22.047576 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:22.048788 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:22.050045 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:22.050564 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:22.050709 (+ 145us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:22.053897 (+ 3188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:22.053903 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:22.053922 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:22.053959 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:22.056230 (+ 2271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:22.056849 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:22.056857 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:22.056868 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:22.056992 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:22.057410 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:22.057419 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:22.057421 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:22.057849 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:22.058117 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:22.058466 (+ 349us) server_negotiation.cc:299] Negotiation successful
0811 17:13:22.058715 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":151,"threads_started":1}
I20260811 17:13:22.060783 11536 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95778861570e4e8098429704f13f8553 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95778861570e4e8098429704f13f8553" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34279 } }
I20260811 17:13:22.061071 11536 raft_consensus.cc:374] T 00000000000000000000000000000000 P 95778861570e4e8098429704f13f8553 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:13:22.061167 11536 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95778861570e4e8098429704f13f8553 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95778861570e4e8098429704f13f8553, State: Initialized, Role: FOLLOWER
I20260811 17:13:22.061674 11536 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95778861570e4e8098429704f13f8553 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95778861570e4e8098429704f13f8553" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34279 } }
I20260811 17:13:22.061872 11536 raft_consensus.cc:388] T 00000000000000000000000000000000 P 95778861570e4e8098429704f13f8553 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:13:22.061931 11536 raft_consensus.cc:482] T 00000000000000000000000000000000 P 95778861570e4e8098429704f13f8553 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:13:22.062003 11536 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95778861570e4e8098429704f13f8553 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:13:22.063087 11536 raft_consensus.cc:504] T 00000000000000000000000000000000 P 95778861570e4e8098429704f13f8553 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95778861570e4e8098429704f13f8553" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34279 } }
I20260811 17:13:22.063337 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:13:22.063537 11536 leader_election.cc:302] T 00000000000000000000000000000000 P 95778861570e4e8098429704f13f8553 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 95778861570e4e8098429704f13f8553; no voters:
I20260811 17:13:22.063918 11536 leader_election.cc:288] T 00000000000000000000000000000000 P 95778861570e4e8098429704f13f8553 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:13:22.064013 11543 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 95778861570e4e8098429704f13f8553 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:13:22.064240 11543 raft_consensus.cc:686] T 00000000000000000000000000000000 P 95778861570e4e8098429704f13f8553 [term 1 LEADER]: Becoming Leader. State: Replica: 95778861570e4e8098429704f13f8553, State: Running, Role: LEADER
I20260811 17:13:22.064623 11543 consensus_queue.cc:237] T 00000000000000000000000000000000 P 95778861570e4e8098429704f13f8553 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95778861570e4e8098429704f13f8553" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34279 } }
I20260811 17:13:22.065383 11536 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95778861570e4e8098429704f13f8553 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:13:22.066470 11545 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95778861570e4e8098429704f13f8553 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95778861570e4e8098429704f13f8553. Latest consensus state: current_term: 1 leader_uuid: "95778861570e4e8098429704f13f8553" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95778861570e4e8098429704f13f8553" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34279 } } }
I20260811 17:13:22.066632 11545 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95778861570e4e8098429704f13f8553 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:22.066936 11544 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95778861570e4e8098429704f13f8553 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "95778861570e4e8098429704f13f8553" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95778861570e4e8098429704f13f8553" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34279 } } }
I20260811 17:13:22.067021 11544 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95778861570e4e8098429704f13f8553 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:22.067066 11561 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:13:22.070567 11561 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:13:22.077788 11561 catalog_manager.cc:1347] Generated new cluster ID: 01752604260349a1b21c73a44552dfe3
I20260811 17:13:22.077865 11561 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:13:22.078428 11539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:22.067944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57943 (local address 127.4.146.254:34279)
0811 17:13:22.068066 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:22.068070 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:22.068650 (+ 580us) server_negotiation.cc:407] Connection header received
0811 17:13:22.068785 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:22.068788 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:22.068833 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:22.068936 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:22.069783 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:22.070323 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:22.071584 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:22.071854 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:22.071975 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:22.073885 (+ 1910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:22.073891 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:22.073898 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:22.073936 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:22.075823 (+ 1887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:22.076493 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:22.076497 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:22.076499 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:22.076600 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:22.077010 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:22.077015 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:22.077017 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:22.077264 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:22.077544 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:22.078160 (+ 616us) server_negotiation.cc:299] Negotiation successful
0811 17:13:22.078312 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 17:13:22.091861 11561 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:13:22.093372 11561 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:13:22.101770 11561 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 95778861570e4e8098429704f13f8553: Generated new TSK 0
I20260811 17:13:22.102589 11561 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:13:22.115208 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 11414
W20260811 17:13:22.138726 11379 connection.cc:535] client connection to 127.4.146.254:34279 recv error: Network error: failed to read from TLS socket (remote: 127.4.146.254:34279): Connection reset by peer (error 104)
2026-08-11T17:13:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1811 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:13:22 dist-test-slave-7vjv krb5kdc[11586](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:13:22 dist-test-slave-7vjv krb5kdc[11586](info): set up 2 sockets
Aug 11 17:13:22 dist-test-slave-7vjv krb5kdc[11586](info): commencing operation
krb5kdc: starting...
W20260811 17:13:23.502735 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.349s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:13:23 dist-test-slave-7vjv krb5kdc[11586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:13:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:13:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:13:23.649256 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:36473
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:38673
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:36473
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:13:23.771605 11614 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:13:23.771970 11614 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:13:23.772061 11614 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:13:23.776224 11614 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:13:23.776345 11614 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:13:23.776387 11614 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:13:23.776453 11614 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:13:23.776512 11614 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:13:23.782238 11614 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:38673
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:36473
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:36473
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:13:23.783692 11614 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:13:23.784965 11614 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:13:23.794438 11626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:23.794682 11614 server_base.cc:1034] running on GCE node
W20260811 17:13:23.794431 11628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:23.794853 11630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:23.795528 11614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:13:23.796949 11614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:13:23.798209 11614 hybrid_clock.cc:648] HybridClock initialized: now 1786468403798184 us; error 59 us; skew 500 ppm
Aug 11 17:13:23 dist-test-slave-7vjv krb5kdc[11586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468403, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:13:23.806792 11614 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:13:23.807982 11614 webserver.cc:460] Webserver started at http://127.4.146.254:35593/ using document root <none> and password file <none>
I20260811 17:13:23.808678 11614 fs_manager.cc:359] Metadata directory not provided
I20260811 17:13:23.808754 11614 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:13:23.808941 11614 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:13:23.811291 11614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "8d620b9db8c34a3dbf47067d0eb77e6d"
format_stamp: "Formatted at 2026-08-11 17:13:23 on dist-test-slave-7vjv"
server_key: "9832f19db816cec98dc6df97e966982f"
server_key_iv: "287ca4e85c2ebdb7eccfd715e4c5bcba"
server_key_version: "encryptionkey@0"
I20260811 17:13:23.811873 11614 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "8d620b9db8c34a3dbf47067d0eb77e6d"
format_stamp: "Formatted at 2026-08-11 17:13:23 on dist-test-slave-7vjv"
server_key: "9832f19db816cec98dc6df97e966982f"
server_key_iv: "287ca4e85c2ebdb7eccfd715e4c5bcba"
server_key_version: "encryptionkey@0"
I20260811 17:13:23.816546 11614 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 17:13:23.819231 11642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:13:23.820848 11614 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:13:23.821020 11614 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "8d620b9db8c34a3dbf47067d0eb77e6d"
format_stamp: "Formatted at 2026-08-11 17:13:23 on dist-test-slave-7vjv"
server_key: "9832f19db816cec98dc6df97e966982f"
server_key_iv: "287ca4e85c2ebdb7eccfd715e4c5bcba"
server_key_version: "encryptionkey@0"
I20260811 17:13:23.821157 11614 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:13:23.832911 11614 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:13:23.836740 11614 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:13:23.836989 11614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:13:23.845700 11614 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:36473
I20260811 17:13:23.845774 11735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:36473 every 8 connection(s)
I20260811 17:13:23.846891 11614 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:13:23.848441 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 11614
I20260811 17:13:23.848620 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:13:23.848977 4683 external_mini_cluster.cc:1428] Setting key b218dbb7923ce4e3a7ecf5bdc34cb205
I20260811 17:13:23.850786 11737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:13:23.857366 11737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d620b9db8c34a3dbf47067d0eb77e6d: Bootstrap starting.
I20260811 17:13:23.859054 11744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:23.850523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36577 (local address 127.4.146.254:36473)
0811 17:13:23.850983 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:23.851045 (+ 62us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:23.851130 (+ 85us) server_negotiation.cc:407] Connection header received
0811 17:13:23.851848 (+ 718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:23.851866 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:23.852334 (+ 468us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:23.852649 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:23.853156 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:23.854322 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:23.855356 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:23.855881 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:23.856122 (+ 241us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:23.857184 (+ 1062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:23.857189 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:23.857203 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:13:23.857687 (+ 484us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:23.857749 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:13:23.857774 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:23.857929 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:23.858135 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 17:13:23.858290 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":162,"threads_started":1}
I20260811 17:13:23.860177 11737 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d620b9db8c34a3dbf47067d0eb77e6d: Neither blocks nor log segments found. Creating new log.
I20260811 17:13:23.861066 11737 log.cc:824] T 00000000000000000000000000000000 P 8d620b9db8c34a3dbf47067d0eb77e6d: Log is configured to *not* fsync() on all Append() calls
I20260811 17:13:23.862413 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:13:23.863447 11737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d620b9db8c34a3dbf47067d0eb77e6d: No bootstrap required, opened a new log
I20260811 17:13:23.867705 11737 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d620b9db8c34a3dbf47067d0eb77e6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d620b9db8c34a3dbf47067d0eb77e6d" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 36473 } }
I20260811 17:13:23.868009 11737 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8d620b9db8c34a3dbf47067d0eb77e6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:13:23.868132 11737 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d620b9db8c34a3dbf47067d0eb77e6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d620b9db8c34a3dbf47067d0eb77e6d, State: Initialized, Role: FOLLOWER
I20260811 17:13:23.868677 11737 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d620b9db8c34a3dbf47067d0eb77e6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d620b9db8c34a3dbf47067d0eb77e6d" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 36473 } }
I20260811 17:13:23.868860 11744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:23.864646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46185 (local address 127.4.146.254:36473)
0811 17:13:23.864782 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:23.864786 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:23.865019 (+ 233us) server_negotiation.cc:407] Connection header received
0811 17:13:23.865185 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:23.865189 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:23.865237 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:23.865321 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:23.865607 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:23.866134 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:23.866985 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:23.867233 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:23.867350 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:23.868337 (+ 987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:23.868345 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:23.868348 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:13:23.868360 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:23.868386 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:13:23.868396 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:23.868499 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:23.868657 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 17:13:23.868709 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 17:13:23.869004 11737 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8d620b9db8c34a3dbf47067d0eb77e6d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:13:23.869104 11737 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d620b9db8c34a3dbf47067d0eb77e6d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:13:23.869223 11737 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d620b9db8c34a3dbf47067d0eb77e6d [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:13:23.870553 11737 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d620b9db8c34a3dbf47067d0eb77e6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d620b9db8c34a3dbf47067d0eb77e6d" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 36473 } }
I20260811 17:13:23.870975 11737 leader_election.cc:302] T 00000000000000000000000000000000 P 8d620b9db8c34a3dbf47067d0eb77e6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d620b9db8c34a3dbf47067d0eb77e6d; no voters:
I20260811 17:13:23.871354 11737 leader_election.cc:288] T 00000000000000000000000000000000 P 8d620b9db8c34a3dbf47067d0eb77e6d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:13:23.871462 11756 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d620b9db8c34a3dbf47067d0eb77e6d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:13:23.871786 11756 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8d620b9db8c34a3dbf47067d0eb77e6d [term 1 LEADER]: Becoming Leader. State: Replica: 8d620b9db8c34a3dbf47067d0eb77e6d, State: Running, Role: LEADER
I20260811 17:13:23.872217 11756 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d620b9db8c34a3dbf47067d0eb77e6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d620b9db8c34a3dbf47067d0eb77e6d" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 36473 } }
I20260811 17:13:23.872915 11737 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d620b9db8c34a3dbf47067d0eb77e6d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:13:23.874404 11757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d620b9db8c34a3dbf47067d0eb77e6d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d620b9db8c34a3dbf47067d0eb77e6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d620b9db8c34a3dbf47067d0eb77e6d" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 36473 } } }
I20260811 17:13:23.874564 11757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d620b9db8c34a3dbf47067d0eb77e6d [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:23.875200 11758 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d620b9db8c34a3dbf47067d0eb77e6d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d620b9db8c34a3dbf47067d0eb77e6d. Latest consensus state: current_term: 1 leader_uuid: "8d620b9db8c34a3dbf47067d0eb77e6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d620b9db8c34a3dbf47067d0eb77e6d" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 36473 } } }
I20260811 17:13:23.875306 11758 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d620b9db8c34a3dbf47067d0eb77e6d [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:23.875818 11768 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:13:23.878728 11768 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:13:23.885425 11768 catalog_manager.cc:1347] Generated new cluster ID: 7de9e58314ad47c2971fe44222824cd3
I20260811 17:13:23.885529 11768 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:13:23.892558 11768 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:13:23.893994 11768 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:13:23.899613 11768 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8d620b9db8c34a3dbf47067d0eb77e6d: Generated new TSK 0
I20260811 17:13:23.900440 11768 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:13:23.911139 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 11614
W20260811 17:13:23.921644 11584 connection.cc:535] client connection to 127.4.146.254:36473 recv error: Network error: failed to read from TLS socket (remote: 127.4.146.254:36473): Connection reset by peer (error 104)
2026-08-11T17:13:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1782 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:13:23 dist-test-slave-7vjv krb5kdc[11785](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:13:23 dist-test-slave-7vjv krb5kdc[11785](info): set up 2 sockets
Aug 11 17:13:23 dist-test-slave-7vjv krb5kdc[11785](info): commencing operation
krb5kdc: starting...
W20260811 17:13:25.259781 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.323s user 0.003s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:13:25 dist-test-slave-7vjv krb5kdc[11785](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468405, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:13:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:13:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:13:25.404709 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:46131
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:37389
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:46131
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:13:25.532618 11805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:13:25.532945 11805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:13:25.532998 11805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:13:25.537827 11805 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:13:25.537923 11805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:13:25.537946 11805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:13:25.537966 11805 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:13:25.537983 11805 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:13:25.544225 11805 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:37389
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:46131
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:46131
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11805
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:13:25.545430 11805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:13:25.546502 11805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:13:25.555751 11815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:25.555751 11819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:25.555794 11813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:25.556006 11805 server_base.cc:1034] running on GCE node
I20260811 17:13:25.556803 11805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:13:25.558012 11805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:13:25.559233 11805 hybrid_clock.cc:648] HybridClock initialized: now 1786468405559216 us; error 31 us; skew 500 ppm
Aug 11 17:13:25 dist-test-slave-7vjv krb5kdc[11785](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468405, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:13:25.562569 11805 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:13:25.563611 11805 webserver.cc:460] Webserver started at http://127.4.146.254:35611/ using document root <none> and password file <none>
I20260811 17:13:25.564320 11805 fs_manager.cc:359] Metadata directory not provided
I20260811 17:13:25.564426 11805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:13:25.564697 11805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:13:25.566965 11805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "516c9665ef064d12b2bd36d61c2a5fb2"
format_stamp: "Formatted at 2026-08-11 17:13:25 on dist-test-slave-7vjv"
server_key: "7913758abc5c6cd76a54ddc348bcca3d"
server_key_iv: "2a2ccdf1207838da75b464a3602012f2"
server_key_version: "encryptionkey@0"
I20260811 17:13:25.567624 11805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "516c9665ef064d12b2bd36d61c2a5fb2"
format_stamp: "Formatted at 2026-08-11 17:13:25 on dist-test-slave-7vjv"
server_key: "7913758abc5c6cd76a54ddc348bcca3d"
server_key_iv: "2a2ccdf1207838da75b464a3602012f2"
server_key_version: "encryptionkey@0"
I20260811 17:13:25.572055 11805 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20260811 17:13:25.574851 11828 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:13:25.576299 11805 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:13:25.576457 11805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "516c9665ef064d12b2bd36d61c2a5fb2"
format_stamp: "Formatted at 2026-08-11 17:13:25 on dist-test-slave-7vjv"
server_key: "7913758abc5c6cd76a54ddc348bcca3d"
server_key_iv: "2a2ccdf1207838da75b464a3602012f2"
server_key_version: "encryptionkey@0"
I20260811 17:13:25.576588 11805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:13:25.581568 11805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:13:25.585240 11805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:13:25.585479 11805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:13:25.593502 11805 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:46131
I20260811 17:13:25.593591 11914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:46131 every 8 connection(s)
I20260811 17:13:25.594636 11805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:13:25.597844 11915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:13:25.603493 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 11805
I20260811 17:13:25.603658 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:13:25.603726 11915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 516c9665ef064d12b2bd36d61c2a5fb2: Bootstrap starting.
I20260811 17:13:25.603976 4683 external_mini_cluster.cc:1428] Setting key 53395fa0967646fd407ef7e96296e017
I20260811 17:13:25.606730 11915 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 516c9665ef064d12b2bd36d61c2a5fb2: Neither blocks nor log segments found. Creating new log.
I20260811 17:13:25.607630 11915 log.cc:824] T 00000000000000000000000000000000 P 516c9665ef064d12b2bd36d61c2a5fb2: Log is configured to *not* fsync() on all Append() calls
I20260811 17:13:25.609905 11919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:25.605531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49399 (local address 127.4.146.254:46131)
0811 17:13:25.606017 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:25.606064 (+ 47us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:25.606103 (+ 39us) server_negotiation.cc:407] Connection header received
0811 17:13:25.606769 (+ 666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:25.606787 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:25.607159 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:25.607456 (+ 297us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:25.608603 (+ 1147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:25.608608 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:25.608620 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:13:25.608632 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:25.608688 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:13:25.608708 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:25.608802 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:25.608971 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 17:13:25.609134 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":152,"threads_started":1}
I20260811 17:13:25.609999 11915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 516c9665ef064d12b2bd36d61c2a5fb2: No bootstrap required, opened a new log
I20260811 17:13:25.613042 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:13:25.614209 11915 raft_consensus.cc:348] T 00000000000000000000000000000000 P 516c9665ef064d12b2bd36d61c2a5fb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "516c9665ef064d12b2bd36d61c2a5fb2" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 46131 } }
I20260811 17:13:25.614612 11915 raft_consensus.cc:374] T 00000000000000000000000000000000 P 516c9665ef064d12b2bd36d61c2a5fb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:13:25.614714 11915 raft_consensus.cc:729] T 00000000000000000000000000000000 P 516c9665ef064d12b2bd36d61c2a5fb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 516c9665ef064d12b2bd36d61c2a5fb2, State: Initialized, Role: FOLLOWER
I20260811 17:13:25.615227 11915 consensus_queue.cc:260] T 00000000000000000000000000000000 P 516c9665ef064d12b2bd36d61c2a5fb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "516c9665ef064d12b2bd36d61c2a5fb2" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 46131 } }
I20260811 17:13:25.615442 11915 raft_consensus.cc:388] T 00000000000000000000000000000000 P 516c9665ef064d12b2bd36d61c2a5fb2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:13:25.615772 11915 raft_consensus.cc:482] T 00000000000000000000000000000000 P 516c9665ef064d12b2bd36d61c2a5fb2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:13:25.615953 11915 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 516c9665ef064d12b2bd36d61c2a5fb2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:13:25.617131 11915 raft_consensus.cc:504] T 00000000000000000000000000000000 P 516c9665ef064d12b2bd36d61c2a5fb2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "516c9665ef064d12b2bd36d61c2a5fb2" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 46131 } }
I20260811 17:13:25.617544 11915 leader_election.cc:302] T 00000000000000000000000000000000 P 516c9665ef064d12b2bd36d61c2a5fb2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 516c9665ef064d12b2bd36d61c2a5fb2; no voters:
I20260811 17:13:25.617691 11919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:25.615573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53423 (local address 127.4.146.254:46131)
0811 17:13:25.615795 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:25.615801 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:25.615989 (+ 188us) server_negotiation.cc:407] Connection header received
0811 17:13:25.616223 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:25.616226 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:25.616276 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:25.616380 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:25.617257 (+ 877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:25.617262 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:25.617264 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:13:25.617280 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:25.617317 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:13:25.617330 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:25.617421 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:25.617501 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 17:13:25.617549 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 17:13:25.618024 11915 leader_election.cc:288] T 00000000000000000000000000000000 P 516c9665ef064d12b2bd36d61c2a5fb2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:13:25.618072 11937 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 516c9665ef064d12b2bd36d61c2a5fb2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:13:25.618358 11937 raft_consensus.cc:686] T 00000000000000000000000000000000 P 516c9665ef064d12b2bd36d61c2a5fb2 [term 1 LEADER]: Becoming Leader. State: Replica: 516c9665ef064d12b2bd36d61c2a5fb2, State: Running, Role: LEADER
I20260811 17:13:25.618763 11937 consensus_queue.cc:237] T 00000000000000000000000000000000 P 516c9665ef064d12b2bd36d61c2a5fb2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "516c9665ef064d12b2bd36d61c2a5fb2" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 46131 } }
I20260811 17:13:25.619582 11915 sys_catalog.cc:564] T 00000000000000000000000000000000 P 516c9665ef064d12b2bd36d61c2a5fb2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:13:25.620240 11937 sys_catalog.cc:455] T 00000000000000000000000000000000 P 516c9665ef064d12b2bd36d61c2a5fb2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "516c9665ef064d12b2bd36d61c2a5fb2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "516c9665ef064d12b2bd36d61c2a5fb2" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 46131 } } }
I20260811 17:13:25.620450 11937 sys_catalog.cc:458] T 00000000000000000000000000000000 P 516c9665ef064d12b2bd36d61c2a5fb2 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:25.620679 11939 sys_catalog.cc:455] T 00000000000000000000000000000000 P 516c9665ef064d12b2bd36d61c2a5fb2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 516c9665ef064d12b2bd36d61c2a5fb2. Latest consensus state: current_term: 1 leader_uuid: "516c9665ef064d12b2bd36d61c2a5fb2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "516c9665ef064d12b2bd36d61c2a5fb2" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 46131 } } }
I20260811 17:13:25.620832 11939 sys_catalog.cc:458] T 00000000000000000000000000000000 P 516c9665ef064d12b2bd36d61c2a5fb2 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:25.621006 11948 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:13:25.624508 11948 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:13:25.631217 11948 catalog_manager.cc:1347] Generated new cluster ID: 08eacd27609945739c017c0fe2fc4025
I20260811 17:13:25.631320 11948 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:13:25.653537 11948 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:13:25.653963 11948 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:13:25.662319 11948 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 516c9665ef064d12b2bd36d61c2a5fb2: Generated new TSK 0
I20260811 17:13:25.663266 11948 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:13:25.674914 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 11805
2026-08-11T17:13:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1767 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:13:25 dist-test-slave-7vjv krb5kdc[11975](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:13:25 dist-test-slave-7vjv krb5kdc[11975](info): set up 2 sockets
Aug 11 17:13:25 dist-test-slave-7vjv krb5kdc[11975](info): commencing operation
krb5kdc: starting...
W20260811 17:13:27.049149 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.345s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:13:27 dist-test-slave-7vjv krb5kdc[11975](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:13:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:13:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:13:27.193707 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:42581
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:33741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:42581
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:13:27.317507 11997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:13:27.317875 11997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:13:27.317972 11997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:13:27.322297 11997 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:13:27.322427 11997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:13:27.322466 11997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:13:27.322510 11997 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:13:27.322551 11997 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:13:27.328344 11997 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:33741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:42581
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:42581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:13:27.329655 11997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:13:27.330791 11997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:13:27.340812 12007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:27.340983 11997 server_base.cc:1034] running on GCE node
W20260811 17:13:27.340845 12013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:27.341181 12009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:27.341861 11997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:13:27.343117 11997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:13:27.344308 11997 hybrid_clock.cc:648] HybridClock initialized: now 1786468407344288 us; error 34 us; skew 500 ppm
Aug 11 17:13:27 dist-test-slave-7vjv krb5kdc[11975](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468407, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:13:27.347316 11997 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:13:27.348392 11997 webserver.cc:460] Webserver started at http://127.4.146.254:34257/ using document root <none> and password file <none>
I20260811 17:13:27.348963 11997 fs_manager.cc:359] Metadata directory not provided
I20260811 17:13:27.349027 11997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:13:27.349221 11997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:13:27.351372 11997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "a109834b720745d2a635e38321daf9a5"
format_stamp: "Formatted at 2026-08-11 17:13:27 on dist-test-slave-7vjv"
server_key: "790145cc6360d9dee4c7945cc6f17d28"
server_key_iv: "01ef253874cf58fa4e92d0d4fd5f3ff2"
server_key_version: "encryptionkey@0"
I20260811 17:13:27.352012 11997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "a109834b720745d2a635e38321daf9a5"
format_stamp: "Formatted at 2026-08-11 17:13:27 on dist-test-slave-7vjv"
server_key: "790145cc6360d9dee4c7945cc6f17d28"
server_key_iv: "01ef253874cf58fa4e92d0d4fd5f3ff2"
server_key_version: "encryptionkey@0"
I20260811 17:13:27.356374 11997 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 17:13:27.359527 12022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:13:27.361194 11997 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:13:27.361384 11997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "a109834b720745d2a635e38321daf9a5"
format_stamp: "Formatted at 2026-08-11 17:13:27 on dist-test-slave-7vjv"
server_key: "790145cc6360d9dee4c7945cc6f17d28"
server_key_iv: "01ef253874cf58fa4e92d0d4fd5f3ff2"
server_key_version: "encryptionkey@0"
I20260811 17:13:27.361533 11997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:13:27.377717 11997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:13:27.381771 11997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:13:27.382050 11997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:13:27.390414 11997 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:42581
I20260811 17:13:27.390444 12116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:42581 every 8 connection(s)
I20260811 17:13:27.391580 11997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:13:27.392866 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 11997
I20260811 17:13:27.393098 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:13:27.393443 4683 external_mini_cluster.cc:1428] Setting key 532b6fe6494af3f4ceedbe76ecdb5702
I20260811 17:13:27.395390 12117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:13:27.402256 12117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a109834b720745d2a635e38321daf9a5: Bootstrap starting.
Aug 11 17:13:27 dist-test-slave-7vjv krb5kdc[11975](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:13:27.405197 12117 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a109834b720745d2a635e38321daf9a5: Neither blocks nor log segments found. Creating new log.
I20260811 17:13:27.406107 12117 log.cc:824] T 00000000000000000000000000000000 P a109834b720745d2a635e38321daf9a5: Log is configured to *not* fsync() on all Append() calls
I20260811 17:13:27.409178 12117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a109834b720745d2a635e38321daf9a5: No bootstrap required, opened a new log
I20260811 17:13:27.409930 12122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:27.395138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35159 (local address 127.4.146.254:42581)
0811 17:13:27.395717 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:27.395736 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:27.395777 (+ 41us) server_negotiation.cc:407] Connection header received
0811 17:13:27.396681 (+ 904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:27.396705 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:27.397098 (+ 393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:27.397488 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:27.398399 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:27.399461 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:27.400456 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:27.400971 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:27.401153 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:27.404218 (+ 3065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:27.404223 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:27.404238 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:27.404274 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:27.406345 (+ 2071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:27.406944 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:27.406951 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:27.406959 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:27.407138 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:27.407608 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:27.407611 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:27.407612 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:27.408152 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:27.408350 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:27.408717 (+ 367us) server_negotiation.cc:299] Negotiation successful
0811 17:13:27.409067 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":170,"threads_started":1}
I20260811 17:13:27.413231 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:13:27.413717 12117 raft_consensus.cc:348] T 00000000000000000000000000000000 P a109834b720745d2a635e38321daf9a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a109834b720745d2a635e38321daf9a5" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42581 } }
I20260811 17:13:27.414086 12117 raft_consensus.cc:374] T 00000000000000000000000000000000 P a109834b720745d2a635e38321daf9a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:13:27.414150 12117 raft_consensus.cc:729] T 00000000000000000000000000000000 P a109834b720745d2a635e38321daf9a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a109834b720745d2a635e38321daf9a5, State: Initialized, Role: FOLLOWER
I20260811 17:13:27.414729 12117 consensus_queue.cc:260] T 00000000000000000000000000000000 P a109834b720745d2a635e38321daf9a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a109834b720745d2a635e38321daf9a5" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42581 } }
I20260811 17:13:27.414950 12117 raft_consensus.cc:388] T 00000000000000000000000000000000 P a109834b720745d2a635e38321daf9a5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:13:27.415040 12117 raft_consensus.cc:482] T 00000000000000000000000000000000 P a109834b720745d2a635e38321daf9a5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:13:27.415166 12117 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a109834b720745d2a635e38321daf9a5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:13:27.416766 12117 raft_consensus.cc:504] T 00000000000000000000000000000000 P a109834b720745d2a635e38321daf9a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a109834b720745d2a635e38321daf9a5" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42581 } }
I20260811 17:13:27.417259 12117 leader_election.cc:302] T 00000000000000000000000000000000 P a109834b720745d2a635e38321daf9a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a109834b720745d2a635e38321daf9a5; no voters:
I20260811 17:13:27.417725 12117 leader_election.cc:288] T 00000000000000000000000000000000 P a109834b720745d2a635e38321daf9a5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:13:27.417830 12131 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a109834b720745d2a635e38321daf9a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:13:27.418085 12131 raft_consensus.cc:686] T 00000000000000000000000000000000 P a109834b720745d2a635e38321daf9a5 [term 1 LEADER]: Becoming Leader. State: Replica: a109834b720745d2a635e38321daf9a5, State: Running, Role: LEADER
I20260811 17:13:27.418427 12131 consensus_queue.cc:237] T 00000000000000000000000000000000 P a109834b720745d2a635e38321daf9a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a109834b720745d2a635e38321daf9a5" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42581 } }
I20260811 17:13:27.419312 12117 sys_catalog.cc:564] T 00000000000000000000000000000000 P a109834b720745d2a635e38321daf9a5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:13:27.420459 12136 sys_catalog.cc:455] T 00000000000000000000000000000000 P a109834b720745d2a635e38321daf9a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a109834b720745d2a635e38321daf9a5. Latest consensus state: current_term: 1 leader_uuid: "a109834b720745d2a635e38321daf9a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a109834b720745d2a635e38321daf9a5" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42581 } } }
I20260811 17:13:27.420459 12133 sys_catalog.cc:455] T 00000000000000000000000000000000 P a109834b720745d2a635e38321daf9a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a109834b720745d2a635e38321daf9a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a109834b720745d2a635e38321daf9a5" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 42581 } } }
I20260811 17:13:27.420640 12136 sys_catalog.cc:458] T 00000000000000000000000000000000 P a109834b720745d2a635e38321daf9a5 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:27.420640 12133 sys_catalog.cc:458] T 00000000000000000000000000000000 P a109834b720745d2a635e38321daf9a5 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:27.421095 12152 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:13:27.424680 12152 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:13:27.427559 12122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:27.415913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43735 (local address 127.4.146.254:42581)
0811 17:13:27.416112 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:27.416117 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:27.416412 (+ 295us) server_negotiation.cc:407] Connection header received
0811 17:13:27.416547 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:27.416550 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:27.416601 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:27.416673 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:27.417651 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:27.418552 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:27.419900 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:27.420390 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:27.420528 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:27.422911 (+ 2383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:27.422915 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:27.422918 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:27.422951 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:27.425054 (+ 2103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:27.425917 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:27.425922 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:27.425923 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:27.426047 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:27.426444 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:27.426448 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:27.426450 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:27.426724 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:27.426883 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:27.427215 (+ 332us) server_negotiation.cc:299] Negotiation successful
0811 17:13:27.427370 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 17:13:27.431627 12152 catalog_manager.cc:1347] Generated new cluster ID: 6120cccbe45c46c7a49e5f9be1f82cb9
I20260811 17:13:27.431708 12152 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:13:27.444841 12152 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:13:27.446221 12152 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:13:27.455866 12152 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a109834b720745d2a635e38321daf9a5: Generated new TSK 0
I20260811 17:13:27.456794 12152 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:13:27.463935 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 11997
2026-08-11T17:13:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1787 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:13:27 dist-test-slave-7vjv krb5kdc[12172](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:13:27 dist-test-slave-7vjv krb5kdc[12172](info): set up 2 sockets
Aug 11 17:13:27 dist-test-slave-7vjv krb5kdc[12172](info): commencing operation
krb5kdc: starting...
W20260811 17:13:28.819654 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.328s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:13:28 dist-test-slave-7vjv krb5kdc[12172](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468408, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:13:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:13:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:13:28.967692 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:40787
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:46567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:40787
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:13:29.089161 12197 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:13:29.089535 12197 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:13:29.089634 12197 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:13:29.094053 12197 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:13:29.094169 12197 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:13:29.094208 12197 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:13:29.094266 12197 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:13:29.094305 12197 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:13:29.100028 12197 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:46567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:40787
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:40787
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12197
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:13:29.101235 12197 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:13:29.102324 12197 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:13:29.111941 12208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:29.112078 12197 server_base.cc:1034] running on GCE node
W20260811 17:13:29.111830 12211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:29.111832 12209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:29.112999 12197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:13:29.114224 12197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:13:29.115435 12197 hybrid_clock.cc:648] HybridClock initialized: now 1786468409115403 us; error 39 us; skew 500 ppm
Aug 11 17:13:29 dist-test-slave-7vjv krb5kdc[12172](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468409, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:13:29.122100 12197 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:13:29.123270 12197 webserver.cc:460] Webserver started at http://127.4.146.254:38205/ using document root <none> and password file <none>
I20260811 17:13:29.123895 12197 fs_manager.cc:359] Metadata directory not provided
I20260811 17:13:29.124003 12197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:13:29.124325 12197 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:13:29.126575 12197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "233cbea788254ae7a64256462ddf04e4"
format_stamp: "Formatted at 2026-08-11 17:13:29 on dist-test-slave-7vjv"
server_key: "752c307bec4dae9cd7559b211a3a410b"
server_key_iv: "c6a3bd17a33aed10877450d8eae74d83"
server_key_version: "encryptionkey@0"
I20260811 17:13:29.127192 12197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "233cbea788254ae7a64256462ddf04e4"
format_stamp: "Formatted at 2026-08-11 17:13:29 on dist-test-slave-7vjv"
server_key: "752c307bec4dae9cd7559b211a3a410b"
server_key_iv: "c6a3bd17a33aed10877450d8eae74d83"
server_key_version: "encryptionkey@0"
I20260811 17:13:29.131341 12197 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260811 17:13:29.134184 12225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:13:29.135514 12197 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 17:13:29.135685 12197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "233cbea788254ae7a64256462ddf04e4"
format_stamp: "Formatted at 2026-08-11 17:13:29 on dist-test-slave-7vjv"
server_key: "752c307bec4dae9cd7559b211a3a410b"
server_key_iv: "c6a3bd17a33aed10877450d8eae74d83"
server_key_version: "encryptionkey@0"
I20260811 17:13:29.135809 12197 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:13:29.158203 12197 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:13:29.161695 12197 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:13:29.161924 12197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:13:29.169790 12197 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:40787
I20260811 17:13:29.169821 12321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:40787 every 8 connection(s)
I20260811 17:13:29.170854 12197 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:13:29.173808 12323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:13:29.176666 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 12197
I20260811 17:13:29.176841 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:13:29.177256 4683 external_mini_cluster.cc:1428] Setting key 5f061a51c66784b6fd7fb10b30106b21
I20260811 17:13:29.180629 12323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 233cbea788254ae7a64256462ddf04e4: Bootstrap starting.
I20260811 17:13:29.182926 12323 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 233cbea788254ae7a64256462ddf04e4: Neither blocks nor log segments found. Creating new log.
I20260811 17:13:29.183851 12323 log.cc:824] T 00000000000000000000000000000000 P 233cbea788254ae7a64256462ddf04e4: Log is configured to *not* fsync() on all Append() calls
I20260811 17:13:29.186226 12323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 233cbea788254ae7a64256462ddf04e4: No bootstrap required, opened a new log
I20260811 17:13:29.186882 12333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:29.178840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49169 (local address 127.4.146.254:40787)
0811 17:13:29.179305 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:29.179322 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:29.179359 (+ 37us) server_negotiation.cc:407] Connection header received
0811 17:13:29.180020 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:29.180039 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:29.180435 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:29.180791 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:29.181233 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:29.182227 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:29.183199 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:29.183691 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:29.183963 (+ 272us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:29.184936 (+ 973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:29.184941 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:29.184955 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:13:29.185361 (+ 406us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:29.185421 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:13:29.185444 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:29.185524 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:29.185699 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 17:13:29.185929 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":142,"threads_started":1}
I20260811 17:13:29.190445 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:13:29.190903 12323 raft_consensus.cc:348] T 00000000000000000000000000000000 P 233cbea788254ae7a64256462ddf04e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233cbea788254ae7a64256462ddf04e4" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40787 } }
I20260811 17:13:29.191133 12323 raft_consensus.cc:374] T 00000000000000000000000000000000 P 233cbea788254ae7a64256462ddf04e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:13:29.191195 12323 raft_consensus.cc:729] T 00000000000000000000000000000000 P 233cbea788254ae7a64256462ddf04e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 233cbea788254ae7a64256462ddf04e4, State: Initialized, Role: FOLLOWER
I20260811 17:13:29.191671 12323 consensus_queue.cc:260] T 00000000000000000000000000000000 P 233cbea788254ae7a64256462ddf04e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233cbea788254ae7a64256462ddf04e4" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40787 } }
I20260811 17:13:29.191854 12323 raft_consensus.cc:388] T 00000000000000000000000000000000 P 233cbea788254ae7a64256462ddf04e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:13:29.191952 12323 raft_consensus.cc:482] T 00000000000000000000000000000000 P 233cbea788254ae7a64256462ddf04e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:13:29.192077 12323 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 233cbea788254ae7a64256462ddf04e4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:13:29.193518 12323 raft_consensus.cc:504] T 00000000000000000000000000000000 P 233cbea788254ae7a64256462ddf04e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233cbea788254ae7a64256462ddf04e4" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40787 } }
I20260811 17:13:29.193938 12323 leader_election.cc:302] T 00000000000000000000000000000000 P 233cbea788254ae7a64256462ddf04e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 233cbea788254ae7a64256462ddf04e4; no voters:
I20260811 17:13:29.194276 12323 leader_election.cc:288] T 00000000000000000000000000000000 P 233cbea788254ae7a64256462ddf04e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:13:29.194391 12346 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 233cbea788254ae7a64256462ddf04e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:13:29.194618 12346 raft_consensus.cc:686] T 00000000000000000000000000000000 P 233cbea788254ae7a64256462ddf04e4 [term 1 LEADER]: Becoming Leader. State: Replica: 233cbea788254ae7a64256462ddf04e4, State: Running, Role: LEADER
I20260811 17:13:29.194934 12346 consensus_queue.cc:237] T 00000000000000000000000000000000 P 233cbea788254ae7a64256462ddf04e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233cbea788254ae7a64256462ddf04e4" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40787 } }
I20260811 17:13:29.195652 12323 sys_catalog.cc:564] T 00000000000000000000000000000000 P 233cbea788254ae7a64256462ddf04e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:13:29.196687 12348 sys_catalog.cc:455] T 00000000000000000000000000000000 P 233cbea788254ae7a64256462ddf04e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "233cbea788254ae7a64256462ddf04e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233cbea788254ae7a64256462ddf04e4" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40787 } } }
I20260811 17:13:29.196854 12348 sys_catalog.cc:458] T 00000000000000000000000000000000 P 233cbea788254ae7a64256462ddf04e4 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:29.197250 12351 sys_catalog.cc:455] T 00000000000000000000000000000000 P 233cbea788254ae7a64256462ddf04e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 233cbea788254ae7a64256462ddf04e4. Latest consensus state: current_term: 1 leader_uuid: "233cbea788254ae7a64256462ddf04e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "233cbea788254ae7a64256462ddf04e4" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 40787 } } }
I20260811 17:13:29.197362 12351 sys_catalog.cc:458] T 00000000000000000000000000000000 P 233cbea788254ae7a64256462ddf04e4 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:29.197692 12362 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:13:29.197924 12333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:29.192789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41959 (local address 127.4.146.254:40787)
0811 17:13:29.192904 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:29.192907 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:29.193138 (+ 231us) server_negotiation.cc:407] Connection header received
0811 17:13:29.193265 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:29.193267 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:29.193306 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:29.193373 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:29.193741 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:29.194515 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:29.195613 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:29.195955 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:29.196067 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:29.197224 (+ 1157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:29.197230 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:29.197233 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:13:29.197248 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:29.197279 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:13:29.197293 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:29.197362 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:29.197725 (+ 363us) server_negotiation.cc:299] Negotiation successful
0811 17:13:29.197789 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 17:13:29.201206 12362 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:13:29.207501 12362 catalog_manager.cc:1347] Generated new cluster ID: 54996e7808d4477c9b35b7bdc25e4336
I20260811 17:13:29.207612 12362 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:13:29.247252 12362 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:13:29.248567 12362 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:13:29.256844 12362 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 233cbea788254ae7a64256462ddf04e4: Generated new TSK 0
I20260811 17:13:29.257613 12362 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:13:29.273005 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 12197
2026-08-11T17:13:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1819 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:13:29 dist-test-slave-7vjv krb5kdc[12382](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:13:29 dist-test-slave-7vjv krb5kdc[12382](info): set up 2 sockets
Aug 11 17:13:29 dist-test-slave-7vjv krb5kdc[12382](info): commencing operation
krb5kdc: starting...
W20260811 17:13:30.634927 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.323s user 0.005s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:13:30 dist-test-slave-7vjv krb5kdc[12382](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:13:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:13:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:13:30.787722 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:35775
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:38871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:35775
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:13:30.915861 12410 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:13:30.916319 12410 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:13:30.916416 12410 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:13:30.920713 12410 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:13:30.920833 12410 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:13:30.920871 12410 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:13:30.920912 12410 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:13:30.920945 12410 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:13:30.926750 12410 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:38871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:35775
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:35775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12410
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:13:30.928025 12410 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:13:30.929162 12410 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:13:30.938521 12421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:30.938521 12424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:30.938525 12420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:30.938865 12410 server_base.cc:1034] running on GCE node
I20260811 17:13:30.939544 12410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:13:30.940891 12410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:13:30.942113 12410 hybrid_clock.cc:648] HybridClock initialized: now 1786468410942091 us; error 34 us; skew 500 ppm
Aug 11 17:13:30 dist-test-slave-7vjv krb5kdc[12382](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468410, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:13:30.945559 12410 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:13:30.946679 12410 webserver.cc:460] Webserver started at http://127.4.146.254:41059/ using document root <none> and password file <none>
I20260811 17:13:30.947271 12410 fs_manager.cc:359] Metadata directory not provided
I20260811 17:13:30.947355 12410 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:13:30.947558 12410 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:13:30.949928 12410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "806289eb77ff46f8b89dbaaa870d6322"
format_stamp: "Formatted at 2026-08-11 17:13:30 on dist-test-slave-7vjv"
server_key: "4b10f649e2e31639ccb252b7bbbc36ed"
server_key_iv: "7944afd91939b5bcf2e9bf50c2677133"
server_key_version: "encryptionkey@0"
I20260811 17:13:30.950532 12410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "806289eb77ff46f8b89dbaaa870d6322"
format_stamp: "Formatted at 2026-08-11 17:13:30 on dist-test-slave-7vjv"
server_key: "4b10f649e2e31639ccb252b7bbbc36ed"
server_key_iv: "7944afd91939b5bcf2e9bf50c2677133"
server_key_version: "encryptionkey@0"
I20260811 17:13:30.955024 12410 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 17:13:30.958061 12435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:13:30.959581 12410 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260811 17:13:30.959776 12410 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "806289eb77ff46f8b89dbaaa870d6322"
format_stamp: "Formatted at 2026-08-11 17:13:30 on dist-test-slave-7vjv"
server_key: "4b10f649e2e31639ccb252b7bbbc36ed"
server_key_iv: "7944afd91939b5bcf2e9bf50c2677133"
server_key_version: "encryptionkey@0"
I20260811 17:13:30.959915 12410 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:13:30.965442 12410 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:13:30.969317 12410 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:13:30.969566 12410 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:13:30.977469 12410 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:35775
I20260811 17:13:30.977556 12532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:35775 every 8 connection(s)
I20260811 17:13:30.978557 12410 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:13:30.981799 12533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:13:30.986986 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 12410
I20260811 17:13:30.987124 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:13:30.987437 4683 external_mini_cluster.cc:1428] Setting key 613adc63c8c93c13e698789d91961cc7
I20260811 17:13:30.988792 12533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 806289eb77ff46f8b89dbaaa870d6322: Bootstrap starting.
I20260811 17:13:30.991482 12533 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 806289eb77ff46f8b89dbaaa870d6322: Neither blocks nor log segments found. Creating new log.
I20260811 17:13:30.992619 12533 log.cc:824] T 00000000000000000000000000000000 P 806289eb77ff46f8b89dbaaa870d6322: Log is configured to *not* fsync() on all Append() calls
I20260811 17:13:30.993497 12541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:30.989176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45727 (local address 127.4.146.254:35775)
0811 17:13:30.989651 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:30.989669 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:30.989706 (+ 37us) server_negotiation.cc:407] Connection header received
0811 17:13:30.990406 (+ 700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:30.990425 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:30.990739 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:30.991038 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:30.992016 (+ 978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:30.992023 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:30.992041 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:13:30.992053 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:30.992177 (+ 124us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:13:30.992203 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:30.992291 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:30.992469 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 17:13:30.992683 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":153,"threads_started":1}
I20260811 17:13:30.994946 12533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 806289eb77ff46f8b89dbaaa870d6322: No bootstrap required, opened a new log
I20260811 17:13:30.996744 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:13:30.999639 12533 raft_consensus.cc:348] T 00000000000000000000000000000000 P 806289eb77ff46f8b89dbaaa870d6322 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "806289eb77ff46f8b89dbaaa870d6322" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35775 } }
I20260811 17:13:30.999979 12533 raft_consensus.cc:374] T 00000000000000000000000000000000 P 806289eb77ff46f8b89dbaaa870d6322 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 17:13:31.000063 12533 raft_consensus.cc:729] T 00000000000000000000000000000000 P 806289eb77ff46f8b89dbaaa870d6322 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 806289eb77ff46f8b89dbaaa870d6322, State: Initialized, Role: FOLLOWER
I20260811 17:13:31.000650 12533 consensus_queue.cc:260] T 00000000000000000000000000000000 P 806289eb77ff46f8b89dbaaa870d6322 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "806289eb77ff46f8b89dbaaa870d6322" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35775 } }
I20260811 17:13:31.000982 12541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:30.998987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47355 (local address 127.4.146.254:35775)
0811 17:13:30.999138 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:30.999143 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:30.999333 (+ 190us) server_negotiation.cc:407] Connection header received
0811 17:13:30.999503 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:30.999528 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:30.999563 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:30.999648 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:31.000537 (+ 889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:31.000541 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:31.000544 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 17:13:31.000556 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:31.000591 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 17:13:31.000602 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:31.000696 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:31.000771 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 17:13:31.000815 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 17:13:31.000831 12533 raft_consensus.cc:388] T 00000000000000000000000000000000 P 806289eb77ff46f8b89dbaaa870d6322 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 17:13:31.001194 12533 raft_consensus.cc:482] T 00000000000000000000000000000000 P 806289eb77ff46f8b89dbaaa870d6322 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 17:13:31.001348 12533 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 806289eb77ff46f8b89dbaaa870d6322 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:13:31.002617 12533 raft_consensus.cc:504] T 00000000000000000000000000000000 P 806289eb77ff46f8b89dbaaa870d6322 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "806289eb77ff46f8b89dbaaa870d6322" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35775 } }
I20260811 17:13:31.003051 12533 leader_election.cc:302] T 00000000000000000000000000000000 P 806289eb77ff46f8b89dbaaa870d6322 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 806289eb77ff46f8b89dbaaa870d6322; no voters:
I20260811 17:13:31.003427 12533 leader_election.cc:288] T 00000000000000000000000000000000 P 806289eb77ff46f8b89dbaaa870d6322 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 17:13:31.003571 12549 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 806289eb77ff46f8b89dbaaa870d6322 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:13:31.003846 12549 raft_consensus.cc:686] T 00000000000000000000000000000000 P 806289eb77ff46f8b89dbaaa870d6322 [term 1 LEADER]: Becoming Leader. State: Replica: 806289eb77ff46f8b89dbaaa870d6322, State: Running, Role: LEADER
I20260811 17:13:31.004334 12549 consensus_queue.cc:237] T 00000000000000000000000000000000 P 806289eb77ff46f8b89dbaaa870d6322 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "806289eb77ff46f8b89dbaaa870d6322" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35775 } }
I20260811 17:13:31.004961 12533 sys_catalog.cc:564] T 00000000000000000000000000000000 P 806289eb77ff46f8b89dbaaa870d6322 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:13:31.006208 12552 sys_catalog.cc:455] T 00000000000000000000000000000000 P 806289eb77ff46f8b89dbaaa870d6322 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 806289eb77ff46f8b89dbaaa870d6322. Latest consensus state: current_term: 1 leader_uuid: "806289eb77ff46f8b89dbaaa870d6322" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "806289eb77ff46f8b89dbaaa870d6322" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35775 } } }
I20260811 17:13:31.006379 12552 sys_catalog.cc:458] T 00000000000000000000000000000000 P 806289eb77ff46f8b89dbaaa870d6322 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:31.006827 12570 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:13:31.007340 12551 sys_catalog.cc:455] T 00000000000000000000000000000000 P 806289eb77ff46f8b89dbaaa870d6322 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "806289eb77ff46f8b89dbaaa870d6322" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "806289eb77ff46f8b89dbaaa870d6322" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 35775 } } }
I20260811 17:13:31.007476 12551 sys_catalog.cc:458] T 00000000000000000000000000000000 P 806289eb77ff46f8b89dbaaa870d6322 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:31.010967 12570 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:13:31.017581 12570 catalog_manager.cc:1347] Generated new cluster ID: a01646c0d1bc4b3da2ab8a58a83e333c
I20260811 17:13:31.017689 12570 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:13:31.033178 12570 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:13:31.033605 12570 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:13:31.046151 12570 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 806289eb77ff46f8b89dbaaa870d6322: Generated new TSK 0
I20260811 17:13:31.047187 12570 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 17:13:31.057003 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 12410
2026-08-11T17:13:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1791 ms)
[----------] 18 tests from AuthTokenIssuingTest (32464 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:13:31 dist-test-slave-7vjv krb5kdc[12588](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:13:31 dist-test-slave-7vjv krb5kdc[12588](info): set up 2 sockets
Aug 11 17:13:31 dist-test-slave-7vjv krb5kdc[12588](info): commencing operation
krb5kdc: starting...
W20260811 17:13:32.451095 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.348s user 0.000s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:13:32 dist-test-slave-7vjv krb5kdc[12588](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:13:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:13:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:13:32.600785 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:34785
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:39361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:34785,127.4.146.253:43507,127.4.146.252:41435
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:13:32.722747 12618 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 17:13:32.723109 12618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:13:32.723137 12618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:13:32.723235 12618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:13:32.727598 12618 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:13:32.727696 12618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:13:32.727717 12618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:13:32.727733 12618 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:13:32.727749 12618 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:13:32.733515 12618 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:39361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:34785,127.4.146.253:43507,127.4.146.252:41435
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:34785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12618
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:13:32.734747 12618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:13:32.735853 12618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 17:13:32.745342 12618 server_base.cc:1034] running on GCE node
W20260811 17:13:32.745250 12625 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:32.745250 12627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:32.745256 12632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:32.746155 12618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:13:32.747386 12618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:13:32.748582 12618 hybrid_clock.cc:648] HybridClock initialized: now 1786468412748558 us; error 38 us; skew 500 ppm
Aug 11 17:13:32 dist-test-slave-7vjv krb5kdc[12588](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468412, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:13:32.751693 12618 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:13:32.752763 12618 webserver.cc:460] Webserver started at http://127.4.146.254:42199/ using document root <none> and password file <none>
I20260811 17:13:32.753381 12618 fs_manager.cc:359] Metadata directory not provided
I20260811 17:13:32.753448 12618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:13:32.753672 12618 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:13:32.755800 12618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "ab8ae13f67104ad5b37ef43b5676bc6c"
format_stamp: "Formatted at 2026-08-11 17:13:32 on dist-test-slave-7vjv"
server_key: "2d895e3ce83bddad35056bffefe0d6b7"
server_key_iv: "4174fa9927e73d2c05b2898fe9e234bb"
server_key_version: "encryptionkey@0"
I20260811 17:13:32.756461 12618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "ab8ae13f67104ad5b37ef43b5676bc6c"
format_stamp: "Formatted at 2026-08-11 17:13:32 on dist-test-slave-7vjv"
server_key: "2d895e3ce83bddad35056bffefe0d6b7"
server_key_iv: "4174fa9927e73d2c05b2898fe9e234bb"
server_key_version: "encryptionkey@0"
I20260811 17:13:32.760352 12618 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 17:13:32.763002 12645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:13:32.764426 12618 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:13:32.764588 12618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "ab8ae13f67104ad5b37ef43b5676bc6c"
format_stamp: "Formatted at 2026-08-11 17:13:32 on dist-test-slave-7vjv"
server_key: "2d895e3ce83bddad35056bffefe0d6b7"
server_key_iv: "4174fa9927e73d2c05b2898fe9e234bb"
server_key_version: "encryptionkey@0"
I20260811 17:13:32.764719 12618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:13:32.777456 12618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:13:32.781220 12618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:13:32.781464 12618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:13:32.789655 12618 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:34785
I20260811 17:13:32.789968 12736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:34785 every 8 connection(s)
I20260811 17:13:32.790788 12618 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:13:32.793637 12737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:13:32.797606 12737 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34785 } has no permanent_uuid. Determining permanent_uuid...
I20260811 17:13:32.800145 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 12618
I20260811 17:13:32.800302 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:13:32.800657 4683 external_mini_cluster.cc:1428] Setting key 07a37416c211f7871f2f41d5c5cafc9d
Aug 11 17:13:32 dist-test-slave-7vjv krb5kdc[12588](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468412, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.146.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.253@KRBTEST.COM" created.
I20260811 17:13:32.816963 12743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:32.800189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33074 (local address 127.4.146.254:34785)
0811 17:13:32.800987 (+ 798us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:32.801000 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:32.801050 (+ 50us) server_negotiation.cc:407] Connection header received
0811 17:13:32.802242 (+ 1192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:32.802252 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:32.802542 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:32.802765 (+ 223us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:32.803995 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:32.805105 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:32.806787 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:32.807398 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:32.807544 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:32.810965 (+ 3421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:32.810972 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:32.810985 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:32.811012 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:32.812965 (+ 1953us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:32.813584 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:32.813590 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:32.813591 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:32.813778 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:32.814197 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:32.814204 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:32.814209 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:32.814775 (+ 566us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:32.814936 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:32.816350 (+ 1414us) server_negotiation.cc:299] Negotiation successful
0811 17:13:32.816525 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":650,"spinlock_wait_cycles":37248,"thread_start_us":202,"threads_started":1}
I20260811 17:13:32.816968 12742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:32.800188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34785 (local address 127.0.0.1:33074)
0811 17:13:32.800876 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:32.800935 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 17:13:32.801879 (+ 944us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:13:32.802786 (+ 907us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:13:32.802793 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:13:32.803347 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:13:32.803754 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:32.803778 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:32.805254 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:32.805261 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:32.806624 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:32.806637 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:32.807615 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:32.807622 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:32.807794 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:32.808536 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:13:32.808562 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:13:32.810753 (+ 2191us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:13:32.813132 (+ 2379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:32.813142 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:32.813153 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:32.813420 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:32.813918 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:32.813921 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:32.813923 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:32.814074 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:32.814955 (+ 881us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:13:32.814963 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:13:32.815109 (+ 146us) client_negotiation.cc:769] Sending connection context
0811 17:13:32.815301 (+ 192us) client_negotiation.cc:240] Negotiation successful
0811 17:13:32.815721 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":194,"threads_started":1}
I20260811 17:13:32.819519 12737 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 } has no permanent_uuid. Determining permanent_uuid...
I20260811 17:13:32.820370 12742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:32.820061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:43507 (local address 127.0.0.1:35654)
0811 17:13:32.820216 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:32.820301 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.253:43507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260811 17:13:32.820600 12653 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.146.253:43507: connect: Connection refused (error 111)
I20260811 17:13:32.821578 12742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:32.821366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:43507 (local address 127.0.0.1:35658)
0811 17:13:32.821470 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:32.821524 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.253:43507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260811 17:13:32.821743 12737 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.253:43507: Network error: Client connection negotiation failed: client connection to 127.4.146.253:43507: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.253.keytab.
Entry for principal kudu/127.4.146.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.253.keytab.
I20260811 17:13:32.836345 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.253:43507
--webserver_interface=127.4.146.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.253.keytab
--principal=kudu/127.4.146.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:39361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:34785,127.4.146.253:43507,127.4.146.252:41435
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 17:13:32.870982 12737 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 } attempt: 1
I20260811 17:13:32.871994 12742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:32.871652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:43507 (local address 127.0.0.1:35672)
0811 17:13:32.871838 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:32.871907 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.253:43507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 17:13:32.872885 12742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:32.872632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:43507 (local address 127.0.0.1:35688)
0811 17:13:32.872775 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:32.872825 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.253:43507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260811 17:13:32.873060 12737 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.253:43507: Network error: Client connection negotiation failed: client connection to 127.4.146.253:43507: connect: Connection refused (error 111)
I20260811 17:13:32.941290 12737 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 } attempt: 2
I20260811 17:13:32.942301 12742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:32.941883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:43507 (local address 127.0.0.1:35694)
0811 17:13:32.942121 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:32.942215 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.253:43507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260811 17:13:32.943213 12742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:32.942922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:43507 (local address 127.0.0.1:35696)
0811 17:13:32.943072 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:32.943144 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.253:43507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260811 17:13:32.943444 12737 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.253:43507: Network error: Client connection negotiation failed: client connection to 127.4.146.253:43507: connect: Connection refused (error 111)
W20260811 17:13:32.960281 12751 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 17:13:32.960626 12751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:13:32.960651 12751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:13:32.960750 12751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:13:32.965003 12751 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:13:32.965091 12751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:13:32.965112 12751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:13:32.965130 12751 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:13:32.965147 12751 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:13:32.971067 12751 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:39361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:34785,127.4.146.253:43507,127.4.146.252:41435
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.253.keytab
--principal=kudu/127.4.146.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.253:43507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.4.146.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:13:32.972373 12751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:13:32.973467 12751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:13:32.983099 12763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:32.983268 12764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:32.983103 12768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:32.983537 12751 server_base.cc:1034] running on GCE node
I20260811 17:13:32.984395 12751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:13:32.986258 12751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:13:32.987493 12751 hybrid_clock.cc:648] HybridClock initialized: now 1786468412987467 us; error 40 us; skew 500 ppm
Aug 11 17:13:32 dist-test-slave-7vjv krb5kdc[12588](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468412, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:13:32.993597 12751 init.cc:377] Logged in from keytab as kudu/127.4.146.253@KRBTEST.COM (short username kudu)
I20260811 17:13:32.995117 12751 webserver.cc:460] Webserver started at http://127.4.146.253:34155/ using document root <none> and password file <none>
I20260811 17:13:32.995766 12751 fs_manager.cc:359] Metadata directory not provided
I20260811 17:13:32.995849 12751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:13:32.996049 12751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:13:32.998471 12751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-1/data/instance:
uuid: "08a739b3c711408094e8c761dbfc36ea"
format_stamp: "Formatted at 2026-08-11 17:13:32 on dist-test-slave-7vjv"
server_key: "18dc78722a72586a5f087e05145c0805"
server_key_iv: "38f4f0f1efc9fa27c19afe2caf82c052"
server_key_version: "encryptionkey@0"
I20260811 17:13:32.999115 12751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-1/wal/instance:
uuid: "08a739b3c711408094e8c761dbfc36ea"
format_stamp: "Formatted at 2026-08-11 17:13:32 on dist-test-slave-7vjv"
server_key: "18dc78722a72586a5f087e05145c0805"
server_key_iv: "38f4f0f1efc9fa27c19afe2caf82c052"
server_key_version: "encryptionkey@0"
I20260811 17:13:33.005131 12751 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260811 17:13:33.009276 12781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:13:33.011044 12751 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260811 17:13:33.011198 12751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-1/wal
uuid: "08a739b3c711408094e8c761dbfc36ea"
format_stamp: "Formatted at 2026-08-11 17:13:32 on dist-test-slave-7vjv"
server_key: "18dc78722a72586a5f087e05145c0805"
server_key_iv: "38f4f0f1efc9fa27c19afe2caf82c052"
server_key_version: "encryptionkey@0"
I20260811 17:13:33.011451 12751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:13:33.030398 12751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:13:33.034420 12751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:13:33.034669 12751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:13:33.034664 12737 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 } attempt: 3
I20260811 17:13:33.035650 12742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.035257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:43507 (local address 127.0.0.1:35704)
0811 17:13:33.035485 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:33.035567 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.253:43507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260811 17:13:33.036595 12742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.036305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:43507 (local address 127.0.0.1:35714)
0811 17:13:33.036449 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:33.036509 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.253:43507: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 17:13:33.036770 12737 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.253:43507: Network error: Client connection negotiation failed: client connection to 127.4.146.253:43507: connect: Connection refused (error 111)
I20260811 17:13:33.044866 12751 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.253:43507
I20260811 17:13:33.045193 12870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.253:43507 every 8 connection(s)
I20260811 17:13:33.046011 12751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-1/data/info.pb
I20260811 17:13:33.049325 12871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:13:33.054033 12871 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34785 } has no permanent_uuid. Determining permanent_uuid...
I20260811 17:13:33.056142 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 12751
I20260811 17:13:33.056330 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-1/wal/instance
I20260811 17:13:33.056656 4683 external_mini_cluster.cc:1428] Setting key 32f65258005872407522542f3e76222f
Aug 11 17:13:33 dist-test-slave-7vjv krb5kdc[12588](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468412, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.253@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.146.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.252@KRBTEST.COM" created.
I20260811 17:13:33.073390 12743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.056292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33082 (local address 127.4.146.254:34785)
0811 17:13:33.056444 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.056449 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.057570 (+ 1121us) server_negotiation.cc:407] Connection header received
0811 17:13:33.058651 (+ 1081us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.058657 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.058738 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.058835 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.060785 (+ 1950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.061682 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.063199 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.063709 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.063875 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:33.067185 (+ 3310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:33.067188 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:33.067190 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:33.067222 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:33.069842 (+ 2620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.070719 (+ 877us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.070722 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.070723 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.070837 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.071422 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.071427 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.071429 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.071805 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:33.071940 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:33.072906 (+ 966us) server_negotiation.cc:299] Negotiation successful
0811 17:13:33.073103 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 17:13:33.074095 12875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.056728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34785 (local address 127.0.0.1:33082)
0811 17:13:33.057339 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:33.057397 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 17:13:33.058384 (+ 987us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:13:33.059074 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:13:33.059086 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:13:33.059661 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:13:33.060575 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:33.060596 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.061908 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.061912 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:33.063036 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:33.063049 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.063947 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.063951 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:33.064300 (+ 349us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:33.065042 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:13:33.065062 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:13:33.066918 (+ 1856us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:13:33.069999 (+ 3081us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:33.070006 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:33.070023 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:33.070515 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:33.070990 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:33.070996 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:33.071001 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:33.071253 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:33.071966 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:13:33.071973 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:13:33.072556 (+ 583us) client_negotiation.cc:769] Sending connection context
0811 17:13:33.072750 (+ 194us) client_negotiation.cc:240] Negotiation successful
0811 17:13:33.073072 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":181,"threads_started":1}
I20260811 17:13:33.075676 12871 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 17:13:33 dist-test-slave-7vjv krb5kdc[12588](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468412, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.253@KRBTEST.COM for kudu/127.4.146.253@KRBTEST.COM
I20260811 17:13:33.091123 12875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.076291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:43507 (local address 127.0.0.1:35724)
0811 17:13:33.076484 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:33.076503 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 17:13:33.076612 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:13:33.077489 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:13:33.077493 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:13:33.077730 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:13:33.077891 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:33.077902 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.079115 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.079121 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:33.080147 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:33.080163 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.080984 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.080990 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:33.081103 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:33.081780 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:13:33.081800 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:13:33.086441 (+ 4641us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:13:33.089155 (+ 2714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:33.089158 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:33.089160 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:33.089388 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:33.089795 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:33.089799 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:33.089801 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:33.089957 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:33.090613 (+ 656us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:13:33.090616 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:13:33.090722 (+ 106us) client_negotiation.cc:769] Sending connection context
0811 17:13:33.090826 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 17:13:33.090969 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87}
I20260811 17:13:33.091557 12881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.076406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35724 (local address 127.4.146.253:43507)
0811 17:13:33.076808 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.076827 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.076850 (+ 23us) server_negotiation.cc:407] Connection header received
0811 17:13:33.076890 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.076894 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.077311 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.077466 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.078101 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.078859 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.080281 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.080820 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.080934 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:33.086670 (+ 5736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:33.086689 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:33.086707 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:33.086736 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:33.088938 (+ 2202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.089522 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.089528 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.089530 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.089625 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.090100 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.090105 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.090107 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.090434 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:33.090655 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:33.091070 (+ 415us) server_negotiation.cc:299] Negotiation successful
0811 17:13:33.091333 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":194,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.252.keytab.
Entry for principal kudu/127.4.146.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.252.keytab.
I20260811 17:13:33.092684 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.252:41435
--webserver_interface=127.4.146.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.252.keytab
--principal=kudu/127.4.146.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:39361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:34785,127.4.146.253:43507,127.4.146.252:41435
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 17:13:33.093918 12871 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } has no permanent_uuid. Determining permanent_uuid...
I20260811 17:13:33.094856 12875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.094552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:41435 (local address 127.0.0.1:49576)
0811 17:13:33.094716 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:33.094796 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:41435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260811 17:13:33.095121 12785 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.146.252:41435: connect: Connection refused (error 111)
I20260811 17:13:33.096452 12875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.095931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:41435 (local address 127.0.0.1:49582)
0811 17:13:33.096081 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:33.096393 (+ 312us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:41435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260811 17:13:33.096663 12871 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.252:41435: Network error: Client connection negotiation failed: client connection to 127.4.146.252:41435: connect: Connection refused (error 111)
I20260811 17:13:33.146025 12871 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } attempt: 1
I20260811 17:13:33.147150 12875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.146789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:41435 (local address 127.0.0.1:49592)
0811 17:13:33.146985 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:33.147063 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:41435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260811 17:13:33.148049 12875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.147844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:41435 (local address 127.0.0.1:49608)
0811 17:13:33.147946 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:33.147993 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:41435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260811 17:13:33.148286 12871 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.252:41435: Network error: Client connection negotiation failed: client connection to 127.4.146.252:41435: connect: Connection refused (error 111)
I20260811 17:13:33.179957 12737 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 } attempt: 4
Aug 11 17:13:33 dist-test-slave-7vjv krb5kdc[12588](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468412, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for kudu/127.4.146.253@KRBTEST.COM
I20260811 17:13:33.191931 12742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.180788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:43507 (local address 127.0.0.1:35738)
0811 17:13:33.181040 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:33.181062 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 17:13:33.181191 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:13:33.181538 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:13:33.181540 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:13:33.181725 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:13:33.181826 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:33.181831 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.183873 (+ 2042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.183877 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:33.184634 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:33.184647 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.185388 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.185392 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:33.185499 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:33.186115 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:13:33.186134 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:13:33.187510 (+ 1376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:13:33.189902 (+ 2392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:33.189906 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:33.189907 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:33.190295 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:33.190699 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:33.190702 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:33.190704 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:33.190801 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:33.191346 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:13:33.191350 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:13:33.191501 (+ 151us) client_negotiation.cc:769] Sending connection context
0811 17:13:33.191620 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 17:13:33.191777 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136}
I20260811 17:13:33.192058 12881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.180992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35738 (local address 127.4.146.253:43507)
0811 17:13:33.181192 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.181200 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.181225 (+ 25us) server_negotiation.cc:407] Connection header received
0811 17:13:33.181287 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.181292 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.181357 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.181462 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.181964 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.183736 (+ 1772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.184776 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.185224 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.185364 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:33.187688 (+ 2324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:33.187692 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:33.187696 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:33.187729 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:33.189727 (+ 1998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.190427 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.190431 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.190436 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.190545 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.190912 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.190915 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.190917 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.191196 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:33.191307 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:33.191707 (+ 400us) server_negotiation.cc:299] Negotiation successful
0811 17:13:33.191847 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 17:13:33.193567 12737 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } has no permanent_uuid. Determining permanent_uuid...
I20260811 17:13:33.194545 12742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.194218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:41435 (local address 127.0.0.1:49612)
0811 17:13:33.194395 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:33.194457 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:41435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260811 17:13:33.195653 12742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.195322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:41435 (local address 127.0.0.1:49624)
0811 17:13:33.195527 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:33.195582 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:41435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
W20260811 17:13:33.195837 12737 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.252:41435: Network error: Client connection negotiation failed: client connection to 127.4.146.252:41435: connect: Connection refused (error 111)
I20260811 17:13:33.216547 12871 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } attempt: 2
I20260811 17:13:33.217553 12875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.217189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:41435 (local address 127.0.0.1:49626)
0811 17:13:33.217371 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:33.217454 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:41435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 17:13:33.218461 12875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.218209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:41435 (local address 127.0.0.1:49638)
0811 17:13:33.218343 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:33.218398 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:41435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 17:13:33.218637 12871 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.252:41435: Network error: Client connection negotiation failed: client connection to 127.4.146.252:41435: connect: Connection refused (error 111)
W20260811 17:13:33.230113 12883 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 17:13:33.230468 12883 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:13:33.230494 12883 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:13:33.230581 12883 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:13:33.235082 12883 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:13:33.235181 12883 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:13:33.235203 12883 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:13:33.235219 12883 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:13:33.235235 12883 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:13:33.241460 12883 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:39361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:34785,127.4.146.253:43507,127.4.146.252:41435
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.252.keytab
--principal=kudu/127.4.146.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.252:41435
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.4.146.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12883
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:13:33.242787 12883 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:13:33.243981 12883 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:13:33.254442 12896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:33.254441 12897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:33.254616 12883 server_base.cc:1034] running on GCE node
W20260811 17:13:33.254361 12904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:33.254999 12737 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } attempt: 1
I20260811 17:13:33.255525 12883 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:13:33.255892 12742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.255513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:41435 (local address 127.0.0.1:49640)
0811 17:13:33.255745 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:33.255805 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:41435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260811 17:13:33.256855 12742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.256611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:41435 (local address 127.0.0.1:49650)
0811 17:13:33.256741 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:33.256795 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:41435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 17:13:33.257020 12737 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.252:41435: Network error: Client connection negotiation failed: client connection to 127.4.146.252:41435: connect: Connection refused (error 111)
I20260811 17:13:33.257198 12883 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:13:33.258417 12883 hybrid_clock.cc:648] HybridClock initialized: now 1786468413258399 us; error 25 us; skew 500 ppm
Aug 11 17:13:33 dist-test-slave-7vjv krb5kdc[12588](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468413, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:13:33.261982 12883 init.cc:377] Logged in from keytab as kudu/127.4.146.252@KRBTEST.COM (short username kudu)
I20260811 17:13:33.263120 12883 webserver.cc:460] Webserver started at http://127.4.146.252:42397/ using document root <none> and password file <none>
I20260811 17:13:33.263754 12883 fs_manager.cc:359] Metadata directory not provided
I20260811 17:13:33.263859 12883 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:13:33.264205 12883 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:13:33.266501 12883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-2/data/instance:
uuid: "b476a3ca02dd4c76a70dd0eb7876a83f"
format_stamp: "Formatted at 2026-08-11 17:13:33 on dist-test-slave-7vjv"
server_key: "c2fd3667878c6c40325d44b09bd034df"
server_key_iv: "46798bc586468e5c309ca56f2a06cedf"
server_key_version: "encryptionkey@0"
I20260811 17:13:33.267197 12883 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-2/wal/instance:
uuid: "b476a3ca02dd4c76a70dd0eb7876a83f"
format_stamp: "Formatted at 2026-08-11 17:13:33 on dist-test-slave-7vjv"
server_key: "c2fd3667878c6c40325d44b09bd034df"
server_key_iv: "46798bc586468e5c309ca56f2a06cedf"
server_key_version: "encryptionkey@0"
I20260811 17:13:33.272069 12883 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 17:13:33.275297 12917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:13:33.276929 12883 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260811 17:13:33.277143 12883 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-2/wal
uuid: "b476a3ca02dd4c76a70dd0eb7876a83f"
format_stamp: "Formatted at 2026-08-11 17:13:33 on dist-test-slave-7vjv"
server_key: "c2fd3667878c6c40325d44b09bd034df"
server_key_iv: "46798bc586468e5c309ca56f2a06cedf"
server_key_version: "encryptionkey@0"
I20260811 17:13:33.277295 12883 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:13:33.301671 12883 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:13:33.305884 12883 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:13:33.306154 12883 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:13:33.309862 12871 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } attempt: 3
I20260811 17:13:33.310890 12875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.310468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:41435 (local address 127.0.0.1:49654)
0811 17:13:33.310731 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:33.310808 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:41435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149}
I20260811 17:13:33.312126 12875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.311772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:41435 (local address 127.0.0.1:49662)
0811 17:13:33.311930 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:33.312015 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:41435: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
W20260811 17:13:33.312351 12871 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.252:41435: Network error: Client connection negotiation failed: client connection to 127.4.146.252:41435: connect: Connection refused (error 111)
I20260811 17:13:33.315011 12883 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.252:41435
I20260811 17:13:33.315423 13014 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.252:41435 every 8 connection(s)
I20260811 17:13:33.316382 12883 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-2/data/info.pb
I20260811 17:13:33.319949 13017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:13:33.322767 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 12883
I20260811 17:13:33.322948 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786468091870818-4683-0/minicluster-data/master-2/wal/instance
I20260811 17:13:33.323289 4683 external_mini_cluster.cc:1428] Setting key e8d71c4dada6466a18776e9ab1fa1ef5
I20260811 17:13:33.324215 12737 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } attempt: 2
I20260811 17:13:33.325161 13017 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34785 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 17:13:33 dist-test-slave-7vjv krb5kdc[12588](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468412, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for kudu/127.4.146.252@KRBTEST.COM
Aug 11 17:13:33 dist-test-slave-7vjv krb5kdc[12588](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.252@KRBTEST.COM
Aug 11 17:13:33 dist-test-slave-7vjv krb5kdc[12588](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468413, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.252@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:13:33.340235 12743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.327598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33086 (local address 127.4.146.254:34785)
0811 17:13:33.327732 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.327738 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.328320 (+ 582us) server_negotiation.cc:407] Connection header received
0811 17:13:33.328518 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.328522 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.328582 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.328695 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.329670 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.330371 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.331622 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.332534 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.332653 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:33.335755 (+ 3102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:33.335759 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:33.335764 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:33.335795 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:33.337520 (+ 1725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.338112 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.338116 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.338118 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.338209 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.338667 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.338673 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.338678 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.339073 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:33.339244 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:33.339860 (+ 616us) server_negotiation.cc:299] Negotiation successful
0811 17:13:33.340004 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 17:13:33.340505 12742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.324805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:41435 (local address 127.0.0.1:49678)
0811 17:13:33.325033 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:33.325051 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 17:13:33.325141 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:13:33.327276 (+ 2135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:13:33.327279 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:13:33.327518 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:13:33.327685 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:33.327693 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.329485 (+ 1792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.329491 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:33.330353 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:33.330364 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.331592 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.331599 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:33.331698 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:33.332357 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:13:33.332384 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:13:33.334968 (+ 2584us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:13:33.338478 (+ 3510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:33.338481 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:33.338483 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:33.338740 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:33.339055 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:33.339058 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:33.339060 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:33.339167 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:33.339681 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:13:33.339685 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:13:33.339796 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 17:13:33.339918 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 17:13:33.340129 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":3}
I20260811 17:13:33.341464 13025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.327330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:34785 (local address 127.0.0.1:33086)
0811 17:13:33.328135 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:33.328201 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 17:13:33.328386 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:13:33.328761 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:13:33.328769 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:13:33.329345 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:13:33.329529 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:33.329540 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.330514 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.330517 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:33.331501 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:33.331513 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.332744 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.332748 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:33.332880 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:33.333480 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:13:33.333504 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:13:33.335583 (+ 2079us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:13:33.337649 (+ 2066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:33.337661 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:33.337673 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:33.337971 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:33.338309 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:33.338313 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:33.338315 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:33.338528 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:33.339240 (+ 712us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:13:33.339248 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:13:33.339581 (+ 333us) client_negotiation.cc:769] Sending connection context
0811 17:13:33.339795 (+ 214us) client_negotiation.cc:240] Negotiation successful
0811 17:13:33.340199 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"mutex_wait_us":32,"thread_start_us":139,"threads_started":1}
I20260811 17:13:33.341467 13020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.324971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49664 (local address 127.4.146.252:41435)
0811 17:13:33.325569 (+ 598us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.325597 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.325659 (+ 62us) server_negotiation.cc:407] Connection header received
0811 17:13:33.326487 (+ 828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.326508 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.326950 (+ 442us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.327304 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.328873 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.329728 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.330907 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.331419 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.331755 (+ 336us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:33.334874 (+ 3119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:33.334883 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:33.334904 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:33.334927 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:33.337623 (+ 2696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.338440 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.338448 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.338450 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.338626 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.338995 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.338999 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.339000 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.339539 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:33.339793 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:33.340284 (+ 491us) server_negotiation.cc:299] Negotiation successful
0811 17:13:33.340487 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":442,"server-negotiator.queue_time_us":405,"spinlock_wait_cycles":23168,"thread_start_us":171,"threads_started":1}
I20260811 17:13:33.342914 13021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.325515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49678 (local address 127.4.146.252:41435)
0811 17:13:33.325835 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.325843 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.325860 (+ 17us) server_negotiation.cc:407] Connection header received
0811 17:13:33.326511 (+ 651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.326515 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.326950 (+ 435us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.327305 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.327878 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.329346 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.330511 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.331415 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.331986 (+ 571us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:33.335165 (+ 3179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:33.335169 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:33.335171 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:33.335199 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:33.338369 (+ 3170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.338861 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.338865 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.338867 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.338953 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.339282 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.339285 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.339287 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.339541 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:33.339686 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:33.340310 (+ 624us) server_negotiation.cc:299] Negotiation successful
0811 17:13:33.340562 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":181,"server-negotiator.queue_time_us":247,"spinlock_wait_cycles":25344,"thread_start_us":128,"threads_started":1}
I20260811 17:13:33.342978 13017 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 } has no permanent_uuid. Determining permanent_uuid...
I20260811 17:13:33.346537 12737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c: Bootstrap starting.
I20260811 17:13:33.349458 12737 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c: Neither blocks nor log segments found. Creating new log.
Aug 11 17:13:33 dist-test-slave-7vjv krb5kdc[12588](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468413, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.252@KRBTEST.COM for kudu/127.4.146.253@KRBTEST.COM
Aug 11 17:13:33 dist-test-slave-7vjv krb5kdc[12588](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:13:33.350452 12737 log.cc:824] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c: Log is configured to *not* fsync() on all Append() calls
I20260811 17:13:33.353433 12737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c: No bootstrap required, opened a new log
I20260811 17:13:33.353716 12881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.343679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35742 (local address 127.4.146.253:43507)
0811 17:13:33.343860 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.343870 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.344011 (+ 141us) server_negotiation.cc:407] Connection header received
0811 17:13:33.344539 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.344544 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.344597 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.344677 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.345391 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.345973 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.346950 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.347294 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.347377 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:33.350154 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:33.350158 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:33.350160 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:33.350198 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:33.351803 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.352392 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.352398 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.352400 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.352495 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.352824 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.352827 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.352829 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.353034 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:33.353153 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:33.353453 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 17:13:33.353572 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 17:13:33.353717 13025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.343512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:43507 (local address 127.0.0.1:35742)
0811 17:13:33.343921 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:33.343937 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:13:33.344036 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:13:33.344838 (+ 802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:13:33.344841 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:13:33.345058 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:13:33.345234 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:33.345246 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.346091 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.346093 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:33.346809 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:33.346819 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.347534 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.347537 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:33.347615 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:33.348239 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:13:33.348255 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:13:33.350002 (+ 1747us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:13:33.351936 (+ 1934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:33.351939 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:33.351941 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:33.352262 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:33.352602 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:33.352607 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:33.352609 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:33.352716 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:33.353138 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:13:33.353141 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:13:33.353258 (+ 117us) client_negotiation.cc:769] Sending connection context
0811 17:13:33.353366 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 17:13:33.353529 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":337}
I20260811 17:13:33.354627 13017 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } has no permanent_uuid. Determining permanent_uuid...
I20260811 17:13:33.355088 12743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.344442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33100 (local address 127.4.146.254:34785)
0811 17:13:33.344574 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.344579 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.344594 (+ 15us) server_negotiation.cc:407] Connection header received
0811 17:13:33.344681 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.344684 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.344726 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.344805 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.345592 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.346299 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.347388 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.347716 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.348221 (+ 505us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:33.351251 (+ 3030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:33.351256 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:33.351259 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:33.351286 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:33.353062 (+ 1776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.353634 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.353637 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.353639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.353734 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.354100 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.354104 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.354105 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.354322 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:33.354511 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:33.354720 (+ 209us) server_negotiation.cc:299] Negotiation successful
0811 17:13:33.354919 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 17:13:33.358493 12737 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34785 } } peers { permanent_uuid: "08a739b3c711408094e8c761dbfc36ea" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 } } peers { permanent_uuid: "b476a3ca02dd4c76a70dd0eb7876a83f" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } }
I20260811 17:13:33.358786 12737 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab8ae13f67104ad5b37ef43b5676bc6c, State: Initialized, Role: FOLLOWER
I20260811 17:13:33.359195 12737 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34785 } } peers { permanent_uuid: "08a739b3c711408094e8c761dbfc36ea" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 } } peers { permanent_uuid: "b476a3ca02dd4c76a70dd0eb7876a83f" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } }
I20260811 17:13:33.359862 13027 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34785 } } peers { permanent_uuid: "08a739b3c711408094e8c761dbfc36ea" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 } } peers { permanent_uuid: "b476a3ca02dd4c76a70dd0eb7876a83f" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } } }
I20260811 17:13:33.360047 13027 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:13:33.361045 12737 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c [sys.catalog]: configured and running, proceeding with master startup.
Aug 11 17:13:33 dist-test-slave-7vjv krb5kdc[12588](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468413, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.252@KRBTEST.COM for kudu/127.4.146.252@KRBTEST.COM
Aug 11 17:13:33 dist-test-slave-7vjv krb5kdc[12588](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468412, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.253@KRBTEST.COM
I20260811 17:13:33.366912 13025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.355157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:41435 (local address 127.0.0.1:49686)
0811 17:13:33.355332 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:33.355346 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 17:13:33.355420 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:13:33.356917 (+ 1497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:13:33.356919 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:13:33.357119 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:13:33.357210 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:33.357218 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.358212 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.358215 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:33.358967 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:33.358978 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.359565 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.359570 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:33.359648 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:33.360241 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:13:33.360256 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:13:33.362527 (+ 2271us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:13:33.365114 (+ 2587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:33.365118 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:33.365120 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:33.365413 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:33.365717 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:33.365720 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:33.365721 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:33.365803 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:33.366361 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:13:33.366363 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:13:33.366457 (+ 94us) client_negotiation.cc:769] Sending connection context
0811 17:13:33.366544 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 17:13:33.366725 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103}
I20260811 17:13:33.367486 13021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.355228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49686 (local address 127.4.146.252:41435)
0811 17:13:33.356730 (+ 1502us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.356733 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.356744 (+ 11us) server_negotiation.cc:407] Connection header received
0811 17:13:33.356775 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.356777 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.356809 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.356908 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.357332 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.358097 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.359100 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.359423 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.359871 (+ 448us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:33.363133 (+ 3262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:33.363148 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:33.363151 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:33.363174 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:33.364988 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.365535 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.365539 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.365540 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.365625 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.365905 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.365908 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.365911 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.366250 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:33.367128 (+ 878us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:33.367206 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 17:13:33.367331 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1430}
I20260811 17:13:33.367498 12881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.356604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35744 (local address 127.4.146.253:43507)
0811 17:13:33.356756 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.356762 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.356777 (+ 15us) server_negotiation.cc:407] Connection header received
0811 17:13:33.356813 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.356816 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.356857 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.356952 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.357589 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.358081 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.358912 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.359177 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.359241 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:33.362774 (+ 3533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:33.362779 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:33.362782 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:33.362818 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:33.364840 (+ 2022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.365476 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.365480 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.365482 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.365583 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.365914 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.365917 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.365919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.366167 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:33.366412 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:33.367226 (+ 814us) server_negotiation.cc:299] Negotiation successful
0811 17:13:33.367354 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
W20260811 17:13:33.368854 13050 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 17:13:33.369027 13050 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 17:13:33.371609 13017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b476a3ca02dd4c76a70dd0eb7876a83f: Bootstrap starting.
I20260811 17:13:33.375289 13017 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b476a3ca02dd4c76a70dd0eb7876a83f: Neither blocks nor log segments found. Creating new log.
I20260811 17:13:33.368726 12618 master_runner.cc:186] Error getting master registration for 127.4.146.253:43507: OK, instance_id { permanent_uuid: "08a739b3c711408094e8c761dbfc36ea" instance_seqno: 1786468413041770 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 17:13:33.376319 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:13:33.376773 13017 log.cc:824] T 00000000000000000000000000000000 P b476a3ca02dd4c76a70dd0eb7876a83f: Log is configured to *not* fsync() on all Append() calls
I20260811 17:13:33.377766 12618 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 17:13:33.378108 12691 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33100
I20260811 17:13:33.378496 12691 raft_consensus.cc:482] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 17:13:33.378643 12691 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:13:33.379851 13017 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b476a3ca02dd4c76a70dd0eb7876a83f: No bootstrap required, opened a new log
I20260811 17:13:33.380762 12691 raft_consensus.cc:504] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34785 } } peers { permanent_uuid: "08a739b3c711408094e8c761dbfc36ea" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 } } peers { permanent_uuid: "b476a3ca02dd4c76a70dd0eb7876a83f" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } }
I20260811 17:13:33.382133 12691 leader_election.cc:288] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c [CANDIDATE]: Term 1 election: Requested vote from peers 08a739b3c711408094e8c761dbfc36ea (127.4.146.253:43507), b476a3ca02dd4c76a70dd0eb7876a83f (127.4.146.252:41435)
I20260811 17:13:33.384672 13017 raft_consensus.cc:348] T 00000000000000000000000000000000 P b476a3ca02dd4c76a70dd0eb7876a83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34785 } } peers { permanent_uuid: "08a739b3c711408094e8c761dbfc36ea" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 } } peers { permanent_uuid: "b476a3ca02dd4c76a70dd0eb7876a83f" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } }
I20260811 17:13:33.384984 13017 raft_consensus.cc:729] T 00000000000000000000000000000000 P b476a3ca02dd4c76a70dd0eb7876a83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b476a3ca02dd4c76a70dd0eb7876a83f, State: Initialized, Role: FOLLOWER
I20260811 17:13:33.385373 13017 consensus_queue.cc:260] T 00000000000000000000000000000000 P b476a3ca02dd4c76a70dd0eb7876a83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34785 } } peers { permanent_uuid: "08a739b3c711408094e8c761dbfc36ea" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 } } peers { permanent_uuid: "b476a3ca02dd4c76a70dd0eb7876a83f" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } }
I20260811 17:13:33.386037 13059 sys_catalog.cc:455] T 00000000000000000000000000000000 P b476a3ca02dd4c76a70dd0eb7876a83f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34785 } } peers { permanent_uuid: "08a739b3c711408094e8c761dbfc36ea" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 } } peers { permanent_uuid: "b476a3ca02dd4c76a70dd0eb7876a83f" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } } }
I20260811 17:13:33.386289 13059 sys_catalog.cc:458] T 00000000000000000000000000000000 P b476a3ca02dd4c76a70dd0eb7876a83f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:13:33.386952 13017 sys_catalog.cc:564] T 00000000000000000000000000000000 P b476a3ca02dd4c76a70dd0eb7876a83f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:13:33.387040 12970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b476a3ca02dd4c76a70dd0eb7876a83f"
I20260811 17:13:33.387293 12970 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b476a3ca02dd4c76a70dd0eb7876a83f [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:13:33.388825 12970 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b476a3ca02dd4c76a70dd0eb7876a83f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab8ae13f67104ad5b37ef43b5676bc6c in term 1.
I20260811 17:13:33.389411 12650 leader_election.cc:302] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab8ae13f67104ad5b37ef43b5676bc6c, b476a3ca02dd4c76a70dd0eb7876a83f; no voters:
I20260811 17:13:33.389829 13027 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:13:33.390100 13027 raft_consensus.cc:686] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c [term 1 LEADER]: Becoming Leader. State: Replica: ab8ae13f67104ad5b37ef43b5676bc6c, State: Running, Role: LEADER
I20260811 17:13:33.390499 13027 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34785 } } peers { permanent_uuid: "08a739b3c711408094e8c761dbfc36ea" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 } } peers { permanent_uuid: "b476a3ca02dd4c76a70dd0eb7876a83f" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } }
I20260811 17:13:33.392551 13027 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab8ae13f67104ad5b37ef43b5676bc6c. Latest consensus state: current_term: 1 leader_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34785 } } peers { permanent_uuid: "08a739b3c711408094e8c761dbfc36ea" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 } } peers { permanent_uuid: "b476a3ca02dd4c76a70dd0eb7876a83f" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } } }
I20260811 17:13:33.392691 13027 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c [sys.catalog]: This master's current role is: LEADER
W20260811 17:13:33.393893 13083 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b476a3ca02dd4c76a70dd0eb7876a83f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 17:13:33.394028 13083 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 17:13:33.397182 12883 master_runner.cc:186] Error getting master registration for 127.4.146.253:43507: OK, instance_id { permanent_uuid: "08a739b3c711408094e8c761dbfc36ea" instance_seqno: 1786468413041770 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 17:13:33.400938 12883 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 17:13:33.412891 13088 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:13:33.414163 13088 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:13:33.414719 12881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.393172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35754 (local address 127.4.146.253:43507)
0811 17:13:33.393307 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.393311 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.394594 (+ 1283us) server_negotiation.cc:407] Connection header received
0811 17:13:33.395399 (+ 805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.395404 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.395470 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.395534 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.404243 (+ 8709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.405137 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.406371 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.406718 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.406824 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:33.409589 (+ 2765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:33.409600 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:33.409603 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:33.409647 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:33.411872 (+ 2225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.412695 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.412699 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.412701 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.412807 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.413246 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.413250 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.413252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.413513 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:33.413652 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:33.414239 (+ 587us) server_negotiation.cc:299] Negotiation successful
0811 17:13:33.414463 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 17:13:33.417279 12743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.392553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33114 (local address 127.4.146.254:34785)
0811 17:13:33.392684 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.392689 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.394720 (+ 2031us) server_negotiation.cc:407] Connection header received
0811 17:13:33.394925 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.394930 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.394993 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.395072 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.396826 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.397689 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.399490 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.399880 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.399966 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:33.403104 (+ 3138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:33.403108 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:33.403111 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:33.403149 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:33.405227 (+ 2078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.406099 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.406103 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.406105 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.406218 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.406719 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.406722 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.406724 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.406971 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:33.407097 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:33.416960 (+ 9863us) server_negotiation.cc:299] Negotiation successful
0811 17:13:33.417109 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 17:13:33.423365 13021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.394253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49696 (local address 127.4.146.252:41435)
0811 17:13:33.394389 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.394393 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.395302 (+ 909us) server_negotiation.cc:407] Connection header received
0811 17:13:33.396037 (+ 735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.396043 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.396121 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.396182 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.407385 (+ 11203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.408375 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.409664 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.410054 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.410147 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:33.419169 (+ 9022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:33.419173 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:33.419177 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:33.419213 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:33.421177 (+ 1964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.421823 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.421827 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.421830 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.421932 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.422298 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.422301 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.422303 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.422560 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:33.422704 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:33.423046 (+ 342us) server_negotiation.cc:299] Negotiation successful
0811 17:13:33.423187 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 17:13:33.432964 12970 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b476a3ca02dd4c76a70dd0eb7876a83f [term 1 FOLLOWER]: Refusing update from remote peer ab8ae13f67104ad5b37ef43b5676bc6c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:13:33.433761 13085 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b476a3ca02dd4c76a70dd0eb7876a83f" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:13:33.437942 13059 sys_catalog.cc:455] T 00000000000000000000000000000000 P b476a3ca02dd4c76a70dd0eb7876a83f [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab8ae13f67104ad5b37ef43b5676bc6c. Latest consensus state: current_term: 1 leader_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34785 } } peers { permanent_uuid: "08a739b3c711408094e8c761dbfc36ea" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 } } peers { permanent_uuid: "b476a3ca02dd4c76a70dd0eb7876a83f" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } } }
I20260811 17:13:33.438087 13059 sys_catalog.cc:458] T 00000000000000000000000000000000 P b476a3ca02dd4c76a70dd0eb7876a83f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:13:33.450119 13027 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34785 } } peers { permanent_uuid: "08a739b3c711408094e8c761dbfc36ea" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 } } peers { permanent_uuid: "b476a3ca02dd4c76a70dd0eb7876a83f" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } } }
I20260811 17:13:33.450281 13027 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:33.451721 13059 sys_catalog.cc:455] T 00000000000000000000000000000000 P b476a3ca02dd4c76a70dd0eb7876a83f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34785 } } peers { permanent_uuid: "08a739b3c711408094e8c761dbfc36ea" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 } } peers { permanent_uuid: "b476a3ca02dd4c76a70dd0eb7876a83f" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } } }
I20260811 17:13:33.451882 13059 sys_catalog.cc:458] T 00000000000000000000000000000000 P b476a3ca02dd4c76a70dd0eb7876a83f [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:13:33.455519 12871 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } attempt: 4
I20260811 17:13:33.458004 13088 catalog_manager.cc:1347] Generated new cluster ID: 279188357c084727873c14046ecdba31
I20260811 17:13:33.458103 13088 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 17:13:33 dist-test-slave-7vjv krb5kdc[12588](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468412, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.253@KRBTEST.COM for kudu/127.4.146.252@KRBTEST.COM
I20260811 17:13:33.468997 13021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.456422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49706 (local address 127.4.146.252:41435)
0811 17:13:33.456549 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.456555 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.456572 (+ 17us) server_negotiation.cc:407] Connection header received
0811 17:13:33.456640 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.456643 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.456699 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.456780 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.457532 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.458387 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.459530 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.459916 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.460034 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:33.464506 (+ 4472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:33.464511 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:33.464514 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:33.464547 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:33.466638 (+ 2091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.467276 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.467280 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.467282 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.467382 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:33.467708 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:33.467711 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:33.467713 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:33.467985 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:33.468085 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:33.468643 (+ 558us) server_negotiation.cc:299] Negotiation successful
0811 17:13:33.468793 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 17:13:33.469518 12875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:33.456192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:41435 (local address 127.0.0.1:49706)
0811 17:13:33.456450 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:33.456465 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 17:13:33.456547 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:13:33.456823 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:13:33.456826 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:13:33.457068 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:13:33.457180 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:33.457187 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.458513 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.458517 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:33.459380 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:33.459392 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:33.460036 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:33.460040 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:33.460163 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:33.460823 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:13:33.460841 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:13:33.464317 (+ 3476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:13:33.466806 (+ 2489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:33.466810 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:33.466813 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:33.467137 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:33.467494 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:33.467497 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:33.467499 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:33.467595 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:33.468161 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:13:33.468164 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:13:33.468284 (+ 120us) client_negotiation.cc:769] Sending connection context
0811 17:13:33.468396 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 17:13:33.469324 (+ 928us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171}
I20260811 17:13:33.473515 12871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08a739b3c711408094e8c761dbfc36ea: Bootstrap starting.
I20260811 17:13:33.476974 12871 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 08a739b3c711408094e8c761dbfc36ea: Neither blocks nor log segments found. Creating new log.
I20260811 17:13:33.478053 12871 log.cc:824] T 00000000000000000000000000000000 P 08a739b3c711408094e8c761dbfc36ea: Log is configured to *not* fsync() on all Append() calls
I20260811 17:13:33.481916 12871 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08a739b3c711408094e8c761dbfc36ea: No bootstrap required, opened a new log
I20260811 17:13:33.489774 12871 raft_consensus.cc:348] T 00000000000000000000000000000000 P 08a739b3c711408094e8c761dbfc36ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34785 } } peers { permanent_uuid: "08a739b3c711408094e8c761dbfc36ea" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 } } peers { permanent_uuid: "b476a3ca02dd4c76a70dd0eb7876a83f" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } }
I20260811 17:13:33.490311 12871 raft_consensus.cc:729] T 00000000000000000000000000000000 P 08a739b3c711408094e8c761dbfc36ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08a739b3c711408094e8c761dbfc36ea, State: Initialized, Role: FOLLOWER
I20260811 17:13:33.490952 12871 consensus_queue.cc:260] T 00000000000000000000000000000000 P 08a739b3c711408094e8c761dbfc36ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34785 } } peers { permanent_uuid: "08a739b3c711408094e8c761dbfc36ea" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 } } peers { permanent_uuid: "b476a3ca02dd4c76a70dd0eb7876a83f" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } }
I20260811 17:13:33.491889 13114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08a739b3c711408094e8c761dbfc36ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34785 } } peers { permanent_uuid: "08a739b3c711408094e8c761dbfc36ea" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 } } peers { permanent_uuid: "b476a3ca02dd4c76a70dd0eb7876a83f" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } } }
I20260811 17:13:33.492259 13114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08a739b3c711408094e8c761dbfc36ea [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:13:33.493867 12823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "08a739b3c711408094e8c761dbfc36ea"
I20260811 17:13:33.494163 12821 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 08a739b3c711408094e8c761dbfc36ea [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:13:33.494220 12871 sys_catalog.cc:564] T 00000000000000000000000000000000 P 08a739b3c711408094e8c761dbfc36ea [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:13:33.495779 12821 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 08a739b3c711408094e8c761dbfc36ea [term 1 FOLLOWER]: Refusing update from remote peer ab8ae13f67104ad5b37ef43b5676bc6c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:13:33.496641 13107 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "08a739b3c711408094e8c761dbfc36ea" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:13:33.497659 12823 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 08a739b3c711408094e8c761dbfc36ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab8ae13f67104ad5b37ef43b5676bc6c in term 1.
I20260811 17:13:33.502254 13114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08a739b3c711408094e8c761dbfc36ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab8ae13f67104ad5b37ef43b5676bc6c. Latest consensus state: current_term: 1 leader_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34785 } } peers { permanent_uuid: "08a739b3c711408094e8c761dbfc36ea" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 } } peers { permanent_uuid: "b476a3ca02dd4c76a70dd0eb7876a83f" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } } }
I20260811 17:13:33.502398 13114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08a739b3c711408094e8c761dbfc36ea [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:13:33.502470 13114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08a739b3c711408094e8c761dbfc36ea [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34785 } } peers { permanent_uuid: "08a739b3c711408094e8c761dbfc36ea" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 } } peers { permanent_uuid: "b476a3ca02dd4c76a70dd0eb7876a83f" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } } }
I20260811 17:13:33.502517 13114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08a739b3c711408094e8c761dbfc36ea [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:13:33.514540 13129 mvcc.cc:205] Tried to move back new op lower bound from 7317374621409787904 to 7317374621251387392. Current Snapshot: MvccSnapshot[applied={T|T < 7317374621409787904}]
I20260811 17:13:33.517796 13107 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab8ae13f67104ad5b37ef43b5676bc6c" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 34785 } } peers { permanent_uuid: "08a739b3c711408094e8c761dbfc36ea" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 43507 } } peers { permanent_uuid: "b476a3ca02dd4c76a70dd0eb7876a83f" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 41435 } } }
I20260811 17:13:33.517947 13107 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c [sys.catalog]: This master's current role is: LEADER
W20260811 17:13:33.519167 13144 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 08a739b3c711408094e8c761dbfc36ea: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 17:13:33.519263 13144 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 17:13:33.522559 13088 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:13:33.523910 13088 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:13:33.538353 13088 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ab8ae13f67104ad5b37ef43b5676bc6c: Generated new TSK 0
I20260811 17:13:33.539338 13088 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 17:13:33.584865 12881 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:33.581818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35770 (local address 127.4.146.253:43507)
0811 17:13:33.581944 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.581949 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.583320 (+ 1371us) server_negotiation.cc:407] Connection header received
0811 17:13:33.583546 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.583551 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.583610 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.583668 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.584706 (+ 1038us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35770: BlockingRecv error: recv got EOF from 127.0.0.1:35770 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260811 17:13:33.586712 12743 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:33.581296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33130 (local address 127.4.146.254:34785)
0811 17:13:33.581441 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.581446 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.585577 (+ 4131us) server_negotiation.cc:407] Connection header received
0811 17:13:33.585788 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.585791 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.585849 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.585906 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.586551 (+ 645us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33130: BlockingRecv error: recv got EOF from 127.0.0.1:33130 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260811 17:13:33.588729 13021 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:33.582981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49718 (local address 127.4.146.252:41435)
0811 17:13:33.583110 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.583114 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.587454 (+ 4340us) server_negotiation.cc:407] Connection header received
0811 17:13:33.587672 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.587676 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.587736 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.587799 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.588559 (+ 760us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49718: BlockingRecv error: recv got EOF from 127.0.0.1:49718 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260811 17:13:33.595279 12881 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:33.593101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35776 (local address 127.4.146.253:43507)
0811 17:13:33.593243 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.593248 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.593916 (+ 668us) server_negotiation.cc:407] Connection header received
0811 17:13:33.594237 (+ 321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.594241 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.594347 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.594415 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.595144 (+ 729us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35776: BlockingRecv error: recv got EOF from 127.0.0.1:35776 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260811 17:13:33.601680 12881 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:33.599605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35792 (local address 127.4.146.253:43507)
0811 17:13:33.599758 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.599763 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.600502 (+ 739us) server_negotiation.cc:407] Connection header received
0811 17:13:33.600760 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.600764 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.600826 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.600887 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.601545 (+ 658us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35792: BlockingRecv error: recv got EOF from 127.0.0.1:35792 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260811 17:13:33.608662 12881 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:33.606503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35808 (local address 127.4.146.253:43507)
0811 17:13:33.606647 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.606651 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.607394 (+ 743us) server_negotiation.cc:407] Connection header received
0811 17:13:33.607660 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.607664 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.607733 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.607797 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.608531 (+ 734us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35808: BlockingRecv error: recv got EOF from 127.0.0.1:35808 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260811 17:13:33.617290 12881 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:33.615250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35824 (local address 127.4.146.253:43507)
0811 17:13:33.615370 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.615375 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.615995 (+ 620us) server_negotiation.cc:407] Connection header received
0811 17:13:33.616289 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.616292 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.616362 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.616416 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.617159 (+ 743us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35824: BlockingRecv error: recv got EOF from 127.0.0.1:35824 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260811 17:13:33.629272 12881 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:33.627801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35836 (local address 127.4.146.253:43507)
0811 17:13:33.627937 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.627942 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.628302 (+ 360us) server_negotiation.cc:407] Connection header received
0811 17:13:33.628438 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.628442 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.628507 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.628604 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.629141 (+ 537us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35836: BlockingRecv error: recv got EOF from 127.0.0.1:35836 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
W20260811 17:13:33.648864 12881 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:33.647594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35838 (local address 127.4.146.253:43507)
0811 17:13:33.647746 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.647751 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.647921 (+ 170us) server_negotiation.cc:407] Connection header received
0811 17:13:33.648066 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.648070 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.648153 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.648254 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.648739 (+ 485us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35838: BlockingRecv error: recv got EOF from 127.0.0.1:35838 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260811 17:13:33.685668 12881 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:33.683732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35850 (local address 127.4.146.253:43507)
0811 17:13:33.683933 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.683938 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.684278 (+ 340us) server_negotiation.cc:407] Connection header received
0811 17:13:33.684537 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.684541 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.684597 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.684707 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.685532 (+ 825us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35850: BlockingRecv error: recv got EOF from 127.0.0.1:35850 (error 108)
Metrics: {"server-negotiator.queue_time_us":110}
W20260811 17:13:33.753453 12881 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:33.752247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35856 (local address 127.4.146.253:43507)
0811 17:13:33.752426 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.752430 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.752464 (+ 34us) server_negotiation.cc:407] Connection header received
0811 17:13:33.752620 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.752623 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.752673 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.752752 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.753300 (+ 548us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35856: BlockingRecv error: recv got EOF from 127.0.0.1:35856 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260811 17:13:33.885922 12881 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:33.884248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35864 (local address 127.4.146.253:43507)
0811 17:13:33.884483 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:33.884489 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:33.884746 (+ 257us) server_negotiation.cc:407] Connection header received
0811 17:13:33.884889 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:33.884892 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:33.884953 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:33.885084 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:33.885774 (+ 690us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35864: BlockingRecv error: recv got EOF from 127.0.0.1:35864 (error 108)
Metrics: {"server-negotiator.queue_time_us":125}
W20260811 17:13:34.145994 12881 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:34.144728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35866 (local address 127.4.146.253:43507)
0811 17:13:34.144886 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:34.144890 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:34.145022 (+ 132us) server_negotiation.cc:407] Connection header received
0811 17:13:34.145175 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:34.145178 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:34.145227 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:34.145305 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:34.145864 (+ 559us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35866: BlockingRecv error: recv got EOF from 127.0.0.1:35866 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 17:13:34.402923 13083 catalog_manager.cc:1259] Loaded cluster ID: 279188357c084727873c14046ecdba31
I20260811 17:13:34.403033 13083 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b476a3ca02dd4c76a70dd0eb7876a83f: loading cluster ID for follower catalog manager: success
I20260811 17:13:34.404953 13083 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b476a3ca02dd4c76a70dd0eb7876a83f: acquiring CA information for follower catalog manager: success
I20260811 17:13:34.406349 13083 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b476a3ca02dd4c76a70dd0eb7876a83f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 17:13:34.520665 13144 catalog_manager.cc:1259] Loaded cluster ID: 279188357c084727873c14046ecdba31
I20260811 17:13:34.520820 13144 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 08a739b3c711408094e8c761dbfc36ea: loading cluster ID for follower catalog manager: success
I20260811 17:13:34.522656 13144 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 08a739b3c711408094e8c761dbfc36ea: acquiring CA information for follower catalog manager: success
I20260811 17:13:34.524063 13144 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 08a739b3c711408094e8c761dbfc36ea: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 17:13:34.664999 13265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:34.660579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35874 (local address 127.4.146.253:43507)
0811 17:13:34.660869 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:34.660875 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:34.661012 (+ 137us) server_negotiation.cc:407] Connection header received
0811 17:13:34.661239 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:34.661242 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:34.661375 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:34.661509 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:13:34.661789 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:34.662420 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:34.663386 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:34.663639 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:34.663736 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:34.664016 (+ 280us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:13:34.664574 (+ 558us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:13:34.664675 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:34.664771 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 17:13:34.664825 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":76,"threads_started":1}
I20260811 17:13:34.672458 13276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:34.668443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49720 (local address 127.4.146.252:41435)
0811 17:13:34.668734 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:34.668738 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:34.668753 (+ 15us) server_negotiation.cc:407] Connection header received
0811 17:13:34.668835 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:34.668837 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:34.668991 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:34.669164 (+ 173us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:13:34.669346 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:34.669877 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:34.670795 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:34.671054 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:34.671153 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:34.671489 (+ 336us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:13:34.671969 (+ 480us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:13:34.672074 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:34.672264 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 17:13:34.672327 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":110,"threads_started":1}
I20260811 17:13:34.680959 13265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:34.675877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35886 (local address 127.4.146.253:43507)
0811 17:13:34.676025 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:34.676032 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:34.676630 (+ 598us) server_negotiation.cc:407] Connection header received
0811 17:13:34.676820 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:34.676825 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:34.676886 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:34.676964 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:13:34.677317 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:34.677887 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:34.679253 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:34.679642 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:34.679762 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:34.680327 (+ 565us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:13:34.680428 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:13:34.680513 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:34.680671 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 17:13:34.680754 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 17:13:34.681037 13290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:34.675804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33140 (local address 127.4.146.254:34785)
0811 17:13:34.676116 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:34.676122 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:34.676244 (+ 122us) server_negotiation.cc:407] Connection header received
0811 17:13:34.676469 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:34.676473 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:34.676661 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:34.676796 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:13:34.677159 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:34.678141 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:34.679135 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:34.679560 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:34.679711 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:34.680121 (+ 410us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:13:34.680537 (+ 416us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:13:34.680643 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:34.680752 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 17:13:34.680830 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193,"thread_start_us":83,"threads_started":1}
I20260811 17:13:34.681492 13276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:34.676340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49722 (local address 127.4.146.252:41435)
0811 17:13:34.676491 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:34.676496 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:34.676774 (+ 278us) server_negotiation.cc:407] Connection header received
0811 17:13:34.676831 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:34.676834 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:34.676881 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:34.676959 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:13:34.677256 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:34.678127 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:34.679399 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:34.679728 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:34.679834 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:34.680355 (+ 521us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:13:34.680433 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:13:34.680513 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:34.681275 (+ 762us) server_negotiation.cc:299] Negotiation successful
0811 17:13:34.681341 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 17:13:34.690167 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 12618
I20260811 17:13:34.707830 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 12751
I20260811 17:13:34.722558 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 12883
2026-08-11T17:13:34Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3658 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 17:13:34 dist-test-slave-7vjv krb5kdc[13300](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 17:13:34 dist-test-slave-7vjv krb5kdc[13300](info): set up 2 sockets
Aug 11 17:13:34 dist-test-slave-7vjv krb5kdc[13300](info): commencing operation
krb5kdc: starting...
W20260811 17:13:36.056959 4683 mini_kdc.cc:121] Time spent starting KDC: real 1.295s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/krb5kdc/test-user.keytab.
Aug 11 17:13:36 dist-test-slave-7vjv krb5kdc[13300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468416, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T17:13:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T17:13:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.4.146.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
Entry for principal kudu/127.4.146.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab.
I20260811 17:13:36.203848 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:37655
--webserver_interface=127.4.146.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:37655,127.4.146.253:45969,127.4.146.252:44247
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:13:36.324728 13323 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 17:13:36.325127 13323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:13:36.325176 13323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:13:36.325260 13323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:13:36.329550 13323 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:13:36.329689 13323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:13:36.329788 13323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:13:36.329847 13323 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:13:36.329888 13323 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:13:36.336692 13323 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:37655,127.4.146.253:45969,127.4.146.252:44247
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.254.keytab
--principal=kudu/127.4.146.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.254:37655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.4.146.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:13:36.338392 13323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:13:36.340027 13323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:13:36.351295 13337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:36.351295 13331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:36.351315 13332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:36.351550 13323 server_base.cc:1034] running on GCE node
I20260811 17:13:36.352296 13323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:13:36.353520 13323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:13:36.354705 13323 hybrid_clock.cc:648] HybridClock initialized: now 1786468416354692 us; error 30 us; skew 500 ppm
Aug 11 17:13:36 dist-test-slave-7vjv krb5kdc[13300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468416, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:13:36.358161 13323 init.cc:377] Logged in from keytab as kudu/127.4.146.254@KRBTEST.COM (short username kudu)
I20260811 17:13:36.359388 13323 webserver.cc:460] Webserver started at http://127.4.146.254:39767/ using document root <none> and password file <none>
I20260811 17:13:36.360059 13323 fs_manager.cc:359] Metadata directory not provided
I20260811 17:13:36.360234 13323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:13:36.360504 13323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:13:36.362891 13323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-0/data/instance:
uuid: "6aa13d4eae704f4489c90054767865a6"
format_stamp: "Formatted at 2026-08-11 17:13:36 on dist-test-slave-7vjv"
server_key: "ca883b5318fadabc9564619d3c9896a2"
server_key_iv: "4e251b6ba71d6d8bc4749877aaca61cb"
server_key_version: "encryptionkey@0"
I20260811 17:13:36.363583 13323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-0/wal/instance:
uuid: "6aa13d4eae704f4489c90054767865a6"
format_stamp: "Formatted at 2026-08-11 17:13:36 on dist-test-slave-7vjv"
server_key: "ca883b5318fadabc9564619d3c9896a2"
server_key_iv: "4e251b6ba71d6d8bc4749877aaca61cb"
server_key_version: "encryptionkey@0"
I20260811 17:13:36.367875 13323 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260811 17:13:36.370784 13348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:13:36.372470 13323 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:13:36.372669 13323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-0/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-0/wal
uuid: "6aa13d4eae704f4489c90054767865a6"
format_stamp: "Formatted at 2026-08-11 17:13:36 on dist-test-slave-7vjv"
server_key: "ca883b5318fadabc9564619d3c9896a2"
server_key_iv: "4e251b6ba71d6d8bc4749877aaca61cb"
server_key_version: "encryptionkey@0"
I20260811 17:13:36.372829 13323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:13:36.385052 13323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:13:36.388886 13323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:13:36.389158 13323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:13:36.397230 13323 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.254:37655
I20260811 17:13:36.397534 13438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.254:37655 every 8 connection(s)
I20260811 17:13:36.398397 13323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-0/data/info.pb
I20260811 17:13:36.401546 13439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:13:36.402959 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 13323
I20260811 17:13:36.403103 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-0/wal/instance
I20260811 17:13:36.403448 4683 external_mini_cluster.cc:1428] Setting key e0a2117932d0f096bf4e4bb716b2bc88
I20260811 17:13:36.407313 13439 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37655 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.4.146.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.253@KRBTEST.COM" created.
Aug 11 17:13:36 dist-test-slave-7vjv krb5kdc[13300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468416, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:13:36.425861 13445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.410529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:37655 (local address 127.0.0.1:35156)
0811 17:13:36.411220 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.411262 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 17:13:36.412322 (+ 1060us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:13:36.413111 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:13:36.413117 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:13:36.413640 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:13:36.413915 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:36.414020 (+ 105us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.415240 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.415244 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:36.415975 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:36.415984 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.416756 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.416764 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:36.416971 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:36.417666 (+ 695us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:13:36.417684 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:13:36.419464 (+ 1780us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:13:36.422461 (+ 2997us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:36.422471 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:36.422482 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:36.422775 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:36.423260 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:36.423266 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:36.423306 (+ 40us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:36.423446 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:36.424397 (+ 951us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:13:36.424403 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:13:36.424543 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 17:13:36.424706 (+ 163us) client_negotiation.cc:240] Negotiation successful
0811 17:13:36.425000 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":494,"mutex_wait_us":34,"thread_start_us":148,"threads_started":1}
I20260811 17:13:36.425865 13443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.410528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35156 (local address 127.4.146.254:37655)
0811 17:13:36.411053 (+ 525us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:36.411075 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:36.411386 (+ 311us) server_negotiation.cc:407] Connection header received
0811 17:13:36.412678 (+ 1292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:36.412682 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:36.412894 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:36.413107 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:36.414209 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.415107 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.416156 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.416573 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.416723 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:36.419642 (+ 2919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:36.419651 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:36.419666 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:36.419711 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:36.422272 (+ 2561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.422918 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.422927 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.422930 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.423097 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.423562 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.423568 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.423572 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.424268 (+ 696us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:36.424439 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:36.424828 (+ 389us) server_negotiation.cc:299] Negotiation successful
0811 17:13:36.425111 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":82,"server-negotiator.queue_time_us":344,"thread_start_us":168,"threads_started":1}
I20260811 17:13:36.428570 13439 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.253" port: 45969 } has no permanent_uuid. Determining permanent_uuid...
I20260811 17:13:36.429447 13445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.429174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:45969 (local address 127.0.0.1:44500)
0811 17:13:36.429300 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.429381 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.253:45969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 17:13:36.429656 13351 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.146.253:45969: connect: Connection refused (error 111)
I20260811 17:13:36.430639 13445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.430420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:45969 (local address 127.0.0.1:44504)
0811 17:13:36.430522 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.430582 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.253:45969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 17:13:36.430824 13439 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.253:45969: Network error: Client connection negotiation failed: client connection to 127.4.146.253:45969: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.253.keytab.
Entry for principal kudu/127.4.146.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.253.keytab.
I20260811 17:13:36.435532 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.253:45969
--webserver_interface=127.4.146.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.253.keytab
--principal=kudu/127.4.146.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:37655,127.4.146.253:45969,127.4.146.252:44247
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 17:13:36.480134 13439 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.253" port: 45969 } attempt: 1
I20260811 17:13:36.481158 13445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.480725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:45969 (local address 127.0.0.1:44512)
0811 17:13:36.480942 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.481038 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.253:45969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260811 17:13:36.482156 13445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.481868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:45969 (local address 127.0.0.1:44514)
0811 17:13:36.482013 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.482082 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.253:45969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260811 17:13:36.482306 13439 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.253:45969: Network error: Client connection negotiation failed: client connection to 127.4.146.253:45969: connect: Connection refused (error 111)
I20260811 17:13:36.550505 13439 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.253" port: 45969 } attempt: 2
I20260811 17:13:36.551544 13445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.551133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:45969 (local address 127.0.0.1:44518)
0811 17:13:36.551328 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.551445 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.253:45969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260811 17:13:36.552704 13445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.552434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:45969 (local address 127.0.0.1:44530)
0811 17:13:36.552585 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.552638 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.253:45969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
W20260811 17:13:36.552973 13439 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.253:45969: Network error: Client connection negotiation failed: client connection to 127.4.146.253:45969: connect: Connection refused (error 111)
W20260811 17:13:36.556834 13449 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 17:13:36.557156 13449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:13:36.557220 13449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:13:36.557323 13449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:13:36.561671 13449 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:13:36.561753 13449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:13:36.561774 13449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:13:36.561792 13449 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:13:36.561807 13449 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:13:36.567910 13449 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:37655,127.4.146.253:45969,127.4.146.252:44247
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.253.keytab
--principal=kudu/127.4.146.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.253:45969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.4.146.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13449
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:13:36.569267 13449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:13:36.570557 13449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:13:36.581362 13470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:36.581355 13462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:36.581355 13465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:36.581842 13449 server_base.cc:1034] running on GCE node
I20260811 17:13:36.582672 13449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:13:36.584308 13449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:13:36.585538 13449 hybrid_clock.cc:648] HybridClock initialized: now 1786468416585524 us; error 40 us; skew 500 ppm
Aug 11 17:13:36 dist-test-slave-7vjv krb5kdc[13300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468416, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:13:36.588822 13449 init.cc:377] Logged in from keytab as kudu/127.4.146.253@KRBTEST.COM (short username kudu)
I20260811 17:13:36.589946 13449 webserver.cc:460] Webserver started at http://127.4.146.253:37165/ using document root <none> and password file <none>
I20260811 17:13:36.590588 13449 fs_manager.cc:359] Metadata directory not provided
I20260811 17:13:36.590698 13449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:13:36.590960 13449 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:13:36.593559 13449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-1/data/instance:
uuid: "a76ac135e03d4d35b27a23c8188dd92a"
format_stamp: "Formatted at 2026-08-11 17:13:36 on dist-test-slave-7vjv"
server_key: "89d5a9211b7ca24894bf87f9c3697949"
server_key_iv: "0e6e264346192fcf3554dd184451e5a7"
server_key_version: "encryptionkey@0"
I20260811 17:13:36.594223 13449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-1/wal/instance:
uuid: "a76ac135e03d4d35b27a23c8188dd92a"
format_stamp: "Formatted at 2026-08-11 17:13:36 on dist-test-slave-7vjv"
server_key: "89d5a9211b7ca24894bf87f9c3697949"
server_key_iv: "0e6e264346192fcf3554dd184451e5a7"
server_key_version: "encryptionkey@0"
I20260811 17:13:36.599434 13449 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 17:13:36.602675 13483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:13:36.604339 13449 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 17:13:36.604522 13449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-1/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-1/wal
uuid: "a76ac135e03d4d35b27a23c8188dd92a"
format_stamp: "Formatted at 2026-08-11 17:13:36 on dist-test-slave-7vjv"
server_key: "89d5a9211b7ca24894bf87f9c3697949"
server_key_iv: "0e6e264346192fcf3554dd184451e5a7"
server_key_version: "encryptionkey@0"
I20260811 17:13:36.604705 13449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:13:36.629926 13449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:13:36.633656 13449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:13:36.633893 13449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:13:36.642602 13449 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.253:45969
I20260811 17:13:36.643013 13594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.253:45969 every 8 connection(s)
I20260811 17:13:36.643824 13449 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-1/data/info.pb
I20260811 17:13:36.644174 13439 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.253" port: 45969 } attempt: 3
I20260811 17:13:36.644311 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 13449
I20260811 17:13:36.644416 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-1/wal/instance
I20260811 17:13:36.644811 4683 external_mini_cluster.cc:1428] Setting key a3ff830b31568862be95add3e9435363
I20260811 17:13:36.647826 13595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:13:36.653185 13595 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37655 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 17:13:36 dist-test-slave-7vjv krb5kdc[13300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468416, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for kudu/127.4.146.253@KRBTEST.COM
WARNING: no policy specified for kudu/127.4.146.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.4.146.252@KRBTEST.COM" created.
I20260811 17:13:36.661996 13445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.644781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:45969 (local address 127.0.0.1:44536)
0811 17:13:36.645008 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.645025 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:13:36.645142 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:13:36.648123 (+ 2981us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:13:36.648128 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:13:36.648354 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:13:36.648502 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:36.648511 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.650476 (+ 1965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.650481 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:36.651437 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:36.651455 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.652750 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.652755 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:36.652876 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:36.653529 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:13:36.653549 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:13:36.655366 (+ 1817us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:13:36.658236 (+ 2870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:36.658238 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:36.658240 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:36.658602 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:36.659050 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:36.659054 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:36.659056 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:36.659171 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:36.660046 (+ 875us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:13:36.660049 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:13:36.660198 (+ 149us) client_negotiation.cc:769] Sending connection context
0811 17:13:36.660303 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 17:13:36.660475 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141}
Aug 11 17:13:36 dist-test-slave-7vjv krb5kdc[13300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468416, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.253@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:13:36.664211 13597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.645654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44536 (local address 127.4.146.253:45969)
0811 17:13:36.646210 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:36.646235 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:36.646288 (+ 53us) server_negotiation.cc:407] Connection header received
0811 17:13:36.647376 (+ 1088us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:36.647400 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:36.647771 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:36.648208 (+ 437us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:36.648684 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.650286 (+ 1602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.651630 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.652574 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.652796 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:36.655666 (+ 2870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:36.655673 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:36.655692 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:36.655731 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:36.658084 (+ 2353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.658726 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.658731 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.658737 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.658897 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.659292 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.659296 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.659298 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.659893 (+ 595us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:36.660089 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:36.662549 (+ 2460us) server_negotiation.cc:299] Negotiation successful
0811 17:13:36.662942 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":168,"threads_started":1}
I20260811 17:13:36.667109 13439 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } has no permanent_uuid. Determining permanent_uuid...
I20260811 17:13:36.667922 13443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.655498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35164 (local address 127.4.146.254:37655)
0811 17:13:36.655663 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:36.655672 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:36.656244 (+ 572us) server_negotiation.cc:407] Connection header received
0811 17:13:36.656501 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:36.656505 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:36.656575 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:36.656689 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:36.657606 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.658412 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.659636 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.660923 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.661051 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:36.663927 (+ 2876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:36.663936 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:36.663938 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:36.663965 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:36.665734 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.666271 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.666275 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.666277 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.666374 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.666754 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.666761 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.666766 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.667071 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:36.667201 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:36.667620 (+ 419us) server_negotiation.cc:299] Negotiation successful
0811 17:13:36.667754 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 17:13:36.667968 13599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.655487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:37655 (local address 127.0.0.1:35164)
0811 17:13:36.656056 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.656159 (+ 103us) client_negotiation.cc:174] Beginning negotiation
0811 17:13:36.656345 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:13:36.656739 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:13:36.656745 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:13:36.657284 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:13:36.657446 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:36.657453 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.658593 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.658597 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:36.659513 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:36.659523 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.661221 (+ 1698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.661227 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:36.661399 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:36.662075 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:13:36.662106 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:13:36.663761 (+ 1655us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:13:36.665865 (+ 2104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:36.665877 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:36.665883 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:36.666139 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:36.666480 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:36.666484 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:36.666487 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:36.666574 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:36.667207 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:13:36.667213 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:13:36.667358 (+ 145us) client_negotiation.cc:769] Sending connection context
0811 17:13:36.667544 (+ 186us) client_negotiation.cc:240] Negotiation successful
0811 17:13:36.667755 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":188,"threads_started":1}
I20260811 17:13:36.668578 13445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.667714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:44247 (local address 127.0.0.1:38536)
0811 17:13:36.667940 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.668006 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:44247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126}
I20260811 17:13:36.669127 13595 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.253" port: 45969 } has no permanent_uuid. Determining permanent_uuid...
I20260811 17:13:36.669539 13445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.669241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:44247 (local address 127.0.0.1:38546)
0811 17:13:36.669402 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.669461 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:44247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
W20260811 17:13:36.669751 13439 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.252:44247: Network error: Client connection negotiation failed: client connection to 127.4.146.252:44247: connect: Connection refused (error 111)
Aug 11 17:13:36 dist-test-slave-7vjv krb5kdc[13300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468416, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.253@KRBTEST.COM for kudu/127.4.146.253@KRBTEST.COM
I20260811 17:13:36.680164 13599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.670289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:45969 (local address 127.0.0.1:44550)
0811 17:13:36.670390 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.670406 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 17:13:36.670500 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:13:36.670784 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:13:36.670787 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:13:36.670949 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:13:36.671055 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:36.671060 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.672231 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.672233 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:36.672755 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:36.672764 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.673375 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.673380 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:36.673491 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:36.674091 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:13:36.674105 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:13:36.675957 (+ 1852us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:13:36.678234 (+ 2277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:36.678237 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:36.678239 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:36.678458 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:36.678842 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:36.678845 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:36.678847 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:36.678943 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:36.679538 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:13:36.679540 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:13:36.679648 (+ 108us) client_negotiation.cc:769] Sending connection context
0811 17:13:36.679760 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 17:13:36.679961 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 17:13:36.680317 13597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.670381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44550 (local address 127.4.146.253:45969)
0811 17:13:36.670516 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:36.670522 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:36.670538 (+ 16us) server_negotiation.cc:407] Connection header received
0811 17:13:36.670578 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:36.670581 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:36.670647 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:36.670746 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:36.671184 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.672058 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.672884 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.673184 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.673284 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:36.676203 (+ 2919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:36.676206 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:36.676208 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:36.676233 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:36.678098 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.678591 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.678594 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.678595 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.678714 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.679068 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.679071 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.679072 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.679389 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:36.679499 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:36.679876 (+ 377us) server_negotiation.cc:299] Negotiation successful
0811 17:13:36.680083 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":54}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.4.146.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.252.keytab.
Entry for principal kudu/127.4.146.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.252.keytab.
I20260811 17:13:36.681627 13595 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } has no permanent_uuid. Determining permanent_uuid...
I20260811 17:13:36.682511 13599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.682199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:44247 (local address 127.0.0.1:38550)
0811 17:13:36.682355 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.682442 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:44247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 17:13:36.682767 4683 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
/tmp/dist-test-taskk7LoRW/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.252:44247
--webserver_interface=127.4.146.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.252.keytab
--principal=kudu/127.4.146.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.4.146.212:45785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.4.146.254:37655,127.4.146.253:45969,127.4.146.252:44247
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 17:13:36.682833 13495 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.146.252:44247: connect: Connection refused (error 111)
I20260811 17:13:36.683894 13599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.683629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:44247 (local address 127.0.0.1:38554)
0811 17:13:36.683770 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.683833 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:44247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260811 17:13:36.684188 13595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.252:44247: Network error: Client connection negotiation failed: client connection to 127.4.146.252:44247: connect: Connection refused (error 111)
I20260811 17:13:36.700923 13439 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } attempt: 1
I20260811 17:13:36.701939 13445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.701555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:44247 (local address 127.0.0.1:38570)
0811 17:13:36.701758 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.701838 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:44247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260811 17:13:36.702941 13445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.702567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:44247 (local address 127.0.0.1:38572)
0811 17:13:36.702787 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.702852 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:44247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129}
W20260811 17:13:36.703212 13439 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.252:44247: Network error: Client connection negotiation failed: client connection to 127.4.146.252:44247: connect: Connection refused (error 111)
I20260811 17:13:36.733500 13595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } attempt: 1
I20260811 17:13:36.734545 13599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.734190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:44247 (local address 127.0.0.1:38584)
0811 17:13:36.734383 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.734455 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:44247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260811 17:13:36.735399 13599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.735161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:44247 (local address 127.0.0.1:38586)
0811 17:13:36.735277 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.735336 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:44247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260811 17:13:36.735540 13595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.252:44247: Network error: Client connection negotiation failed: client connection to 127.4.146.252:44247: connect: Connection refused (error 111)
I20260811 17:13:36.778425 13439 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } attempt: 2
I20260811 17:13:36.779341 13445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.778982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:44247 (local address 127.0.0.1:38588)
0811 17:13:36.779167 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.779244 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:44247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260811 17:13:36.780171 13445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.779897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:44247 (local address 127.0.0.1:38604)
0811 17:13:36.780025 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.780081 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:44247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 17:13:36.780315 13439 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.252:44247: Network error: Client connection negotiation failed: client connection to 127.4.146.252:44247: connect: Connection refused (error 111)
I20260811 17:13:36.803745 13595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } attempt: 2
I20260811 17:13:36.804759 13599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.804435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:44247 (local address 127.0.0.1:38606)
0811 17:13:36.804597 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.804673 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:44247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260811 17:13:36.805576 13599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.805340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:44247 (local address 127.0.0.1:38608)
0811 17:13:36.805456 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.805513 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.146.252:44247: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 17:13:36.805780 13595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.4.146.252:44247: Network error: Client connection negotiation failed: client connection to 127.4.146.252:44247: connect: Connection refused (error 111)
W20260811 17:13:36.807808 13605 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 17:13:36.808207 13605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 17:13:36.808288 13605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 17:13:36.808367 13605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 17:13:36.812865 13605 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 17:13:36.812940 13605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 17:13:36.812960 13605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 17:13:36.812978 13605 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 17:13:36.812994 13605 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 17:13:36.818786 13605 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.4.146.212:45785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.4.146.254:37655,127.4.146.253:45969,127.4.146.252:44247
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/krb5kdc/kudu_127.4.146.252.keytab
--principal=kudu/127.4.146.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.4.146.252:44247
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.4.146.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13605
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 16:30:47 UTC on ccycloud.quasar-gzgosm.root.comops.site
build id 4580888
I20260811 17:13:36.820075 13605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 17:13:36.821345 13605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 17:13:36.830801 13614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:36.830847 13621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 17:13:36.830847 13612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 17:13:36.831128 13605 server_base.cc:1034] running on GCE node
I20260811 17:13:36.831871 13605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 17:13:36.833628 13605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 17:13:36.834848 13605 hybrid_clock.cc:648] HybridClock initialized: now 1786468416834804 us; error 54 us; skew 500 ppm
Aug 11 17:13:36 dist-test-slave-7vjv krb5kdc[13300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468416, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 17:13:36.837976 13605 init.cc:377] Logged in from keytab as kudu/127.4.146.252@KRBTEST.COM (short username kudu)
I20260811 17:13:36.839004 13605 webserver.cc:460] Webserver started at http://127.4.146.252:37467/ using document root <none> and password file <none>
I20260811 17:13:36.839578 13605 fs_manager.cc:359] Metadata directory not provided
I20260811 17:13:36.839641 13605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 17:13:36.839840 13605 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 17:13:36.842087 13605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-2/data/instance:
uuid: "1abd0cb9e764418eac729b7114387602"
format_stamp: "Formatted at 2026-08-11 17:13:36 on dist-test-slave-7vjv"
server_key: "059a3e227bce699eb3a3157d7f2ad797"
server_key_iv: "c06564da8c7fafc1bfb73e9574ea6006"
server_key_version: "encryptionkey@0"
I20260811 17:13:36.842653 13605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-2/wal/instance:
uuid: "1abd0cb9e764418eac729b7114387602"
format_stamp: "Formatted at 2026-08-11 17:13:36 on dist-test-slave-7vjv"
server_key: "059a3e227bce699eb3a3157d7f2ad797"
server_key_iv: "c06564da8c7fafc1bfb73e9574ea6006"
server_key_version: "encryptionkey@0"
I20260811 17:13:36.847349 13605 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260811 17:13:36.850270 13631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 17:13:36.851892 13605 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260811 17:13:36.852015 13605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-2/data,/tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-2/wal
uuid: "1abd0cb9e764418eac729b7114387602"
format_stamp: "Formatted at 2026-08-11 17:13:36 on dist-test-slave-7vjv"
server_key: "059a3e227bce699eb3a3157d7f2ad797"
server_key_iv: "c06564da8c7fafc1bfb73e9574ea6006"
server_key_version: "encryptionkey@0"
I20260811 17:13:36.852216 13605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 17:13:36.865401 13605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 17:13:36.868706 13605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 17:13:36.868887 13605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 17:13:36.876477 13605 rpc_server.cc:307] RPC server started. Bound to: 127.4.146.252:44247
I20260811 17:13:36.876824 13736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.4.146.252:44247 every 8 connection(s)
I20260811 17:13:36.877701 13605 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-2/data/info.pb
I20260811 17:13:36.879499 13439 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } attempt: 3
I20260811 17:13:36.881341 13737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 17:13:36.881997 4683 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu as pid 13605
I20260811 17:13:36.882138 4683 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskk7LoRW/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786468091870818-4683-0/minicluster-data/master-2/wal/instance
I20260811 17:13:36.882485 4683 external_mini_cluster.cc:1428] Setting key 2fb0140851e443b499893f575500fdbd
I20260811 17:13:36.886556 13737 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37655 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 17:13:36 dist-test-slave-7vjv krb5kdc[13300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468416, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.254@KRBTEST.COM for kudu/127.4.146.252@KRBTEST.COM
Aug 11 17:13:36 dist-test-slave-7vjv krb5kdc[13300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468416, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.252@KRBTEST.COM
Aug 11 17:13:36 dist-test-slave-7vjv krb5kdc[13300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468416, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.252@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:13:36.896948 13595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } attempt: 3
I20260811 17:13:36.897610 13445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.880167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:44247 (local address 127.0.0.1:38614)
0811 17:13:36.880359 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.880383 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 17:13:36.880521 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:13:36.883563 (+ 3042us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:13:36.883567 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:13:36.883791 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:13:36.883926 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:36.883937 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.885917 (+ 1980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.885923 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:36.886723 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:36.886739 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.887858 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.887864 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:36.887988 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:36.888832 (+ 844us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:13:36.888851 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:13:36.891528 (+ 2677us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:13:36.895168 (+ 3640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:36.895172 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:36.895174 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:36.895404 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:36.895885 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:36.895892 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:36.895895 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:36.896040 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:36.896930 (+ 890us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:13:36.896935 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:13:36.897069 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 17:13:36.897212 (+ 143us) client_negotiation.cc:240] Negotiation successful
0811 17:13:36.897412 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260811 17:13:36.899560 13740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.883220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38626 (local address 127.4.146.252:44247)
0811 17:13:36.884261 (+ 1041us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:36.884270 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:36.884284 (+ 14us) server_negotiation.cc:407] Connection header received
0811 17:13:36.884336 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:36.884339 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:36.884384 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:36.884480 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:36.885613 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.886237 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.887285 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.887704 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.887865 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:36.891788 (+ 3923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:36.891794 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:36.891808 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:36.891852 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:36.895023 (+ 3171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.895707 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.895710 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.895712 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.895793 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.896232 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.896236 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.896238 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.896797 (+ 559us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:36.896999 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:36.898157 (+ 1158us) server_negotiation.cc:299] Negotiation successful
0811 17:13:36.898354 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":130,"server-negotiator.queue_time_us":970,"spinlock_wait_cycles":13696,"thread_start_us":145,"threads_started":1}
I20260811 17:13:36.899565 13739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.881101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38614 (local address 127.4.146.252:44247)
0811 17:13:36.881637 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:36.881656 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:36.881697 (+ 41us) server_negotiation.cc:407] Connection header received
0811 17:13:36.882608 (+ 911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:36.882641 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:36.883136 (+ 495us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:36.883631 (+ 495us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:36.884187 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.885754 (+ 1567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.886871 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.887684 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.887868 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:36.891786 (+ 3918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:36.891794 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:36.891808 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:36.891851 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:36.895008 (+ 3157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.895540 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.895546 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.895554 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.895750 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.896195 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.896200 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.896202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.896783 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:36.896950 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:36.897413 (+ 463us) server_negotiation.cc:299] Negotiation successful
0811 17:13:36.898286 (+ 873us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":71,"server-negotiator.queue_time_us":367,"spinlock_wait_cycles":6656,"thread_start_us":146,"threads_started":1}
I20260811 17:13:36.903009 13443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.888970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35180 (local address 127.4.146.254:37655)
0811 17:13:36.889136 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:36.889145 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:36.889557 (+ 412us) server_negotiation.cc:407] Connection header received
0811 17:13:36.889710 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:36.889714 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:36.889778 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:36.889884 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:36.890931 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.891551 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.892961 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.893305 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.893448 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:36.898275 (+ 4827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:36.898279 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:36.898282 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:36.898309 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:36.900134 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.900696 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.900699 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.900701 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.900793 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.901813 (+ 1020us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.901816 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.901818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.902120 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:36.902209 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:36.902735 (+ 526us) server_negotiation.cc:299] Negotiation successful
0811 17:13:36.902879 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 17:13:36.903427 13746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.888913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.254:37655 (local address 127.0.0.1:35180)
0811 17:13:36.889383 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.889450 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 17:13:36.889593 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:13:36.889976 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:13:36.889983 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:13:36.890553 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:13:36.890759 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:36.890770 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.891732 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.891737 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:36.892791 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:36.892805 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.893629 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.893637 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:36.893806 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:36.894439 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:13:36.894453 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:13:36.898114 (+ 3661us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:13:36.900260 (+ 2146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:36.900269 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:36.900274 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:36.900559 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:36.901589 (+ 1030us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:36.901592 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:36.901594 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:36.901693 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:36.902305 (+ 612us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:13:36.902311 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:13:36.902446 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 17:13:36.903121 (+ 675us) client_negotiation.cc:240] Negotiation successful
0811 17:13:36.903293 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":126,"threads_started":1}
Aug 11 17:13:36 dist-test-slave-7vjv krb5kdc[13300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468416, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.253@KRBTEST.COM for kudu/127.4.146.252@KRBTEST.COM
I20260811 17:13:36.904909 13439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6: Bootstrap starting.
I20260811 17:13:36.907603 13439 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6: Neither blocks nor log segments found. Creating new log.
I20260811 17:13:36.907994 13599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.897459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:44247 (local address 127.0.0.1:38636)
0811 17:13:36.897697 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.897714 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:13:36.897801 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:13:36.898452 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:13:36.898456 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:13:36.899050 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:13:36.899462 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:36.899477 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.900759 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.900765 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:36.901589 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:36.901602 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.902258 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.902262 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:36.902372 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:36.902953 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:13:36.902971 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:13:36.904576 (+ 1605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:13:36.906378 (+ 1802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:36.906382 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:36.906384 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:36.906613 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:36.906913 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:36.906917 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:36.906919 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:36.907014 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:36.907421 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:13:36.907424 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:13:36.907537 (+ 113us) client_negotiation.cc:769] Sending connection context
0811 17:13:36.907649 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 17:13:36.907814 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151}
I20260811 17:13:36.908011 13747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.897500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38636 (local address 127.4.146.252:44247)
0811 17:13:36.898151 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:36.898163 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:36.898180 (+ 17us) server_negotiation.cc:407] Connection header received
0811 17:13:36.898222 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:36.898226 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:36.898280 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:36.899613 (+ 1333us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:36.899792 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.900604 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.901751 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.902095 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.904229 (+ 2134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:36.904728 (+ 499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:36.904732 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:36.904735 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:36.904763 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:36.906254 (+ 1491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.906726 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.906730 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.906731 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.906814 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.907120 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.907125 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.907126 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.907318 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:36.907430 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:36.907716 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 17:13:36.907839 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":142,"threads_started":1}
I20260811 17:13:36.909507 13439 log.cc:824] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6: Log is configured to *not* fsync() on all Append() calls
I20260811 17:13:36.910010 13737 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.253" port: 45969 } has no permanent_uuid. Determining permanent_uuid...
I20260811 17:13:36.911793 13595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a76ac135e03d4d35b27a23c8188dd92a: Bootstrap starting.
I20260811 17:13:36.913826 13439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6: No bootstrap required, opened a new log
Aug 11 17:13:36 dist-test-slave-7vjv krb5kdc[13300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468416, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.254@KRBTEST.COM
I20260811 17:13:36.914971 13595 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a76ac135e03d4d35b27a23c8188dd92a: Neither blocks nor log segments found. Creating new log.
I20260811 17:13:36.916023 13595 log.cc:824] T 00000000000000000000000000000000 P a76ac135e03d4d35b27a23c8188dd92a: Log is configured to *not* fsync() on all Append() calls
Aug 11 17:13:36 dist-test-slave-7vjv krb5kdc[13300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468416, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.252@KRBTEST.COM for kudu/127.4.146.253@KRBTEST.COM
I20260811 17:13:36.918586 13595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a76ac135e03d4d35b27a23c8188dd92a: No bootstrap required, opened a new log
I20260811 17:13:36.919912 13443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.908261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35184 (local address 127.4.146.254:37655)
0811 17:13:36.908427 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:36.908432 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:36.908445 (+ 13us) server_negotiation.cc:407] Connection header received
0811 17:13:36.908488 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:36.908494 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:36.908542 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:36.908657 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:36.909809 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.910559 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.911717 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.912023 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.912130 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:36.915424 (+ 3294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:36.915429 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:36.915431 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:36.915458 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:36.917307 (+ 1849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.917843 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.917847 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.917848 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.917942 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.918330 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.918335 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.918337 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.918605 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:36.918782 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:36.919581 (+ 799us) server_negotiation.cc:299] Negotiation successful
0811 17:13:36.919740 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 17:13:36.920382 13439 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa13d4eae704f4489c90054767865a6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37655 } } peers { permanent_uuid: "a76ac135e03d4d35b27a23c8188dd92a" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 45969 } } peers { permanent_uuid: "1abd0cb9e764418eac729b7114387602" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } }
I20260811 17:13:36.920653 13439 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6aa13d4eae704f4489c90054767865a6, State: Initialized, Role: FOLLOWER
I20260811 17:13:36.920933 13597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.910870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44554 (local address 127.4.146.253:45969)
0811 17:13:36.911070 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:36.911074 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:36.911085 (+ 11us) server_negotiation.cc:407] Connection header received
0811 17:13:36.911119 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:36.911121 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:36.911158 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:36.911264 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:36.911830 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.912605 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.913793 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.914101 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.914197 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:36.917063 (+ 2866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:36.917068 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:36.917071 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:36.917101 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:36.918784 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.919314 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.919318 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.919319 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.919405 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.919888 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.919892 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.919894 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.920179 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:36.920256 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:36.920655 (+ 399us) server_negotiation.cc:299] Negotiation successful
0811 17:13:36.920784 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133}
I20260811 17:13:36.921041 13439 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa13d4eae704f4489c90054767865a6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37655 } } peers { permanent_uuid: "a76ac135e03d4d35b27a23c8188dd92a" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 45969 } } peers { permanent_uuid: "1abd0cb9e764418eac729b7114387602" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } }
I20260811 17:13:36.921489 13746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.910633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.253:45969 (local address 127.0.0.1:44554)
0811 17:13:36.910743 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.910760 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 17:13:36.910845 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:13:36.911280 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:13:36.911284 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:13:36.911499 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:13:36.911659 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:36.911670 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.912829 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.912833 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:36.913633 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:36.913647 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.914413 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.914417 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:36.914540 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:36.915163 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:13:36.915184 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:13:36.916870 (+ 1686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:13:36.918917 (+ 2047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:36.918922 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:36.918926 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:36.919196 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:36.919655 (+ 459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:36.919658 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:36.919660 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:36.919773 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:36.920335 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:13:36.920338 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:13:36.920443 (+ 105us) client_negotiation.cc:769] Sending connection context
0811 17:13:36.921134 (+ 691us) client_negotiation.cc:240] Negotiation successful
0811 17:13:36.921304 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 17:13:36.921864 13753 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa13d4eae704f4489c90054767865a6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37655 } } peers { permanent_uuid: "a76ac135e03d4d35b27a23c8188dd92a" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 45969 } } peers { permanent_uuid: "1abd0cb9e764418eac729b7114387602" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } } }
I20260811 17:13:36.922120 13753 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:13:36.922268 13737 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } has no permanent_uuid. Determining permanent_uuid...
I20260811 17:13:36.922972 13439 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6 [sys.catalog]: configured and running, proceeding with master startup.
Aug 11 17:13:36 dist-test-slave-7vjv krb5kdc[13300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468416, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.4.146.253@KRBTEST.COM
Aug 11 17:13:36 dist-test-slave-7vjv krb5kdc[13300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786468416, etypes {rep=17 tkt=17 ses=17}, kudu/127.4.146.252@KRBTEST.COM for kudu/127.4.146.252@KRBTEST.COM
I20260811 17:13:36.929818 13595 raft_consensus.cc:348] T 00000000000000000000000000000000 P a76ac135e03d4d35b27a23c8188dd92a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa13d4eae704f4489c90054767865a6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37655 } } peers { permanent_uuid: "a76ac135e03d4d35b27a23c8188dd92a" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 45969 } } peers { permanent_uuid: "1abd0cb9e764418eac729b7114387602" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } }
I20260811 17:13:36.930079 13595 raft_consensus.cc:729] T 00000000000000000000000000000000 P a76ac135e03d4d35b27a23c8188dd92a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a76ac135e03d4d35b27a23c8188dd92a, State: Initialized, Role: FOLLOWER
I20260811 17:13:36.930449 13595 consensus_queue.cc:260] T 00000000000000000000000000000000 P a76ac135e03d4d35b27a23c8188dd92a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa13d4eae704f4489c90054767865a6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37655 } } peers { permanent_uuid: "a76ac135e03d4d35b27a23c8188dd92a" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 45969 } } peers { permanent_uuid: "1abd0cb9e764418eac729b7114387602" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } }
I20260811 17:13:36.931979 13595 sys_catalog.cc:564] T 00000000000000000000000000000000 P a76ac135e03d4d35b27a23c8188dd92a [sys.catalog]: configured and running, proceeding with master startup.
W20260811 17:13:36.932269 13776 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 17:13:36.932375 13776 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 17:13:36.929709 13323 master_runner.cc:186] Error getting master registration for 127.4.146.253:45969: OK, instance_id { permanent_uuid: "a76ac135e03d4d35b27a23c8188dd92a" instance_seqno: 1786468416640035 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 17:13:36.933840 13323 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 17:13:36.935222 13597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.921536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44560 (local address 127.4.146.253:45969)
0811 17:13:36.922018 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:36.922024 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:36.922038 (+ 14us) server_negotiation.cc:407] Connection header received
0811 17:13:36.922076 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:36.922079 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:36.922124 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:36.922194 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:36.923083 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.923803 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.924830 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.925156 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.925252 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:36.929778 (+ 4526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:36.929783 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:36.929785 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:36.929817 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:36.932000 (+ 2183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.932895 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.932899 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.932901 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.933012 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.933452 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.933457 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.933458 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.933714 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:36.934125 (+ 411us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:36.934898 (+ 773us) server_negotiation.cc:299] Negotiation successful
0811 17:13:36.935041 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412}
I20260811 17:13:36.935932 13779 sys_catalog.cc:455] T 00000000000000000000000000000000 P a76ac135e03d4d35b27a23c8188dd92a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa13d4eae704f4489c90054767865a6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37655 } } peers { permanent_uuid: "a76ac135e03d4d35b27a23c8188dd92a" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 45969 } } peers { permanent_uuid: "1abd0cb9e764418eac729b7114387602" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } } }
I20260811 17:13:36.936128 13779 sys_catalog.cc:458] T 00000000000000000000000000000000 P a76ac135e03d4d35b27a23c8188dd92a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:13:36.937301 13747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.923011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38652 (local address 127.4.146.252:44247)
0811 17:13:36.923125 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:36.923130 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:36.923145 (+ 15us) server_negotiation.cc:407] Connection header received
0811 17:13:36.923186 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:36.923188 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:36.923232 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:36.923331 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:36.923753 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.924573 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.925600 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.925935 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.926029 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:36.929182 (+ 3153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:36.929187 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:36.929189 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:36.929215 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:36.934719 (+ 5504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.935551 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.935555 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.935558 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.935650 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.936158 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.936161 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.936163 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.936418 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:36.936504 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:36.936975 (+ 471us) server_negotiation.cc:299] Negotiation successful
0811 17:13:36.937131 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 17:13:36.938054 13746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.922838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.4.146.252:44247 (local address 127.0.0.1:38652)
0811 17:13:36.922941 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0811 17:13:36.922954 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 17:13:36.923033 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 17:13:36.923357 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 17:13:36.923360 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 17:13:36.923529 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 17:13:36.923620 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:36.923626 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.924706 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.924710 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:36.925475 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 17:13:36.925485 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.926160 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.926164 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 17:13:36.926251 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:36.926697 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 17:13:36.926717 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 17:13:36.929015 (+ 2298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 17:13:36.935144 (+ 6129us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:36.935150 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:36.935154 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:36.935436 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:36.935780 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 17:13:36.935784 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 17:13:36.935786 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 17:13:36.935901 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 17:13:36.936691 (+ 790us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 17:13:36.936694 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 17:13:36.936795 (+ 101us) client_negotiation.cc:769] Sending connection context
0811 17:13:36.937731 (+ 936us) client_negotiation.cc:240] Negotiation successful
0811 17:13:36.937895 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 17:13:36.941146 13797 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a76ac135e03d4d35b27a23c8188dd92a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 17:13:36.941305 13797 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 17:13:36.941555 4683 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 17:13:36.941690 13737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1abd0cb9e764418eac729b7114387602: Bootstrap starting.
I20260811 17:13:36.942817 13396 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "6aa13d4eae704f4489c90054767865a6"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35184
I20260811 17:13:36.943097 13396 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 17:13:36.943228 13396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:13:36.944831 13737 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1abd0cb9e764418eac729b7114387602: Neither blocks nor log segments found. Creating new log.
I20260811 17:13:36.945243 13396 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa13d4eae704f4489c90054767865a6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37655 } } peers { permanent_uuid: "a76ac135e03d4d35b27a23c8188dd92a" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 45969 } } peers { permanent_uuid: "1abd0cb9e764418eac729b7114387602" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } }
I20260811 17:13:36.945815 13737 log.cc:824] T 00000000000000000000000000000000 P 1abd0cb9e764418eac729b7114387602: Log is configured to *not* fsync() on all Append() calls
I20260811 17:13:36.946853 13544 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6aa13d4eae704f4489c90054767865a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a76ac135e03d4d35b27a23c8188dd92a"
I20260811 17:13:36.947101 13544 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a76ac135e03d4d35b27a23c8188dd92a [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:13:36.948549 13737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1abd0cb9e764418eac729b7114387602: No bootstrap required, opened a new log
I20260811 17:13:36.949101 13544 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a76ac135e03d4d35b27a23c8188dd92a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aa13d4eae704f4489c90054767865a6 in term 1.
I20260811 17:13:36.949533 13351 leader_election.cc:302] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6aa13d4eae704f4489c90054767865a6, a76ac135e03d4d35b27a23c8188dd92a; no voters:
I20260811 17:13:36.949899 13753 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 17:13:36.950172 13753 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6 [term 1 LEADER]: Becoming Leader. State: Replica: 6aa13d4eae704f4489c90054767865a6, State: Running, Role: LEADER
I20260811 17:13:36.950529 13753 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa13d4eae704f4489c90054767865a6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37655 } } peers { permanent_uuid: "a76ac135e03d4d35b27a23c8188dd92a" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 45969 } } peers { permanent_uuid: "1abd0cb9e764418eac729b7114387602" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } }
I20260811 17:13:36.948909 13449 master_runner.cc:186] Error getting master registration for 127.4.146.252:44247: OK, instance_id { permanent_uuid: "1abd0cb9e764418eac729b7114387602" instance_seqno: 1786468416874281 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 17:13:36.952296 13449 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 17:13:36.952543 13753 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6aa13d4eae704f4489c90054767865a6. Latest consensus state: current_term: 1 leader_uuid: "6aa13d4eae704f4489c90054767865a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa13d4eae704f4489c90054767865a6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37655 } } peers { permanent_uuid: "a76ac135e03d4d35b27a23c8188dd92a" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 45969 } } peers { permanent_uuid: "1abd0cb9e764418eac729b7114387602" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } } }
I20260811 17:13:36.952672 13753 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:36.953073 13396 leader_election.cc:288] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6 [CANDIDATE]: Term 1 election: Requested vote from peers a76ac135e03d4d35b27a23c8188dd92a (127.4.146.253:45969), 1abd0cb9e764418eac729b7114387602 (127.4.146.252:44247)
I20260811 17:13:36.954012 13737 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1abd0cb9e764418eac729b7114387602 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa13d4eae704f4489c90054767865a6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37655 } } peers { permanent_uuid: "a76ac135e03d4d35b27a23c8188dd92a" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 45969 } } peers { permanent_uuid: "1abd0cb9e764418eac729b7114387602" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } }
I20260811 17:13:36.954312 13737 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1abd0cb9e764418eac729b7114387602 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abd0cb9e764418eac729b7114387602, State: Initialized, Role: FOLLOWER
I20260811 17:13:36.954685 13737 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1abd0cb9e764418eac729b7114387602 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa13d4eae704f4489c90054767865a6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37655 } } peers { permanent_uuid: "a76ac135e03d4d35b27a23c8188dd92a" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 45969 } } peers { permanent_uuid: "1abd0cb9e764418eac729b7114387602" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } }
I20260811 17:13:36.955070 13810 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 17:13:36.956185 13737 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1abd0cb9e764418eac729b7114387602 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 17:13:36.956238 13680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6aa13d4eae704f4489c90054767865a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "1abd0cb9e764418eac729b7114387602"
I20260811 17:13:36.956499 13680 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1abd0cb9e764418eac729b7114387602 [term 0 FOLLOWER]: Advancing to term 1
I20260811 17:13:36.956571 13810 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 17:13:36.957975 13680 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1abd0cb9e764418eac729b7114387602 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6aa13d4eae704f4489c90054767865a6 in term 1.
I20260811 17:13:36.960923 13817 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1abd0cb9e764418eac729b7114387602 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa13d4eae704f4489c90054767865a6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37655 } } peers { permanent_uuid: "a76ac135e03d4d35b27a23c8188dd92a" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 45969 } } peers { permanent_uuid: "1abd0cb9e764418eac729b7114387602" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } } }
I20260811 17:13:36.961125 13817 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1abd0cb9e764418eac729b7114387602 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:13:36.969304 13747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.955653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38666 (local address 127.4.146.252:44247)
0811 17:13:36.955769 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:36.955774 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:36.959053 (+ 3279us) server_negotiation.cc:407] Connection header received
0811 17:13:36.959260 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:36.959263 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:36.959315 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:36.959365 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:36.960508 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.961311 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.962661 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.963009 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.963086 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:36.965289 (+ 2203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:36.965293 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:36.965297 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:36.965327 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:36.967234 (+ 1907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.967814 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.967818 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.967820 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.967908 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.968266 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.968270 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.968272 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.968500 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:36.968652 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:36.968995 (+ 343us) server_negotiation.cc:299] Negotiation successful
0811 17:13:36.969134 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 17:13:36.973380 13680 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1abd0cb9e764418eac729b7114387602 [term 1 FOLLOWER]: Refusing update from remote peer 6aa13d4eae704f4489c90054767865a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:13:36.974169 13807 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1abd0cb9e764418eac729b7114387602" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 17:13:36.975950 13836 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1abd0cb9e764418eac729b7114387602: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 17:13:36.976199 13836 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 17:13:36.978844 13817 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1abd0cb9e764418eac729b7114387602 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6aa13d4eae704f4489c90054767865a6. Latest consensus state: current_term: 1 leader_uuid: "6aa13d4eae704f4489c90054767865a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa13d4eae704f4489c90054767865a6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37655 } } peers { permanent_uuid: "a76ac135e03d4d35b27a23c8188dd92a" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 45969 } } peers { permanent_uuid: "1abd0cb9e764418eac729b7114387602" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } } }
I20260811 17:13:36.979001 13817 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1abd0cb9e764418eac729b7114387602 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:13:36.980549 13544 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a76ac135e03d4d35b27a23c8188dd92a [term 1 FOLLOWER]: Refusing update from remote peer 6aa13d4eae704f4489c90054767865a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 17:13:36.981285 13807 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a76ac135e03d4d35b27a23c8188dd92a" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 45969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 17:13:36.982890 13597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.960756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44574 (local address 127.4.146.253:45969)
0811 17:13:36.960887 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:36.960891 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:36.971240 (+ 10349us) server_negotiation.cc:407] Connection header received
0811 17:13:36.971418 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:36.971421 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:36.971476 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:36.971527 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:36.972479 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.973166 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.974545 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.974876 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.974959 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:36.978384 (+ 3425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:36.978388 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:36.978391 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:36.978423 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:36.980582 (+ 2159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.981286 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.981292 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.981295 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.981410 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.981821 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.981825 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.981827 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.982067 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:36.982204 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:36.982574 (+ 370us) server_negotiation.cc:299] Negotiation successful
0811 17:13:36.982724 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 17:13:36.986397 13779 sys_catalog.cc:455] T 00000000000000000000000000000000 P a76ac135e03d4d35b27a23c8188dd92a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6aa13d4eae704f4489c90054767865a6. Latest consensus state: current_term: 1 leader_uuid: "6aa13d4eae704f4489c90054767865a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa13d4eae704f4489c90054767865a6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37655 } } peers { permanent_uuid: "a76ac135e03d4d35b27a23c8188dd92a" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 45969 } } peers { permanent_uuid: "1abd0cb9e764418eac729b7114387602" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } } }
I20260811 17:13:36.986569 13779 sys_catalog.cc:458] T 00000000000000000000000000000000 P a76ac135e03d4d35b27a23c8188dd92a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:13:36.989789 13443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:36.959273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35198 (local address 127.4.146.254:37655)
0811 17:13:36.959402 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:36.959406 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:36.966923 (+ 7517us) server_negotiation.cc:407] Connection header received
0811 17:13:36.967162 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:36.967166 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:36.967229 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:36.967294 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:36.968404 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.969262 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.970634 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:36.971014 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:36.971102 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:36.977406 (+ 6304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 17:13:36.977411 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 17:13:36.977414 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 17:13:36.977450 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 17:13:36.979474 (+ 2024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.987803 (+ 8329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.987808 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.987811 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.987967 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 17:13:36.988489 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 17:13:36.988494 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 17:13:36.988496 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 17:13:36.988804 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 17:13:36.988972 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:36.989409 (+ 437us) server_negotiation.cc:299] Negotiation successful
0811 17:13:36.989591 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 17:13:36.989884 13807 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6aa13d4eae704f4489c90054767865a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa13d4eae704f4489c90054767865a6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37655 } } peers { permanent_uuid: "a76ac135e03d4d35b27a23c8188dd92a" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 45969 } } peers { permanent_uuid: "1abd0cb9e764418eac729b7114387602" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } } }
I20260811 17:13:36.990037 13807 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:36.990269 13841 mvcc.cc:205] Tried to move back new op lower bound from 7317374635893981184 to 7317374635833397248. Current Snapshot: MvccSnapshot[applied={T|T < 7317374635893981184}]
I20260811 17:13:36.991786 13817 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1abd0cb9e764418eac729b7114387602 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6aa13d4eae704f4489c90054767865a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa13d4eae704f4489c90054767865a6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37655 } } peers { permanent_uuid: "a76ac135e03d4d35b27a23c8188dd92a" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 45969 } } peers { permanent_uuid: "1abd0cb9e764418eac729b7114387602" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } } }
I20260811 17:13:36.991937 13817 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1abd0cb9e764418eac729b7114387602 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:13:36.992449 13847 mvcc.cc:205] Tried to move back new op lower bound from 7317374635893981184 to 7317374635833397248. Current Snapshot: MvccSnapshot[applied={T|T < 7317374635893981184}]
I20260811 17:13:37.000775 13810 catalog_manager.cc:1347] Generated new cluster ID: 8f2f548e4c8946678c5967b6b355027c
I20260811 17:13:37.000890 13810 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 17:13:37.002804 13753 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6aa13d4eae704f4489c90054767865a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa13d4eae704f4489c90054767865a6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37655 } } peers { permanent_uuid: "a76ac135e03d4d35b27a23c8188dd92a" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 45969 } } peers { permanent_uuid: "1abd0cb9e764418eac729b7114387602" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } } }
I20260811 17:13:37.002978 13753 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6 [sys.catalog]: This master's current role is: LEADER
I20260811 17:13:37.004733 13779 sys_catalog.cc:455] T 00000000000000000000000000000000 P a76ac135e03d4d35b27a23c8188dd92a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6aa13d4eae704f4489c90054767865a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6aa13d4eae704f4489c90054767865a6" member_type: VOTER last_known_addr { host: "127.4.146.254" port: 37655 } } peers { permanent_uuid: "a76ac135e03d4d35b27a23c8188dd92a" member_type: VOTER last_known_addr { host: "127.4.146.253" port: 45969 } } peers { permanent_uuid: "1abd0cb9e764418eac729b7114387602" member_type: VOTER last_known_addr { host: "127.4.146.252" port: 44247 } } }
I20260811 17:13:37.004889 13779 sys_catalog.cc:458] T 00000000000000000000000000000000 P a76ac135e03d4d35b27a23c8188dd92a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 17:13:37.007277 13849 mvcc.cc:205] Tried to move back new op lower bound from 7317374635893981184 to 7317374635833397248. Current Snapshot: MvccSnapshot[applied={T|T < 7317374635893981184}]
I20260811 17:13:37.019623 13810 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 17:13:37.022589 13810 catalog_manager.cc:1504] Loading token signing keys...
I20260811 17:13:37.037511 13810 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6aa13d4eae704f4489c90054767865a6: Generated new TSK 0
I20260811 17:13:37.038596 13810 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 17:13:37.083128 13747 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:37.079263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38676 (local address 127.4.146.252:44247)
0811 17:13:37.079445 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:37.079451 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:37.081759 (+ 2308us) server_negotiation.cc:407] Connection header received
0811 17:13:37.081997 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:37.082001 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:37.082072 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:37.082139 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:37.082943 (+ 804us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38676: BlockingRecv error: recv got EOF from 127.0.0.1:38676 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260811 17:13:37.084956 13443 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:37.080289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35204 (local address 127.4.146.254:37655)
0811 17:13:37.080423 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:37.080428 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:37.083756 (+ 3328us) server_negotiation.cc:407] Connection header received
0811 17:13:37.083961 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:37.083965 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:37.084025 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:37.084136 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:37.084800 (+ 664us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35204: BlockingRecv error: recv got EOF from 127.0.0.1:35204 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260811 17:13:37.086822 13597 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:37.081048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44576 (local address 127.4.146.253:45969)
0811 17:13:37.081192 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:37.081197 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:37.085445 (+ 4248us) server_negotiation.cc:407] Connection header received
0811 17:13:37.085904 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:37.085909 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:37.085970 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:37.086032 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:37.086683 (+ 651us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44576: BlockingRecv error: recv got EOF from 127.0.0.1:44576 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
W20260811 17:13:37.092691 13597 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:37.090527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44586 (local address 127.4.146.253:45969)
0811 17:13:37.090672 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:37.090677 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:37.091273 (+ 596us) server_negotiation.cc:407] Connection header received
0811 17:13:37.091557 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:37.091561 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:37.091659 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:37.091723 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:37.092552 (+ 829us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44586: BlockingRecv error: recv got EOF from 127.0.0.1:44586 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260811 17:13:37.099005 13597 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:37.097074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44602 (local address 127.4.146.253:45969)
0811 17:13:37.097212 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:37.097218 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:37.097868 (+ 650us) server_negotiation.cc:407] Connection header received
0811 17:13:37.098112 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:37.098117 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:37.098185 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:37.098246 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:37.098870 (+ 624us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44602: BlockingRecv error: recv got EOF from 127.0.0.1:44602 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260811 17:13:37.105906 13597 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:37.104029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44610 (local address 127.4.146.253:45969)
0811 17:13:37.104190 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:37.104196 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:37.104800 (+ 604us) server_negotiation.cc:407] Connection header received
0811 17:13:37.105038 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:37.105042 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:37.105101 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:37.105158 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:37.105773 (+ 615us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44610: BlockingRecv error: recv got EOF from 127.0.0.1:44610 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260811 17:13:37.117810 13597 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:37.112743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44620 (local address 127.4.146.253:45969)
0811 17:13:37.112915 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:37.112920 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:37.116621 (+ 3701us) server_negotiation.cc:407] Connection header received
0811 17:13:37.116879 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:37.116883 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:37.116960 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:37.117020 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:37.117673 (+ 653us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44620: BlockingRecv error: recv got EOF from 127.0.0.1:44620 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
W20260811 17:13:37.131390 13597 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:37.129216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44628 (local address 127.4.146.253:45969)
0811 17:13:37.129368 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:37.129374 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:37.130167 (+ 793us) server_negotiation.cc:407] Connection header received
0811 17:13:37.130414 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:37.130419 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:37.130482 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:37.130543 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:37.131247 (+ 704us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44628: BlockingRecv error: recv got EOF from 127.0.0.1:44628 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260811 17:13:37.152475 13597 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:37.150460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44640 (local address 127.4.146.253:45969)
0811 17:13:37.150622 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:37.150626 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:37.151290 (+ 664us) server_negotiation.cc:407] Connection header received
0811 17:13:37.151551 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:37.151555 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:37.151613 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:37.151670 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:37.152348 (+ 678us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44640: BlockingRecv error: recv got EOF from 127.0.0.1:44640 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260811 17:13:37.189886 13597 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:37.187669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44652 (local address 127.4.146.253:45969)
0811 17:13:37.187822 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:37.187828 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:37.188626 (+ 798us) server_negotiation.cc:407] Connection header received
0811 17:13:37.188910 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:37.188916 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:37.188994 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:37.189064 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:37.189743 (+ 679us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44652: BlockingRecv error: recv got EOF from 127.0.0.1:44652 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260811 17:13:37.258512 13597 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:37.257047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44666 (local address 127.4.146.253:45969)
0811 17:13:37.257235 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:37.257239 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:37.257315 (+ 76us) server_negotiation.cc:407] Connection header received
0811 17:13:37.257484 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:37.257487 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:37.257560 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:37.257695 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:37.258366 (+ 671us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44666: BlockingRecv error: recv got EOF from 127.0.0.1:44666 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260811 17:13:37.390277 13597 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:37.388955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44676 (local address 127.4.146.253:45969)
0811 17:13:37.389128 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:37.389140 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:37.389251 (+ 111us) server_negotiation.cc:407] Connection header received
0811 17:13:37.389435 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:37.389439 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:37.389510 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:37.389619 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:37.390161 (+ 542us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44676: BlockingRecv error: recv got EOF from 127.0.0.1:44676 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260811 17:13:37.650283 13597 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 17:13:37.648871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44686 (local address 127.4.146.253:45969)
0811 17:13:37.649040 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:37.649046 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:37.649278 (+ 232us) server_negotiation.cc:407] Connection header received
0811 17:13:37.649468 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:37.649470 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:37.649523 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:37.649619 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 17:13:37.650142 (+ 523us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44686: BlockingRecv error: recv got EOF from 127.0.0.1:44686 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 17:13:37.942704 13797 catalog_manager.cc:1259] Loaded cluster ID: 8f2f548e4c8946678c5967b6b355027c
I20260811 17:13:37.942793 13797 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a76ac135e03d4d35b27a23c8188dd92a: loading cluster ID for follower catalog manager: success
I20260811 17:13:37.944543 13797 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a76ac135e03d4d35b27a23c8188dd92a: acquiring CA information for follower catalog manager: success
I20260811 17:13:37.945762 13797 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a76ac135e03d4d35b27a23c8188dd92a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 17:13:37.977717 13836 catalog_manager.cc:1259] Loaded cluster ID: 8f2f548e4c8946678c5967b6b355027c
I20260811 17:13:37.977838 13836 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1abd0cb9e764418eac729b7114387602: loading cluster ID for follower catalog manager: success
I20260811 17:13:37.979630 13836 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1abd0cb9e764418eac729b7114387602: acquiring CA information for follower catalog manager: success
I20260811 17:13:37.980927 13836 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1abd0cb9e764418eac729b7114387602: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 17:13:38.169003 13982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:38.164695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44702 (local address 127.4.146.253:45969)
0811 17:13:38.164954 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:38.164958 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:38.164996 (+ 38us) server_negotiation.cc:407] Connection header received
0811 17:13:38.165205 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:38.165208 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:38.165350 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:38.165459 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:13:38.165808 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:38.166377 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:38.167339 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:38.167584 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:38.167678 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:38.168002 (+ 324us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:13:38.168504 (+ 502us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:13:38.168630 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:38.168720 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 17:13:38.168780 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":80,"threads_started":1}
I20260811 17:13:38.176571 13990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:38.172495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38690 (local address 127.4.146.252:44247)
0811 17:13:38.172792 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:38.172797 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:38.172813 (+ 16us) server_negotiation.cc:407] Connection header received
0811 17:13:38.173000 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:38.173002 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:38.173148 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:38.173285 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:13:38.173527 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:38.174076 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:38.174958 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:38.175196 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:38.175307 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:38.175648 (+ 341us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:13:38.176156 (+ 508us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:13:38.176296 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:38.176341 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 17:13:38.176402 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":105,"threads_started":1}
I20260811 17:13:38.184248 13982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:38.180188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44716 (local address 127.4.146.253:45969)
0811 17:13:38.180322 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:38.180327 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:38.180704 (+ 377us) server_negotiation.cc:407] Connection header received
0811 17:13:38.180799 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:38.180805 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:38.180871 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:38.180938 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:13:38.181292 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:38.182037 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:38.182946 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:38.183299 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:38.183404 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:38.183708 (+ 304us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:13:38.183802 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:13:38.183888 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:38.183980 (+ 92us) server_negotiation.cc:299] Negotiation successful
0811 17:13:38.184036 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 17:13:38.184489 13990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:38.179921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38696 (local address 127.4.146.252:44247)
0811 17:13:38.180414 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:38.180417 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:38.180544 (+ 127us) server_negotiation.cc:407] Connection header received
0811 17:13:38.180663 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:38.180668 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:38.180722 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:38.180795 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:13:38.181143 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:38.181700 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:38.182978 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:38.183299 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:38.183404 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:38.183948 (+ 544us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:13:38.184038 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:13:38.184085 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:38.184291 (+ 206us) server_negotiation.cc:299] Negotiation successful
0811 17:13:38.184354 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150}
I20260811 17:13:38.184890 14004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 17:13:38.180068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35212 (local address 127.4.146.254:37655)
0811 17:13:38.180358 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0811 17:13:38.180364 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 17:13:38.180379 (+ 15us) server_negotiation.cc:407] Connection header received
0811 17:13:38.180482 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 17:13:38.180488 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 17:13:38.180704 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 17:13:38.180869 (+ 165us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 17:13:38.181112 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:38.181962 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:38.183100 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 17:13:38.183339 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 17:13:38.183495 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 17:13:38.183821 (+ 326us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 17:13:38.184246 (+ 425us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 17:13:38.184611 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0811 17:13:38.184643 (+ 32us) server_negotiation.cc:299] Negotiation successful
0811 17:13:38.184742 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":81,"threads_started":1}
I20260811 17:13:38.188426 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 13323
I20260811 17:13:38.208966 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 13449
I20260811 17:13:38.225539 4683 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskk7LoRW/build/debug/bin/kudu with pid 13605
2026-08-11T17:13:38Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3502 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (7161 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (326343 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST